Robust Lottery Tickets for Pre-trained Language Models
Rui Zheng, Bao Rong, Yuhao Zhou, Di Liang, Sirui Wang, Wei Wu, Tao Gui, Qi Zhang, Xuanjing Huang
2022Proceedings of the 60th Annual Meeting of the Association for Computational Linguistics (Volume 1: Long Papers)17 citationsDOIOpen Access PDF
Abstract
Rui Zheng, Bao Rong, Yuhao Zhou, Di Liang, Sirui Wang, Wei Wu, Tao Gui, Qi Zhang, Xuanjing Huang. Proceedings of the 60th Annual Meeting of the Association for Computational Linguistics (Volume 1: Long Papers). 2022.
Topics & Concepts
Adversarial systemComputer scienceRobustness (evolution)Regularization (linguistics)SmoothingArtificial intelligenceBinary numberLotteryMachine learningDifferentiable functionAdversaryLanguage modelComputer securityMathematicsComputer visionGeneStatisticsMathematical analysisArithmeticChemistryBiochemistryTopic ModelingAdversarial Robustness in Machine LearningNatural Language Processing Techniques