EarlyBERT: Efficient BERT Training via Early-bird Lottery Tickets
Xiaohan Chen, Yu Cheng, Shuohang Wang, Zhe Gan, Zhangyang Wang, Jun Liu
Abstract
Xiaohan Chen, Yu Cheng, Shuohang Wang, Zhe Gan, Zhangyang Wang, Jingjing Liu. Proceedings of the 59th Annual Meeting of the Association for Computational Linguistics and the 11th International Joint Conference on Natural Language Processing (Volume 1: Long Papers). 2021.
Topics & Concepts
LotteryComputer scienceChenAssociation (psychology)Joint (building)Computational linguisticsVolume (thermodynamics)Artificial intelligenceTraining (meteorology)Natural language processingEngineeringGeographyMathematicsPsychologyEcologyPhysicsQuantum mechanicsArchitectural engineeringPsychotherapistStatisticsBiologyMeteorologyTopic ModelingNatural Language Processing TechniquesMultimodal Machine Learning Applications