Super Tickets in Pre-Trained Language Models: From Model Compression to Improving Generalization
Liang Chen, Simiao Zuo, Minshuo Chen, Haoming Jiang, Xiaodong Liu, Pengcheng He, Tuo Zhao, Weizhu Chen
Abstract
Chen Liang, Simiao Zuo, Minshuo Chen, Haoming Jiang, Xiaodong Liu, Pengcheng He, Tuo Zhao, Weizhu Chen. Proceedings of the 59th Annual Meeting of the Association for Computational Linguistics and the 11th International Joint Conference on Natural Language Processing (Volume 1: Long Papers). 2021.
Topics & Concepts
ChenGeneralizationComputer scienceNatural language processingVolume (thermodynamics)Computational linguisticsArtificial intelligenceLinguisticsJoint (building)Speech recognitionMathematicsEngineeringPhilosophyArchitectural engineeringBiologyPaleontologyMathematical analysisPhysicsQuantum mechanicsNatural Language Processing TechniquesTopic ModelingMultimodal Machine Learning Applications