AutoTinyBERT: Automatic Hyper-parameter Optimization for Efficient Pre-trained Language Models
Yichun Yin, Cheng Chen, Lifeng Shang, Xin Jiang, Xiao Chen, Qun Liu
Abstract
Yichun Yin, Cheng Chen, Lifeng Shang, Xin Jiang, Xiao Chen, Qun Liu. Proceedings of the 59th Annual Meeting of the Association for Computational Linguistics and the 11th International Joint Conference on Natural Language Processing (Volume 1: Long Papers). 2021.
Topics & Concepts
ChenComputer scienceComputational linguisticsNatural language processingVolume (thermodynamics)Association (psychology)Joint (building)Artificial intelligenceLinguisticsPhilosophyEngineeringEpistemologyPhysicsQuantum mechanicsPaleontologyArchitectural engineeringBiologyTopic ModelingNatural Language Processing TechniquesMultimodal Machine Learning Applications