Meta-KD: A Meta Knowledge Distillation Framework for Language Model Compression across Domains
Haojie Pan, Chengyu Wang, Minghui Qiu, Yichang Zhang, Yaliang Li, Jun Huang
Abstract
Haojie Pan, Chengyu Wang, Minghui Qiu, Yichang Zhang, Yaliang Li, Jun Huang. Proceedings of the 59th Annual Meeting of the Association for Computational Linguistics and the 11th International Joint Conference on Natural Language Processing (Volume 1: Long Papers). 2021.
Topics & Concepts
ZhàngComputer scienceNatural language processingJoint (building)Volume (thermodynamics)Artificial intelligenceMacroMeta-analysisLinguisticsChinaEngineeringHistoryProgramming languagePhilosophyInternal medicineMedicineArchaeologyArchitectural engineeringQuantum mechanicsPhysicsTopic ModelingNatural Language Processing TechniquesMultimodal Machine Learning Applications