ReAugKD: Retrieval-Augmented Knowledge Distillation For Pre-trained Language Models
Jianyi Zhang, Aashiq Muhamed, Aditya Anantharaman, Guoyin Wang, Changyou Chen, Kai Zhong, Qingjun Cui, Yi Xu, Belinda Zeng, Trishul Chilimbi, Yiran Chen
Abstract
Jianyi Zhang, Aashiq Muhamed, Aditya Anantharaman, Guoyin Wang, Changyou Chen, Kai Zhong, Qingjun Cui, Yi Xu, Belinda Zeng, Trishul Chilimbi, Yiran Chen. Proceedings of the 61st Annual Meeting of the Association for Computational Linguistics (Volume 2: Short Papers). 2023.
Topics & Concepts
ChenZhàngComputer scienceNatural language processingAssociation (psychology)Artificial intelligenceVolume (thermodynamics)DistillationPhilosophyChemistryHistoryEpistemologyPhysicsChromatographyArchaeologyGeologyQuantum mechanicsChinaPaleontologyTopic ModelingNatural Language Processing Techniques