Knowledge Transfer from Pre-trained Language Models to Cif-based Speech Recognizers via Hierarchical Distillation
Minglun Han, Feilong Chen, Jing Shi, Shuang Xu, Bo Xu
Topics & Concepts
Computer scienceDistillationNatural language processingSpeech recognitionArtificial intelligenceLanguage modelChemistryOrganic chemistrySpeech Recognition and Synthesis