Self-Distillation for Improving CTC-Transformer-Based ASR Systems
Takafumi Moriya, Tsubasa Ochiai, Shigeki Karita, Hiroshi Sato, Tomohiro Tanaka, Takanori Ashihara, Ryo Masumura, Yusuke Shinohara, Marc Delcroix
Topics & Concepts
TransformerComputer scienceDistillationElectrical engineeringChemistryVoltageEngineeringChromatographyUltrasonics and Acoustic Wave PropagationNon-Destructive Testing TechniquesFault Detection and Control Systems