Knowledge Fusion Distillation: Improving Distillation with Multi-scale Attention Mechanisms
Linfeng Li, Weixing Su, Fang Liu, Maowei He, Xiaodan Liang
Topics & Concepts
DistillationComputer scienceArtificial intelligenceFeature (linguistics)Machine learningFusionArtificial neural networkProcess engineeringEngineeringChemistryPhilosophyOrganic chemistryLinguisticsAdvanced Neural Network ApplicationsDomain Adaptation and Few-Shot LearningMachine Learning and Data Classification