Improving knowledge distillation using unified ensembles of specialized teachers
Adamantios Zaras, Nikolaos Passalis, Anastasios Tefas
Topics & Concepts
DistillationComputer scienceProcess (computing)Machine learningSet (abstract data type)Artificial intelligenceEnsemble learningChemistryChromatographyOperating systemProgramming languageAdvanced Neural Network ApplicationsDomain Adaptation and Few-Shot LearningAdversarial Robustness in Machine Learning