Agree to Disagree: Adaptive Ensemble Knowledge Distillation in Gradient Space
Shangchen Du, Shan You, Xiaojie Li, Jianlong Wu, Fei Wang, Chen Qian, Changshui Zhang
2020Neural Information Processing Systems58 citations
Topics & Concepts
Computer scienceDistillationSpace (punctuation)Artificial intelligenceStatistical physicsPhysicsChemistryChromatographyOperating systemNeural Networks and ApplicationsStochastic Gradient Optimization TechniquesMachine Learning and ELM