Online Ensemble Model Compression Using Knowledge Distillation
Devesh Walawalkar, Zhiqiang Shen, Marios Savvides
Topics & Concepts
Computer scienceDistillationCompression (physics)Artificial intelligenceEnsemble learningMachine learningBaseline (sea)Ensemble forecastingTraining setData miningPattern recognition (psychology)Data compressionData modelingAdvanced Neural Network ApplicationsGenerative Adversarial Networks and Image SynthesisDomain Adaptation and Few-Shot Learning