Categories of Response-Based, Feature-Based, and Relation-Based Knowledge Distillation
Chuanguang Yang, Xinqiang Yu, Zhulin An, Yongjun Xu
Topics & Concepts
DistillationComputer scienceArtificial intelligenceParameterized complexityMachine learningArtificial neural networkRelation (database)Data miningAlgorithmChemistryOrganic chemistryAdvanced Neural Network ApplicationsAdversarial Robustness in Machine LearningDomain Adaptation and Few-Shot Learning