Knowledge Transfer via Dense Cross-Layer Mutual-Distillation
Anbang Yao, Dawei Sun
Topics & Concepts
Computer scienceDistillationCode (set theory)Scheme (mathematics)Layer (electronics)Artificial intelligenceRepresentation (politics)ScratchKnowledge transferVariety (cybernetics)Mutual informationTransfer of learningMachine learningArtificial neural networkProgramming languageMathematicsLawPoliticsMathematical analysisSet (abstract data type)ChemistryPolitical scienceOrganic chemistryKnowledge managementDomain Adaptation and Few-Shot LearningMachine Learning and ELMAdvanced Neural Network Applications