DynamicKD: An effective knowledge distillation via dynamic entropy correction-based distillation for gap optimizing
Songling Zhu, Ronghua Shang, Bo Yuan, Weitong Zhang, Wenjie Li, Yangyang Li, Licheng Jiao
Topics & Concepts
DistillationComputer scienceProcess engineeringEntropy (arrow of time)ChromatographyChemistryThermodynamicsEngineeringPhysicsAdvanced Neural Network ApplicationsIoT and Edge/Fog ComputingAdvanced Image and Video Retrieval Techniques