SCL-IKD: intermediate knowledge distillation via supervised contrastive representation learning
Saurabh Sharma, Shikhar Singh Lodhi, Joydeep Chandra
Topics & Concepts
Computer scienceArtificial intelligenceDistillationRegularization (linguistics)Machine learningNatural language processingTask (project management)Labeled dataManagementOrganic chemistryChemistryEconomicsDomain Adaptation and Few-Shot LearningAdvanced Neural Network ApplicationsMultimodal Machine Learning Applications