Layerwised multimodal knowledge distillation for vision-language pretrained model
Jin Wang, Dawei Liao, You Zhang, Dan Xu, Xuejie Zhang
Topics & Concepts
Computer scienceDistillationModalitiesArtificial intelligenceModality (human–computer interaction)OverfittingMachine learningLanguage modelTransformerArtificial neural networkVoltageOrganic chemistryQuantum mechanicsChemistrySociologySocial sciencePhysicsMultimodal Machine Learning ApplicationsDomain Adaptation and Few-Shot LearningTopic Modeling