TinyViT: Fast Pretraining Distillation for Small Vision Transformers
Kan Wu, Jinnian Zhang, Houwen Peng, Mengchen Liu, Bin Xiao, Jianlong Fu, Lu Yuan
Topics & Concepts
Computer scienceTransformerComputationDistillationArtificial intelligenceMachine learningSource codeAlgorithmVoltageProgramming languageQuantum mechanicsPhysicsOrganic chemistryChemistryAdvanced Neural Network ApplicationsVisual Attention and Saliency DetectionAdvanced Image and Video Retrieval Techniques