Training data-efficient image transformers & distillation through attention
Hugo, Touvron, Matthieu Cord, Matthijs Douze, Massa Francisco, Alexandre, Sablayrolles, Herve, Jegou
2021HAL (Le Centre pour la Communication Scientifique Directe)20 citations
Abstract
International audience
Topics & Concepts
Computer scienceDistillationTransformerArtificial intelligenceTraining (meteorology)Training setComputer visionElectrical engineeringEngineeringVoltageChemistryMeteorologyOrganic chemistryPhysicsCurrency Recognition and DetectionNeural Networks and Applications