Self-training Improves Pre-training for Natural Language Understanding
Jingfei Du, Édouard Grave, Beliz Gunel, Vishrav Chaudhary, Onur Çelebi, Michael Auli, Veselin Stoyanov, Alexis Conneau
Abstract
Jingfei Du, Edouard Grave, Beliz Gunel, Vishrav Chaudhary, Onur Celebi, Michael Auli, Veselin Stoyanov, Alexis Conneau. Proceedings of the 2021 Conference of the North American Chapter of the Association for Computational Linguistics: Human Language Technologies. 2021.
Topics & Concepts
Computer scienceTraining (meteorology)Natural languageArtificial intelligenceAssociation (psychology)Natural language processingNatural (archaeology)LinguisticsPhilosophyHistoryArchaeologyEpistemologyPhysicsMeteorologyTopic ModelingNatural Language Processing TechniquesSpeech and dialogue systems