mT5: A Massively Multilingual Pre-trained Text-to-Text Transformer
Linting Xue, Noah Constant, Adam P. Roberts, Mihir Kale, Rami Al‐Rfou, Aditya Siddhant, Aditya Barua, Colin Raffel
Abstract
Linting Xue, Noah Constant, Adam Roberts, Mihir Kale, Rami Al-Rfou, Aditya Siddhant, Aditya Barua, Colin Raffel. Proceedings of the 2021 Conference of the North American Chapter of the Association for Computational Linguistics: Human Language Technologies. 2021.
Topics & Concepts
TransformerComputer scienceMassively parallelComputational linguisticsAssociation (psychology)Artificial intelligenceNatural language processingElectrical engineeringEngineeringParallel computingPhilosophyEpistemologyVoltageTopic ModelingNatural Language Processing TechniquesComputational and Text Analysis Methods