Lifting the Curse of Multilinguality by Pre-training Modular Transformers
Jonas Pfeiffer, Naman Goyal, Xi Lin, Xian Li, James H. Cross, Sebastian Riedel, Mikel Artetxe
2022Proceedings of the 2022 Conference of the North American Chapter of the Association for Computational Linguistics: Human Language Technologies61 citationsDOIOpen Access PDF
Abstract
Jonas Pfeiffer, Naman Goyal, Xi Lin, Xian Li, James Cross, Sebastian Riedel, Mikel Artetxe. Proceedings of the 2022 Conference of the North American Chapter of the Association for Computational Linguistics: Human Language Technologies. 2022.
Topics & Concepts
Modular designCurseTransformerComputational linguisticsComputer scienceArtificial intelligenceProgramming languageEngineeringPhilosophyElectrical engineeringTheologyVoltageNatural Language Processing Techniques