ERNIE-Gram: Pre-Training with Explicitly N-Gram Masked Language Modeling for Natural Language Understanding
Dongling Xiao, Yukun Li, Han Zhang, Yu Sun, Hao Tian, Hua Wu, Haifeng Wang
Abstract
Dongling Xiao, Yu-Kun Li, Han Zhang, Yu Sun, Hao Tian, Hua Wu, Haifeng Wang. Proceedings of the 2021 Conference of the North American Chapter of the Association for Computational Linguistics: Human Language Technologies. 2021.
Topics & Concepts
Natural language processingComputational linguisticsn-gramComputer scienceNatural languageArtificial intelligenceZhàngLanguage modelLinguisticsPhilosophyHistoryChinaArchaeologyTopic ModelingNatural Language Processing TechniquesSpeech Recognition and Synthesis