BERTweet: A pre-trained language model for English Tweets
Dat Quoc Nguyen, Thanh Vu, Anh Tuan Nguyen
Abstract
We present BERTweet, the first public largescale pre-trained language model for English Tweets. Our BERTweet, having the same architecture as BERT base Experiments show that BERTweet outperforms strong baselines RoBERTa base and XLM-R base
Topics & Concepts
Computer scienceNatural language processingLanguage modelLicenseBase (topology)Artificial intelligenceMIT LicenseArchitectureEntity linkingNamed-entity recognitionInformation retrievalKnowledge baseTask (project management)EngineeringMathematicsOperating systemSystems engineeringVisual artsMathematical analysisArtTopic ModelingNatural Language Processing TechniquesSpeech Recognition and Synthesis