Is Domain Adaptation Worth Your Investment? Comparing BERT and FinBERT on Financial Tasks
Bo Peng, Emmanuele Chersoni, Yu-Yin Hsu, Chu‐Ren Huang
Abstract
With the recent rise in popularity of Transformer models in Natural Language Processing, research efforts have been dedicated to the development of domain-adapted versions of BERT-like architectures.
Topics & Concepts
TransformerComputer sciencePopularityDomain adaptationScratchVariety (cybernetics)Domain (mathematical analysis)FinanceArtificial intelligenceEconomicsPsychologyEngineeringProgramming languageMathematical analysisClassifier (UML)Social psychologyVoltageMathematicsElectrical engineeringTopic ModelingNatural Language Processing TechniquesStock Market Forecasting Methods