Investigating Learning Dynamics of BERT Fine-Tuning
Yaru Hao, Li Dong, Furu Wei, Ke Xu
Abstract
Yaru Hao, Li Dong, Furu Wei, Ke Xu. Proceedings of the 1st Conference of the Asia-Pacific Chapter of the Association for Computational Linguistics and the 10th International Joint Conference on Natural Language Processing. 2020.
Topics & Concepts
Fine-tuningComputer scienceConsistency (knowledge bases)Divergence (linguistics)Mode (computer interface)Feature (linguistics)Process (computing)Dynamics (music)Artificial intelligenceLanguage modelFeature extractionHuman–computer interactionPhysicsOperating systemPhilosophyAcousticsQuantum mechanicsLinguisticsTopic ModelingNatural Language Processing TechniquesMultimodal Machine Learning Applications