Training Trajectories of Language Models Across Scales
Mengzhou Xia, Mikel Artetxe, Chunting Zhou, Xi Victoria Lin, Ramakanth Pasunuru, Danqi Chen, Luke Zettlemoyer, Veselin Stoyanov
Abstract
Mengzhou Xia, Mikel Artetxe, Chunting Zhou, Xi Victoria Lin, Ramakanth Pasunuru, Danqi Chen, Luke Zettlemoyer, Veselin Stoyanov. Proceedings of the 61st Annual Meeting of the Association for Computational Linguistics (Volume 1: Long Papers). 2023.
Topics & Concepts
ChenComputational linguisticsComputer scienceVolume (thermodynamics)Association (psychology)Training (meteorology)Natural language processingArtificial intelligenceLinguisticsGeographyPhilosophyGeologyEpistemologyPhysicsQuantum mechanicsMeteorologyPaleontologyTopic ModelingNatural Language Processing Techniques