On the Effect of Pretraining Corpora on In-context Learning by a Large-scale Language Model
Seongjin Shin, Sang-Woo Lee, Hwijeen Ahn, Sungdong Kim, HyoungSeok Kim, Boseop Kim, Kyunghyun Cho, Gichang Lee, Woomyoung Park, Jung-Woo Ha, Nako Sung
2022Proceedings of the 2022 Conference of the North American Chapter of the Association for Computational Linguistics: Human Language Technologies34 citationsDOIOpen Access PDF
Abstract
Seongjin Shin, Sang-Woo Lee, Hwijeen Ahn, Sungdong Kim, HyoungSeok Kim, Boseop Kim, Kyunghyun Cho, Gichang Lee, Woomyoung Park, Jung-Woo Ha, Nako Sung. Proceedings of the 2022 Conference of the North American Chapter of the Association for Computational Linguistics: Human Language Technologies. 2022.
Topics & Concepts
Computer scienceLanguage modelContext (archaeology)Natural language processingLinguisticsComputational linguisticsArtificial intelligenceScale (ratio)Cognitive scienceCorpus linguisticsPsychologyHistoryPhilosophyCartographyGeographyArchaeologyNatural Language Processing TechniquesTopic Modeling