Deduplicating Training Data Makes Language Models Better
Katherine Lee, Daphne Ippolito, Andrew Nystrom, Chiyuan Zhang, Douglas Eck, Chris Callison-Burch, Nicholas Carlini
2022Proceedings of the 60th Annual Meeting of the Association for Computational Linguistics (Volume 1: Long Papers)258 citationsDOIOpen Access PDF
Abstract
Katherine Lee, Daphne Ippolito, Andrew Nystrom, Chiyuan Zhang, Douglas Eck, Chris Callison-Burch, Nicholas Carlini. Proceedings of the 60th Annual Meeting of the Association for Computational Linguistics (Volume 1: Long Papers). 2022.
Topics & Concepts
ZhàngComputer scienceVolume (thermodynamics)Computational linguisticsNatural language processingArtificial intelligenceLinguisticsLibrary scienceCognitive scienceHistoryPhilosophyPsychologyPhysicsArchaeologyQuantum mechanicsChinaTopic ModelingNatural Language Processing TechniquesData Quality and Management