Compressing Pre-trained Language Models by Matrix Decomposition
Matan Ben Noach, Yoav Goldberg
Abstract
Matan Ben Noach, Yoav Goldberg. Proceedings of the 1st Conference of the Asia-Pacific Chapter of the Association for Computational Linguistics and the 10th International Joint Conference on Natural Language Processing. 2020.
Topics & Concepts
Computer scienceBenchmark (surveying)Metric (unit)InferenceDecompositionFactor (programming language)Artificial intelligenceRepresentation (politics)Feature (linguistics)Language modelMachine learningProgramming languageGeographyPoliticsBiologyLawLinguisticsGeodesyEconomicsPolitical sciencePhilosophyEcologyOperations managementTopic ModelingNatural Language Processing TechniquesSpeech Recognition and Synthesis