Kronecker Decomposition for GPT Compression
Ali Edalati, Marzieh S. Tahaei, Ahmad Rashid, Vahid Partovi Nia, James H. Clark, Mehdi Rezagholizadeh
Abstract
Ali Edalati, Marzieh Tahaei, Ahmad Rashid, Vahid Nia, James Clark, Mehdi Rezagholizadeh. Proceedings of the 60th Annual Meeting of the Association for Computational Linguistics (Volume 2: Short Papers). 2022.
Topics & Concepts
Kronecker deltaDecompositionComputer scienceKronecker productVolume (thermodynamics)Compression (physics)LinguisticsPhilosophyPhysicsEcologyThermodynamicsBiologyQuantum mechanicsAlgorithms and Data CompressionTopic ModelingNatural Language Processing Techniques