KroneckerBERT: Significant Compression of Pre-trained Language Models Through Kronecker Decomposition and Knowledge Distillation
Marzieh S. Tahaei, Ella Charlaix, Vahid Partovi Nia, Ali Ghodsi, Mehdi Rezagholizadeh
2022Proceedings of the 2022 Conference of the North American Chapter of the Association for Computational Linguistics: Human Language Technologies12 citationsDOIOpen Access PDF
Abstract
Marzieh Tahaei, Ella Charlaix, Vahid Nia, Ali Ghodsi, Mehdi Rezagholizadeh. Proceedings of the 2022 Conference of the North American Chapter of the Association for Computational Linguistics: Human Language Technologies. 2022.
Topics & Concepts
Computer scienceDecompositionAssociation (psychology)Natural language processingCompression (physics)Kronecker deltaArtificial intelligencePhilosophyChemistryEpistemologyMaterials sciencePhysicsComposite materialOrganic chemistryQuantum mechanicsTopic ModelingNatural Language Processing TechniquesSpeech Recognition and Synthesis