GhostBERT: Generate More Features with Cheap Operations for BERT
Zhiqi Huang, Lu Hou, Lifeng Shang, Xin Jiang, Xiao Chen, Qun Liu
Abstract
Zhiqi Huang, Lu Hou, Lifeng Shang, Xin Jiang, Xiao Chen, Qun Liu. Proceedings of the 59th Annual Meeting of the Association for Computational Linguistics and the 11th International Joint Conference on Natural Language Processing (Volume 1: Long Papers). 2021.
Topics & Concepts
ChenComputer scienceNatural language processingComputational linguisticsVolume (thermodynamics)Joint (building)Artificial intelligenceLinguisticsProgramming languageTheoretical computer scienceLibrary sciencePhilosophyEngineeringPhysicsPaleontologyBiologyQuantum mechanicsArchitectural engineeringTopic ModelingNatural Language Processing TechniquesMultimodal Machine Learning Applications