UniDrop: A Simple yet Effective Technique to Improve Transformer without Extra Cost
Zhen Wu, Lijun Wu, Qi Meng, Yingce Xia, Shufang Xie, Tao Qin, Xinyu Dai, Tie‐Yan Liu
Abstract
Zhen Wu, Lijun Wu, Qi Meng, Yingce Xia, Shufang Xie, Tao Qin, Xinyu Dai, Tie-Yan Liu. Proceedings of the 2021 Conference of the North American Chapter of the Association for Computational Linguistics: Human Language Technologies. 2021.
Topics & Concepts
TransformerComputer scienceSimple (philosophy)EngineeringPhilosophyElectrical engineeringEpistemologyVoltageNatural Language Processing TechniquesTopic ModelingSpeech Recognition and Synthesis