On Attention Redundancy: A Comprehensive Study
Yuchen Bian, Jiaji Huang, Xingyu Cai, Jiahong Yuan, Kenneth Church
Abstract
Yuchen Bian, Jiaji Huang, Xingyu Cai, Jiahong Yuan, Kenneth Church. Proceedings of the 2021 Conference of the North American Chapter of the Association for Computational Linguistics: Human Language Technologies. 2021.
Topics & Concepts
Redundancy (engineering)Computer scienceComputational linguisticsNatural language processingCognitive scienceLinguisticsArtificial intelligencePhilosophyPsychologyOperating systemTopic ModelingNatural Language Processing TechniquesAdvanced Graph Neural Networks