Litcius/Paper detail

Attention is Not Only a Weight: Analyzing Transformers with Vector Norms

Goro Kobayashi

2021Journal of Natural Language Processing21 citationsDOIOpen Access PDF

Topics & Concepts

TransformerComputer sciencePsychologyElectrical engineeringEngineeringVoltageTopic ModelingNatural Language Processing TechniquesNeural Networks and Applications
Attention is Not Only a Weight: Analyzing Transformers with Vector Norms | Litcius