Litcius/Paper detail

Self-attention Mechanism at the Token Level: Gradient Analysis and Algorithm Optimization

Linqing Liu, Xiaolong Xu

2023Knowledge-Based Systems24 citationsDOI

Topics & Concepts

Computer scienceSecurity tokenTransformerMachine translationArtificial intelligenceMechanism (biology)AlgorithmDistortion (music)VoltageComputer securityBandwidth (computing)PhysicsComputer networkQuantum mechanicsEpistemologyPhilosophyAmplifierTopic ModelingDomain Adaptation and Few-Shot LearningAdvanced Neural Network Applications
Self-attention Mechanism at the Token Level: Gradient Analysis and Algorithm Optimization | Litcius