RoFormer: Enhanced transformer with Rotary Position Embedding
Jianlin Su, Murtadha Ahmed, Yu Lu, Shengfeng Pan, Bo Wen, Yunfeng Liu
Topics & Concepts
EmbeddingComputer scienceTransformerRopeLeverage (statistics)Security tokenArtificial intelligenceAlgorithmEngineeringElectrical engineeringComputer securityVoltageTopic ModelingNatural Language Processing TechniquesAdvanced Text Analysis Techniques