Exploring Context Window of Large Language Models via Decomposed Positional Vectors
Weipeng Chen, Zican Dong, Junyi Li, Xin Men, Zhen Tian, Bingning Wang, Ji-Rong Wen, Wayne Xin Zhao
Topics & Concepts
Computer scienceContext (archaeology)Artificial intelligenceWindow (computing)Natural language processingNatural languageFeature (linguistics)Context modelIdentification (biology)Computer visionPattern recognition (psychology)Topic ModelingNatural Language Processing TechniquesLanguage and cultural evolution