Found in the middle: Calibrating Positional Attention Bias Improves Long Context Utilization
Cheng-Yu Hsieh, Yung-Sung Chuang, Chunliang Li, Zifeng Wang, Long Tan Le, Abhishek Kumar, James M. Glass, Alexander Ratner, Chen‐Yu Lee, Ranjay Krishna, Tomas Pfister
Abstract
Cheng-Yu Hsieh, Yung-Sung Chuang, Chun-Liang Li, Zifeng Wang, Long Le, Abhishek Kumar, James Glass, Alexander Ratner, Chen-Yu Lee, Ranjay Krishna, Tomas Pfister. Findings of the Association for Computational Linguistics: ACL 2024. 2024.
Topics & Concepts
Context (archaeology)Computer scienceCalibrationStatisticsMathematicsGeographyArchaeologyNeural and Behavioral Psychology Studies