H2O: Heavy-Hitter Oracle for Efficient Generative Inference of Large Language Models
Clark Barrett, Ruisi Cai, Beidi Chen, Tianlong Chen, Christopher Ré, Ying Sheng, Zhao Song, Yuandong Tian, Zhangyang "atlas" Wang, Zhenyu Zhang, Lianmin Zheng, Tianyi Zhou
Topics & Concepts
Computer scienceArtificial intelligenceNatural language processingInferenceGenerative grammarOracleLanguage modelGenerative modelNatural languageFeature (linguistics)Machine learningData modelingSemantics (computer science)Natural Language Processing TechniquesTopic ModelingMachine Learning in Healthcare