LLM in a flash: Efficient Large Language Model Inference with Limited Memory
Keivan Alizadeh, Seyed Iman Mirzadeh, Dmitry Belenko, S. Karen Khatamifard, Minsik Cho, Carlo C. Del Mundo, Mohammad Rastegari, Mehrdad Farajtabar
Abstract
Keivan Alizadeh, Seyed Iman Mirzadeh, Dmitry Belenko, S. Khatamifard, Minsik Cho, Carlo C Del Mundo, Mohammad Rastegari, Mehrdad Farajtabar. Proceedings of the 62nd Annual Meeting of the Association for Computational Linguistics (Volume 1: Long Papers). 2024.
Topics & Concepts
Computer scienceInferenceNatural language processingLanguage modelArtificial intelligenceProgramming languageNatural Language Processing TechniquesTopic ModelingSpeech Recognition and Synthesis