Energy Considerations of Large Language Model Inference and Efficiency Optimizations
Jared Fernandez, Clara Na, V. Tiwari, Yonatan Bisk, Sasha Luccioni, Emma Strubell
Abstract
Jared Fernandez, Clara Na, Vashisth Tiwari, Yonatan Bisk, Sasha Luccioni, Emma Strubell. Proceedings of the 63rd Annual Meeting of the Association for Computational Linguistics (Volume 1: Long Papers). 2025.
Topics & Concepts
Computer scienceInferenceEfficient energy useProgramming languageArtificial intelligenceEngineeringElectrical engineeringTopic Modeling