REST: Retrieval-Based Speculative Decoding
Zhenyu He, Zexuan Zhong, Tianle Cai, Jason Lee, Di He
Abstract
Zhenyu He, Zexuan Zhong, Tianle Cai, Jason Lee, Di He. Proceedings of the 2024 Conference of the North American Chapter of the Association for Computational Linguistics: Human Language Technologies (Volume 1: Long Papers). 2024.
Topics & Concepts
Rest (music)Decoding methodsComputer scienceAlgorithmPhysicsAcousticsTopic ModelingNatural Language Processing Techniques