SGLang: Efficient Execution of Structured Language Model Programs
Clark Barrett, Shiyi Cao, Joseph E. Gonzalez, Jeff Huang, Christos Kozyrakis, Ying Sheng, Ion Stoica, Chuyue Sun, Zhiqiang Xie, Liangsheng Yin, Chengtao Yu, Lianmin Zheng
Topics & Concepts
Computer scienceProgramming languageStructured programmingNatural language processingSoftware engineeringArtificial intelligenceExecution modelSemantics (computer science)Modeling languageStructured EnglishStructured predictionComponent (thermodynamics)SoftwareSet (abstract data type)Model-Driven Software Engineering TechniquesNatural Language Processing TechniquesLogic, programming, and type systems