Compute-Optimal Resource Allocation for Distributed Large Language Model Inference in Cloud-Scale Intelligent Systems
Tejas Patel, Sandeep Shivam, Viswanathan Ranganathan
Topics & Concepts
Computer scienceArtificial intelligenceInferenceResource allocationIntelligent decision support systemResource (disambiguation)Data miningData modelingMachine learningExpert systemKnowledge representation and reasoningKey (lock)Scheme (mathematics)Big Data and Digital EconomyIoT and Edge/Fog ComputingAdvanced Neural Network Applications