Octopus: SLO-Aware Progressive Inference Serving via Deep Reinforcement Learning in Multi-tenant Edge Cluster
Ziyang Zhang, Yang Zhao, Jie Liu
Topics & Concepts
Computer scienceInferenceScheduling (production processes)Artificial intelligenceEdge deviceEnhanced Data Rates for GSM EvolutionDistributed computingThroughputEdge computingReinforcement learningMachine learningCloud computingWirelessOperating systemEconomicsOperations managementIoT and Edge/Fog ComputingAge of Information OptimizationAdvanced Neural Network Applications