Workload consolidation in alibaba clusters
Yongkang Zhang, Yinghao Yu, Wei Wang, Qiukai Chen, Jie Wu, Zuowei Zhang, Jiang Zhong, Tianchen Ding, Qizhen Weng, Lingyun Yang, Cheng Wang, Jian He, Guodong Yang, Liping Zhang
Abstract
Web companies typically run latency-critical long-running services and resource-intensive, throughput-hungry batch jobs in a shared cluster for improved utilization and reduced cost. Despite many recent studies on workload consolidation, the production practice remains largely unknown. This paper describes our efforts to efficiently consolidate the two types of workloads in Alibaba clusters to support the company's e-commerce businesses.
Topics & Concepts
WorkloadConsolidation (business)Computer scienceLatency (audio)BusinessCluster (spacecraft)Industrial organizationOperating systemTelecommunicationsFinanceCloud Computing and Resource ManagementDistributed and Parallel Computing SystemsIoT and Edge/Fog Computing