Optimizing makespan and resource utilization for multi-DNN training in GPU cluster
Zhongjin Li, Victor Chang, Haiyang Hu, Maozhong Fu, Jidong Ge, Francesco Piccialli
Topics & Concepts
Computer scienceJob shop schedulingGPU clusterScheduling (production processes)Distributed computingArtificial neural networkDeep learningArtificial intelligenceJob schedulerAsynchronous communicationSpeedupMachine learningReal-time computingParallel computingCUDAMathematical optimizationCloud computingComputer networkScheduleOperating systemMathematicsAdvanced Neural Network ApplicationsFerroelectric and Negative Capacitance DevicesStochastic Gradient Optimization Techniques