xCCL: A Survey of Industry-Led Collective Communication Libraries for Deep Learning
Adam Weingram, Yuke Li, Hao Qi, Darren Ng, Liuyao Dai, Xiaoyi Lu
Topics & Concepts
Computer scienceProcess (computing)Deep learningKey (lock)Focus (optics)Node (physics)Artificial intelligenceData scienceMachine learningKnowledge managementEngineeringStructural engineeringPhysicsOpticsComputer securityOperating systemFerroelectric and Negative Capacitance DevicesAdvanced Memory and Neural ComputingStochastic Gradient Optimization Techniques