Advances of Pipeline Model Parallelism for Deep Learning Training: An Overview
Lei Guan, Dongsheng Li, Jiye Liang, Wenjian Wang, Keshi Ge, Xicheng Lu
Topics & Concepts
Computer scienceParallelism (grammar)Pipeline (software)Theory of computationTraining (meteorology)Data parallelismParallel computingTask parallelismArtificial intelligenceDeep learningMachine learningProgramming languageMeteorologyPhysicsAdvanced Neural Network ApplicationsAnomaly Detection Techniques and ApplicationsTopic Modeling