Dynamic layer-wise sparsification for distributed deep learning
Hao Zhang, Tingting Wu, Zhifeng Ma, Feng Li, Jie Liu
Topics & Concepts
Computer scienceOverhead (engineering)Stochastic gradient descentLayer (electronics)ComputationUploadAlgorithmSpeedupArtificial intelligenceDeep learningGradient descentArtificial neural networkMachine learningDistributed computingParallel computingChemistryOperating systemOrganic chemistryStochastic Gradient Optimization TechniquesPrivacy-Preserving Technologies in DataAdvanced Neural Network Applications