Sketch-fusion: A gradient compression method with multi-layer fusion for communication-efficient distributed training
Lingfei Dai, Luqi Gong, Zhulin An, Yongjun Xu, Boyu Diao
Topics & Concepts
Computer scienceScalabilityCompression ratioOverhead (engineering)Data compressionSketchCompression (physics)Convergence (economics)Data compression ratioComputer engineeringAlgorithmArtificial intelligenceImage compressionImage (mathematics)DatabaseImage processingAutomotive engineeringMaterials scienceEngineeringEconomic growthInternal combustion engineOperating systemEconomicsComposite materialStochastic Gradient Optimization TechniquesAdvanced Neural Network ApplicationsDomain Adaptation and Few-Shot Learning