A framework for energy and carbon footprint analysis of distributed and federated edge learning
Stefano Savazzi, Sanaz Kianoush, Vittorio Rampa, Mehdi Bennis
Abstract
Recent advances in distributed learning raise environmental concerns due to the large energy needed to train and move data to/from data centers. Novel paradigms, such as federated learning (FL), are suitable for decentralized model training across devices or silos that simultaneously act as both data producers and learners. Unlike centralized learning (CL) techniques, relying on big-data fusion and analytics located in energy hungry data centers, in FL scenarios devices collaboratively train their models without sharing their private data. This article breaks down and analyzes the main factors that influence the environmental footprint of FL policies compared with classical CL/Big-Data algorithms running in data centers. The proposed analytical framework takes into account both learning and communication energy costs, as well as the incurred greenhouse gas, or carbon equivalent, emissions. The framework is evaluated in an industrial setting assuming a real-world robotized workplace. Results show that FL allows remarkable end-to-end energy savings (30%÷40%) in low-rate/power IoT communications (with limited energy efficiency). On the other hand, FL is slower to converge when local data are unevenly distributed (often 2x slower than CL).