FedOps: A Platform of Federated Learning Operations With Heterogeneity Management
J. Moon, S.H. Yang, Kang Yoon Lee
Abstract
Federated learning (FL) is a decentralized machine learning (ML) method that enables model training while preserving privacy. FL is gaining attention because it avoids data transfer to the server, facilitating the decentralized learning of the traditional ML model. Despite its potential, FL project is significantly more challenging to develop than centralized ML methods owing to decentralized local data. We propose <italic xmlns:mml="http://www.w3.org/1998/Math/MathML" xmlns:xlink="http://www.w3.org/1999/xlink">FedOps</i> , federated learning operations for constructing systematic FL project by enhancing machine learning operations (MLOps) to be effectively applied to FL while preserving its core process. To address complexity of FL implementation, we developed <italic xmlns:mml="http://www.w3.org/1998/Math/MathML" xmlns:xlink="http://www.w3.org/1999/xlink">FedOps platform</i> , which involves <italic xmlns:mml="http://www.w3.org/1998/Math/MathML" xmlns:xlink="http://www.w3.org/1999/xlink">FedOps</i> -based projects to manage the whole lifecycle in FL context. We also investigated methods to identify performance degradation factors in FL and suggest an approach for improvement. <italic xmlns:mml="http://www.w3.org/1998/Math/MathML" xmlns:xlink="http://www.w3.org/1999/xlink">FedOps Platform</i> provides an analysis tool for client heterogeneity, called <italic xmlns:mml="http://www.w3.org/1998/Math/MathML" xmlns:xlink="http://www.w3.org/1999/xlink">chunk-bench</i> . This tool enables researchers and engineers to gain insights into systems heterogeneity by using only small chunk of the clients’ data to execute test in the shortest time possible while tracking the systems heterogeneity across the clients. By addressing systems heterogeneity, <italic xmlns:mml="http://www.w3.org/1998/Math/MathML" xmlns:xlink="http://www.w3.org/1999/xlink">FedOps Platform</i> achieved 13%-43% improvement in communication cost-to-accuracy and 20%-68% improvement in time-to-accuracy. We believe that <italic xmlns:mml="http://www.w3.org/1998/Math/MathML" xmlns:xlink="http://www.w3.org/1999/xlink">FedOps Platform</i> offers an optimal solution for end-to-end development of FL projects, with significantly improving both computational and communication efficiencies.