Client Selection for Federated Learning With Label Noise
Miao Yang, Hua Qian, Ximin Wang, Yong Zhou, Hongbin Zhu
Abstract
Federated learning (FL) unleashes the full potential of training a global statistical model collaboratively from edge clients. In wireless FL, for the scarcity of spectrum, only a fraction of clients are capable to participate in the FL training in each round. On the other hand, the performance of FL suffers from the label noise, which naturally exists in the dataset of each client. To alleviate the label noise issue, prior works proposed several client selection algorithms, where the privacy of raw data might be compromised when extra information exchange was introduced. To avoid extra information exchange in FL, we propose to leverage an algorithm that measures the noise ratio of each client based on a clean validation dataset. We then propose an online client selection framework, supported by Copeland score and multi-arm bandits, which can select the client set with low noise ratios efficiently. The proposed algorithm is performed in the server side, thereby it can be implemented in the basic FL framework seamlessly. Simulation results demonstrate that our proposed algorithm spends less training time while guaranteeing the required accuracy compared to other baseline algorithms.