Logo image
Poster: Optimal Variance-Reduced Client Sampling for Multiple Models Federated Learning
Conference proceeding

Poster: Optimal Variance-Reduced Client Sampling for Multiple Models Federated Learning

Haoran Zhang, Zekai Li, Zejun Gong, Marie Siew, Carlee Joe-Wong, Rachid El-Azouzi and IEEE COMPUTER SOC
Proceedings of the International Conference on Distributed Computing Systems, pp.1446-1447
23/07/2024

Abstract

Accuracy Client Sampling Computational modeling Distributed databases Federated learning Multiple Models Federated Learning Sampling methods System performance Training
Federated learning (FL) is a variant of distributed learning in which multiple clients collaborate to learn a global model without sharing their data with the central server. In real-world scenarios, a client may be involved in training multiple unrelated FL models, which we call multi-model federated learning (MMFL), and the client sampling strategy and task allocation are crucial for improving system performance. In this paper, we propose an optimal sampling method to minimize the variance of global updates for unbiased learning in MMFL systems. The resulting method achieves an average accuracy of over 30 % higher than other baseline methods, as we demonstrate through simulations on real-world federated datasets.

Metrics

1 Record Views

Details

Logo image