pMixFed: Mixing up model coefficients for Efficient Personalized Federated Learning
Personalized federated learning;Distributed computing
violating formatting guideline
 (use smaller font size from the bottom of page 6 all the way to the end of the main text (end of page 10), which enables it to squeeze in substantially more content.)
Submission Desk Rejected by Program Chairs
An adaptive and dynamic partial PFL method which tunes the generalization and personalization degree using mixup
@misc{
saadati2024pmixfed,
title={pMixFed: Mixing up model coefficients for Efficient Personalized Federated Learning},
author={Yasaman Saadati and Mohammad Rostami and M. Hadi Amini},
year={2024},
url={https://openreview.net/forum?id=lX8DahcJbL}
}
Federated Learning  enables decentralized collaborative learning of machine learning models which presents challenges such as data privacy  and client drift for heterogeneous data. Traditional FL methods offer strong generalization but lack personalized solutions for non-IID data. Personalized federated learning (PFL) addresses   data heterogeneity by tackling these issues through balancing generalization and personalization level. It, however, still faces challenges such as optimal model partitioning and catastrophic forgetting that reduce quality and accuracy of both local and global models. To address these challenges,  we propose ``pMixFed'', a dynamic, layer-wise PFL approach integrating mixup between shared global and personalized local models. We develop adaptive partitioning between shared and personalized layers of the model,  gradual transition of personalization to allow seamless adaptation of local clients, improved generalization across clients, and mitigation of catastrophic forgetting. We provide theoretical analysis of pMixFed. Further, we conduct extensive experiments to demonstrate   its superior performance compared with the existing PFL methods. Empirical results hows faster training, increased robustness, and improved handling of  heterogeneity when using pMixFed as compared with the state-of-the-art PFL models.
I certify that there is no URL (e.g., github page) that could be used to find authors’ identity.
~Yasaman_Saadati1 ~Mohammad_Rostami1 ~M._Hadi_Amini1
Yasaman Saadati Mohammad Rostami M. Hadi Amini
I acknowledge that I and all co-authors of this work have read and commit to adhering to the ICLR Code of Ethics.
Personalized federated learning Distributed computing
I certify that there is no acknowledgement section in this submission for double blind review.
saadati|pmixfed_mixing_up_model_coefficients_for_efficient_personalized_federated_learning
/pdf/9cd025f81a3c85c826233701bb1fb266a093a0e0.pdf
other topics in machine learning (i.e., none of the above)
I understand the reciprocal reviewing requirement as described on https://iclr.cc/Conferences/2025/CallForPapers. If none of the authors are registered as a reviewer, it may result in a desk rejection at the discretion of the program chairs. To request an exception, please complete this form at https://forms.gle/Huojr6VjkFxiQsUp6.
I certify that this submission complies with the submission instructions as described on https://iclr.cc/Conferences/2025/AuthorGuide.
/attachment/d2e85926045102366148f19a8481eca3840ad9bd.zip
pMixFed: Mixing up model coefficients for Efficient Personalized Federated Learning
ICLR 2025 Conference Desk Rejected Submission
ICLR.cc/2025/Conference/Desk_Rejected_Submission