Physics-Informed Decentralized Federated Learning
Federated Learning;Physics-Informed Neural Network;Domain Knowledge;Decentralized
Yes
No ethics review needed.
- How could (1) be written in the form of one in line 138?

- Equation (4). Could we explicitly define "residual" function?

- Line 322. Is this scalable?

- Theorem 1. What does the solution converge to?
- The writing is easy to understand.

- The idea is intuitive and the algorithm is easy to implement.
This paper proposes to leverage physical information into federated learning. By incorporating the corresponding differential equations into the model as penalty term, this paper proposes an algorithm for decentralized federated learning setting.
- Lack of motivation: this paper only provided 1-2 examples to motivate the problem settings. I am not convinced that the proposed framework could be used for many applications. 

- Lack of theoretical support: no generalization bound

- The convergence results don't seem to be right. As it only says that it will converge to the average of its neighbors weights, it does not imply that it will converge to the (local) optimal solution.

- The idea is simple and it doesn't have much technical contribtuion.
Yes
No ethics review needed.
See the weakness section.
+ It is somewhat new to apply the PINNs into DFL.
+ Convergence analysis is provided.
This paper studies integrating domain knowledge into decentralized federated learning (DFL). Specifically, the paper considers local clients training with the Physics-Informed Neural Networks (PINNs) and proposes the PIDFL architecture. Extensive experiments verify the feasibility of the proposed method.
- This is just a direct and simple application of the PINNs, where no technical challenges are brought up by combining DFL and PINNs. 
- The proof is problematic. Why the contraction of consensus error represents the convergence of the algorithm? Should we further prove $\bar{\theta}\rightarrow \theta^{*}$ for the strongly convex case or $|\Vert \nabla f(\theta)\Vert^{2}|\rightarrow 0$ for the non-convex case?
- More baselines should be compared, such as Scaffold, which has better performance than FedAvg.
Yes
No ethics review needed.
see weakness
- This paper is generally well-written and easy to follow
- Incorporating domain knowledge through physics-informed constraints is novel and it seems to be enhancing model accuracy.
- This paper provides theoretical convergence proof for the DFLA algorithm.
- Experimental results indicate that PIDFL consistently outperforms traditional DFL approaches.
The paper proposes a Physics-Informed Decentralized Federated Learning (PIDFL) framework that incorporates domain-specific knowledge, represented by differential equations, into decentralized federated learning (DFL).
- It seems that the effectiveness of physics-informed constraints is contingent on the accuracy of the domain knowledge.
- The sensitivity of the regularization parameter is not fully discussed.
- The convergence is at $O(\mu^2C^2)$, what does it say? is squared convergence good? more explanations, insights and remarks on this would be beneficial to this paper
- Many other FL limitations are not discussed, e.g. it seems that this method requires frequent peer-to-peer communication, partial participation is not considered?
Yes
No ethics review needed.
1. Is the proposed algorithm synchronous? If so, what impact does idle time in P2P communication have on the algorithm’s performance? Additionally, what is the extra communication overhead introduced compared to a centralized algorithm? The authors are encouraged to analyze this aspect.
2. The incorporation of domain knowledge is insufficiently elaborated. In which aspects is it utilized? A summary dedicated to this would be beneficial.
3. There are errors in the theoretical proofs. In the penultimate equation on line 362, summing over $i$ includes both $w_{ij}$ and $\Theta$, meaning $i$ and $w_{ij}$ cannot be grouped in parentheses independently. Additionally, the result on line 367 does not lead to the result on line 394, as $\gamma$ does not exist. The authors need to thoroughly verify their proofs.
4. The algorithms selected for comparison in the simulations are more than five years old, which might be outdated. Additionally, why was a noise variance of exactly 0.24 chosen—is there any specific reasoning behind this particular value? The authors should provide an explanation.
This paper proposes a federated learning algorithm with theoretical guarantees by integrating physics-informed neural networks with decentralized federated learning. Leveraging domain knowledge, this algorithm demonstrates superior performance on non-IID datasets.
This paper proposes a federated learning algorithm with theoretical guarantees by integrating physics-informed neural networks with decentralized federated learning. Leveraging domain knowledge, this algorithm demonstrates superior performance on non-IID datasets.
The role of domain knowledge is insufficiently clarified—is it incorporated in the form of partial differential equations (PDEs) or the choice of dataset $\mathcal{X}$? Furthermore, the PDEs used for training are not adequately specified, nor is there an explanation of how the dataset $\mathcal{X}$ is selected adaptively without expert knowledge.
New Decentralized Federated Learning Framework by Integration of Physics-Informed Neural Network
@inproceedings{
anonymous2024physicsinformed,
title={Physics-Informed Decentralized Federated Learning},
author={Anonymous},
booktitle={Submitted to The Thirteenth International Conference on Learning Representations},
year={2024},
url={https://openreview.net/forum?id=ZXFJeR9Xm6},
note={under review}
}
The integration of domain knowledge into the learning process of artificial intelligence (AI) has received significant attention in the last few years. Most of the approaches proposed so far have focused on centralized machine learning scenarios, with less emphasis on how domain knowledge can be effectively integrated in decentralized settings. In this paper, we address this gap by evaluating the effectiveness of domain knowledge integration in distributed settings, specifically in the context of Decentralized Federated Learning (DFL). We propose the Physics-Informed DFL (PIDFL) architecture by integrating domain knowledge expressed as differential equations. We introduce a serverless data aggregation algorithm for PIDFL, prove its convergence, and discuss its computational complexity. We performed comprehensive experiments across various datasets and demonstrated that  PIDFL significantly reduces average loss across diverse applications. This highlights the potential of PIDFL and offers a promising avenue for improving decentralized learning through domain knowledge integration.
I certify that there is no URL (e.g., github page) that could be used to find authors’ identity.
I acknowledge that I and all co-authors of this work have read and commit to adhering to the ICLR Code of Ethics.
Federated Learning Physics-Informed Neural Network Domain Knowledge Decentralized
I certify that there is no acknowledgement section in this submission for double blind review.
/pdf/e1eaf0f0e2cf79c991ddccdeedf6dcf1594eb0aa.pdf
neurosymbolic & hybrid AI systems (physics-informed, logic & formal reasoning, etc.)
I understand the reciprocal reviewing requirement as described on https://iclr.cc/Conferences/2025/CallForPapers. If none of the authors are registered as a reviewer, it may result in a desk rejection at the discretion of the program chairs. To request an exception, please complete this form at https://forms.gle/Huojr6VjkFxiQsUp6.
I certify that this submission complies with the submission instructions as described on https://iclr.cc/Conferences/2025/AuthorGuide.
/attachment/41baa9ef77c2dbd154cb2dd39b9445606e5cadba.zip
Physics-Informed Decentralized Federated Learning
ICLR 2025 Conference Submission
ICLR.cc/2025/Conference/Submission