Radial Basis Operator Networks
Operator networks;Radial basis functions;Scientific computing;Partial differential equations
Yes
No ethics review needed.
Can you please reinforce the methodological part and make more self-contained and more detailed.
Can you extend the comparisons (if you think it makes sense)?
The paper is well written and the topic is interesting though not mainstream.
The experiments are relevant.
This paper deals with operator networks working with radial basis functions.
Time and frequency domain are studied.
A couple of experiments are carried out, mainly on PDEs and TSP.
The methodological description of the method is too short and not detailed enough, especially for unfamiliar readers.
Some theoretical statements are made but the rest of the methodology would not allow re-implmenting the method. Figs 1 and 2 do not carry any information whatsoever; most equations about the network are implicitly embedded in the theorem.
Part of the problem is that the paper describes a variant of NO/ON and the authors focus on the increment, probably for the sake of space, at the expense of making the paper difficult to read for the average reader.
With the amount of provided details, the proposed method seems to be very simple and very close to classical RBFNs with a product on top. The PDE and TSP tasks are not very convincing if they are not compared to other architecture and methods (X-RBON get compared to LNO only).
Yes
No ethics review needed.
perhaps authors can include the LNO results on CO2 to temperature experiment? 

What is difference between RBON and NRBON? can authors clarify key architectural or mathematical differences between RBON and NRBON, and how these differences impact performance
Paper proposes a new operator network based on radial basis functions. Paper is clearly written. The quantitative results of RBON, NRBON, and F-RBON outperform LNO on the wave, burgers, and Euler-bernoulli beam equations.
Paper proposes a radial basis operator network, an operator network entirely represented with radial basis functions. The RBON can learn in both time and frequency domain. Experiments include comparison with Laplace neural operator on wave, burgers, and Euler-bernoulli beam equations. Paper shows RBON and NRBON forecasting global and local temperatures based on atmospheric CO2.
small set of experiments. CO2 to temperature experiment lacks baseline. other factors than CO2 affect temperature, and overall there's a lot of fluctuation in temperature, so it is hard to tell how good predictions are from the RBONs. another dataset with experiments may be helpful.
Yes
No ethics review needed.
See weakness.
Replacing the DNN in DeepONet with the radial basis neural network sounds an interesting idea, leading to improved numerical results.
This paper presents an extension of DeepONet, where the DNN is replaced with a radial basis neural network, and demonstrates the performance of the extension  through solving some partial differential equations.
1. The presentation is unclear, making it challenging for readers unfamiliar with DeepONet to follow. For example, it lacks a clear outline (or pseudo) of the training algorithm for the proposed network. What are the training parameters? How should  M and N be selected? 

2. Figure 1: what does `x' represent?  Does the linear transformation L include tunable parameters? 

3. In Section 2.3, the authors mentioned computation in the frequency domain, but the algorithm is not detailed. 

4. The comparison with DeepONet is not included in the paper. 

5. Theoretical contribution of the paper is marginal.
Yes
No ethics review needed.
1. Could you elaborate on the literature review regarding learning operators in either the time domain or frequency domain?
2. What are the advantages of learning an operator simultaneously in both the time and frequency domains, as opposed to learning them separately and then combining the results?
3. Could you provide more details on the network structure?
4. How many centers are chosen using KNN, and what criteria are used for selection?
5. How do you explain the results in Table 1, where different networks show instability on different examples? LNO works better on Burgers?
6. Why some networks work better on OOD data in table 1?
They introduce the Radial Basis Operator Network (RBON) to learn an operator in both the time and frequency domains, with adjustments to handle complex-valued inputs. Experiments on both in-distribution and out-of-distribution (OOD) data are conducted to validate RBON’s effectiveness.
They introduce the Radial Basis Operator Network (RBON) to learn an operator in both the time and frequency domains, with adjustments to handle complex-valued inputs. Experiments on both in-distribution and out-of-distribution (OOD) data are conducted to validate RBON’s effectiveness.
1. The experimental comparisons are insufficient, especially lacking comparisons with methods like DeepONet and FNO.
2. Using KNN to select centers may introduce instabilities.
3. The explanation of the experimental results is inadequate; for instance, Table 1 lacks clarity on why different algorithms perform variably across different problems.
Yes
No ethics review needed.
•	Weather data is simple. Can more complex data be added to the comparison as well? There are many time series benchmark data sets (https://arxiv.org/pdf/2303.06053). 
•       More comparison needs to be added. Like LNO, FNO, LSTM, etc. This will give a holistic view wrt performance.
•	Any insights on why the model did not perform as well as global in the local prediction? Is it because of short-term fluctuations or long-term trends?
•	Figures 5 and 6 are too compact and don’t add much information. Can be added to the appendix. A zoomed-in version of the plot would be helpful.
•	A sensitivity study for k means for deciding centers for RBFs would be useful. Showing the effect of varying values of k on model performance will give many insights.
The paper is written.
Theory enhances the paper.
This paper introduces a Radial basis operator network for mapping infinite dimensional spaces like function spaces. This approach can model temporal as well as frequency information. The introduction gives a good motivation for the problem, the literature is vast, and the methods are explained well. The paper shows the efficacy of the proposed approach on a weather dataset.
The experiments and comparisons are a bit small and need to be extended to understand the efficacy of RBON.
A novel operator network capable of learning on either real or complex-valued inputs.
@inproceedings{
anonymous2024radial,
title={Radial Basis Operator Networks},
author={Anonymous},
booktitle={Submitted to The Thirteenth International Conference on Learning Representations},
year={2024},
url={https://openreview.net/forum?id=q6hEuC48Dk},
note={under review}
}
Operator networks are designed to approximate nonlinear operators, which provide mappings between infinite-dimensional spaces such as function spaces. These networks are playing an increasingly important role in machine learning, with their most notable contributions in the field of scientific computing. Their significance stems from their ability to handle the type of data often encountered in scientific applications. For instance, in climate modeling or fluid dynamics, input data typically consists of discretized continuous fields (like temperature distributions or velocity fields). We introduce the radial basis operator network (RBON), which represents a significant advancement as the first operator network capable of learning an operator in both the time domain and frequency domain when adjusted to accept complex-valued inputs. Despite the small, single hidden-layer structure, the RBON boasts small $L^2$ relative test error for both in- and out-of-distribution data (OOD) of less than $1\times 10^{-7}$ in some benchmark cases. Moreover, the RBON maintains small error on OOD data from entirely different function classes from the training data.
I certify that there is no URL (e.g., github page) that could be used to find authors’ identity.
I acknowledge that I and all co-authors of this work have read and commit to adhering to the ICLR Code of Ethics.
Operator networks Radial basis functions Scientific computing Partial differential equations
I certify that there is no acknowledgement section in this submission for double blind review.
/pdf/295b522f5da3c46b17e2909ecd3a7bd142110b4f.pdf
applications to physical sciences (physics, chemistry, biology, etc.)
I understand the reciprocal reviewing requirement as described on https://iclr.cc/Conferences/2025/CallForPapers. If none of the authors are registered as a reviewer, it may result in a desk rejection at the discretion of the program chairs. To request an exception, please complete this form at https://forms.gle/Huojr6VjkFxiQsUp6.
I certify that this submission complies with the submission instructions as described on https://iclr.cc/Conferences/2025/AuthorGuide.
Radial Basis Operator Networks
ICLR 2025 Conference Submission
ICLR.cc/2025/Conference/Submission