Flow matching achieves almost minimax optimal convergence
flow matching;generative model;convergence rate;optimality
Yes
No ethics review needed.
- How do estimates change if you take a distribution other than the Gaussian distribution as the initial distribution $P_{[0]}$?

- Can the obtained estimates be easily extended to the case of estimation error in the total variation (TV) distance?

- Would your estimates change if you use different heuristics for Flow Matching, such as OT-minibatch?
- The paper is the first to present estimates for the Flow Matching framework, which shows that almost optimal minimax converges rates are achieved under several assumptions.
- The paper is well written
The paper provides estimates for the 2-Wasserstein distance for the sample-based distribution obtained in the Flow-Matching framework relative to the exact distribution. These estimates depend on the number of samples used in training, the smoothness of the true distribution as an element of the Besov space, the asymptote of the growth of the conditional map at the initial time instant.
The paper considers the early stopping mode of the ODE, when the solution stops at time $T_0<1$, and the estimates of $T_0$ are also given.
This paper contains many points in common with the paper cited therein [1].  In particular, using Besov space for target density, B-splines for its approximation, etc. Many estimates are based on thouse from [1], see, for example, Appendix A.4--A.5 of the presented paper, where the citation on [1] are explicit. In paper [1] diffusion models are considered, but as shown in paper [2], Flow Matching approach includes, under certain conditions, Diffusion models approach. Thus, generalization or obtaining similar results for Flow Matching is rather straightforward. Namely, in essence, the difference is to use Alekseev-Gröbner Theorem (Lemma 16 about error of a perturbed solution of ODE) instead of Girsanov’s Theorem (Proposition D.1 of [1] for error of a perturbed solution of SDE).
One of the main differences is the presence in the estimates of the degree of growth of the parameter $\sigma_t$ at 1, but the authors come to the well-known (empirical) conclusion that the optimal asymptotics is $\sqrt t$. Does this provide the first theoretical justification for this empirically observed optimal scaling?  How can one intuitively realize that the degree of $\sigma_t$ growth near the time point $t=1$ is important if the ODE solution is considered on the interval $[0, T_0]$, where $T_0<1$?


[1] Kazusato Oko, Shunta Akiyama, and Taiji Suzuki. Diffusion models are minimax optimal distribution estimators. volume 202, pages 26517–26582. PMLR, 4 2023

[2] Aaron Lipman, Ricky T Q Chen, Heli Ben-Hamu, Maximilian Nickel, and Matthew Le. Flow matching for generative modeling. In The Eleventh International Conference on Learning Representations, 2023
Yes
No ethics review needed.
1) In Theorem 1, what is a good bound for R_0?
2) Still in theorem 1, why do you chose $\sigma_{[\tau]}$ in that form? In what applications does it appear that way?
3) Can you test the sharpness of the bounds of theorem 9 for some FM famous use cases? 

at line 310 "in general we generally consider" may be rephrased
It's interesting to know that FM have the same standard guarantees as DMs.
The paper applies the same framework as in Oko et al. (a paper on convergence rates of diffusion models as timesteps and/or sample size goes to infinity), to Flow Matching. Due to the application to a different model, some of the proofs are different but the results are of the same strength.
Mathematically, the paper does not shine as to novelty, it mostly chains known estimates, and applies them to FM. 
Like in similar papers for other models, some of the setups look like toy models, this may be because the mathematical theory is unavailable in general.
Yes
N/A
No ethics review needed.
My comments are minor (these are mostly typos I found, but this is far from exhaustive)

1. Line 188 "for probability *density* estimation"?
2. L193 (this might happen in many places): I believe grammatically it makes sense to say "i.id. sample*s*" instead of a single sample
3.  L222: *reverse* not revserve
4. L254: "respectivly" is misspelled
5. This is a question: is there a clean way to track the dependence on the diameter of the set of the support? The assumptions assume the support of the density is in the unit cube. What is the dependence if the radius was arbitrary? This might fall outside the scope of the paper, but I'm curious if the authors have the answer
6. L516: "diffrence" is misspelled
This paper provides (to my understanding) the first estimation rates for flow matching in the context of classical statistical estimation rates. This paper is similar in spirit to the FM paper of Lipman et al (2023), where they use different combinations of mean-variance parameters to define their path. While this work leverages many ideas from Oko et al. (2023), what is especially interesting is this idea that "optimal parameter choices" lead to minimax convergence rates, whereas other choices do not enjoy the same statistical rates.
This paper provides near-minimax convergence guarantees for the flow matching (FM) algorithm for $p$-Wasserstein distances. Distinct from diffusion models, FM use ordinary differential equations (ODEs) at inference time instead of stochastic differential equations (SDEs). Their estimator is based on time-partitioned estimators, similar to the analysis of Oko et al (2023). They adopt the estimator for more general parameters (specifically the mean and covariance parameters) to provide an estimator for flow matching.
The paper could be more clearly written, and the main text is very technical. This paper would benefit substantially from a small figure explaining the construction of the estimator at a high level, and also explaining the reason why the full minimax estimation is not possible. These are overall minor points, but I do believe the paper would benefit greatly from these modifications overall.
Yes
No ethics review needed.
L223: Kappa = 1/2 corresponds to diffusion-FM, correct? So the result actually says that that only diffusion-FM is optimal within the family of FMs you consider? If so, L230 'FM is as strong as diffusion models' seems somewhat misleading -- it seems more like diffusion is actually stronger than FM, except when FM is equivalent to diffusion. Please correct me if I'm wrong; otherwise might want to state this differently.

L225: Can you elaborate on the ways in which your proof technique differs significantly from Oko's? (Since Oko's result is a special case of yours for diffusion-FM and 1-Wasserstein.)

L133: Can anything be said in the more general non-Gaussian case of FMs?

L177: Notation not super clear here. What is P_[1] vs p_[1]?

Theorem 1: It seems like you are further restricting sigma to have the form (1-\tau)^\kappa?

L222: Typo 'revserse'

L224: Diffusion can be expressed as an ODE so I am not sure what you mean here?
Provides new theoretical results for a family of flow models, showing almost minimax optimality (with 'almost' depending on a specific parameter). The paper is rigorous, clearly written, and clearly places the results in the context of prior work.
This paper proves an almost minimax optimality result for a class of flow models. Previously, Oko had shown that diffusion models are minimax optimal under the 1-Wasserstein distance. This paper builds on Oko to show that a class of FMs with terminal Gaussian distribution and paths of the form x_t = \sigma_t x_0 + m_t x_1 (which includes diffusion as a special case) are almost minimax optimal, with a parameter kappa determining the non-optimality. They show this under the p-Wasserstein distance for 1 <= p <= 2.
Please see Questions.
We establish that FM can achieve an almost minmax optimal convergence rate in terms of 2-Wasserstein distance.
@inproceedings{
anonymous2024flow,
title={Flow matching achieves almost minimax optimal convergence},
author={Anonymous},
booktitle={Submitted to The Thirteenth International Conference on Learning Representations},
year={2024},
url={https://openreview.net/forum?id=2OMyAFjiJJ},
note={under review}
}
Flow matching (FM) has gained significant attention as a simulation-free generative model. Unlike diffusion models, which are based on stochastic differential equations, FM employs a simpler approach by solving an ordinary differential equation with an initial condition from a normal distribution, thus streamlining the sample generation process. This paper discusses the convergence properties of FM in terms of the $p$-Wasserstein distance, a measure of distributional discrepancy. We establish that FM can achieve an almost minimax optimal convergence rate for $1 \leq p \leq 2$, presenting the first theoretical evidence that FM can reach convergence rates comparable to those of diffusion models. Our analysis extends existing frameworks by examining a broader class of mean and variance functions for the vector fields and identifies specific conditions necessary to attain these optimal rates.
I certify that there is no URL (e.g., github page) that could be used to find authors’ identity.
I acknowledge that I and all co-authors of this work have read and commit to adhering to the ICLR Code of Ethics.
flow matching generative model convergence rate optimality
I certify that there is no acknowledgement section in this submission for double blind review.
/pdf/f12a968546cfc82dffae091c3f5ca5337aefbfe7.pdf
generative models
I understand the reciprocal reviewing requirement as described on https://iclr.cc/Conferences/2025/CallForPapers. If none of the authors are registered as a reviewer, it may result in a desk rejection at the discretion of the program chairs. To request an exception, please complete this form at https://forms.gle/Huojr6VjkFxiQsUp6.
I certify that this submission complies with the submission instructions as described on https://iclr.cc/Conferences/2025/AuthorGuide.
Flow matching achieves almost minimax optimal convergence
ICLR 2025 Conference Submission
ICLR.cc/2025/Conference/Submission