Compositional Generative Inference Using Diffusion-based Optimization
Diffusion;Composition;Probablistic Models;Energy based models
I have read and agree with the venue's withdrawal policy on behalf of myself and my co-authors.
We propose a generalizable strategy for compositing multiple diffusion model even for nonlinear transformations.
@misc{
han2024compositional,
title={Compositional Generative Inference Using Diffusion-based Optimization},
author={Sookwan Han and Hyunjun Lee},
year={2024},
url={https://openreview.net/forum?id=e0YazAdpzD}
}
Compositional generative tasks, despite being important and having potential applications, have not been thoroughly addressed due to the unclear formulation and the challenges associated with selecting composition strategies. In this paper, we propose a probabilistic graphical approach to tackle the problem of compositional generative tasks and alleviate these challenges. Our approach formulates the problem as a Bayesian inference problem using a representative bipartite Bayesian network. In this network, one set of random variables represents the generation targets, while the other set represents observable variables with explicit or implicit distribution information. To solve this problem, we employ variational inference on the marginal distribution of observable variables. We approximate this distribution using diffusion models. We view the diffusion models as approximate Markov Chain Monte Carlo (MCMC) samplers for the marginals. Based on this perspective, we introduce a novel MCMC-based inference algorithm that incorporates per-step optimization using aggregated objectives from the diffusion models. We demonstrate the generality of our method and conduct experiments to validate its applicability to various compositional generation tasks.
I certify that there is no URL (e.g., github page) that could be used to find authors’ identity.
~Sookwan_Han1 ~Hyunjun_Lee4
Sookwan Han Hyunjun Lee
I acknowledge that I and all co-authors of this work have read and commit to adhering to the ICLR Code of Ethics.
Diffusion Composition Probablistic Models Energy based models
I certify that there is no acknowledgement section in this submission for double blind review.
han|compositional_generative_inference_using_diffusionbased_optimization
/pdf/a0c438e4d9ae3671d1ebddffa072f2e46d770966.pdf
generative models
I understand the reciprocal reviewing requirement as described on https://iclr.cc/Conferences/2025/CallForPapers. If none of the authors are registered as a reviewer, it may result in a desk rejection at the discretion of the program chairs. To request an exception, please complete this form at https://forms.gle/Huojr6VjkFxiQsUp6.
I certify that this submission complies with the submission instructions as described on https://iclr.cc/Conferences/2025/AuthorGuide.
Compositional Generative Inference Using Diffusion-based Optimization
ICLR 2025 Conference Withdrawn Submission
ICLR.cc/2025/Conference/Withdrawn_Submission