Daily Arxiv

This page organizes papers related to artificial intelligence published around the world.
This page is summarized using Google Gemini and is operated on a non-profit basis.
The copyright of the paper belongs to the author and the relevant institution. When sharing, simply cite the source.

Equilibrium Matching: Generative Modeling with Implicit Energy-Based Models

Created by
  • Haebom

Author

Runqian Wang, Yilun Du

Outline

Equilibrium Matching (EqM) is a generative modeling framework built from the perspective of equilibrium dynamics. It abandons the non-equilibrium, time-conditional dynamics of traditional diffusion- and flow-based generative models and instead learns the equilibrium gradient of an implicit energy landscape. This approach employs an optimization-based sampling process at inference time, using gradient descent from the learned landscape with a tunable step size, an adaptive optimizer, and adaptive computation. EqM empirically outperforms diffusion/flow models in generative performance, achieving a FID of 1.90 on ImageNet 256$\times$256. Furthermore, EqM is theoretically justified by learning and sampling from a data manifold. Beyond generative tasks, EqM is a flexible framework that naturally addresses tasks including partially noisy image denoising, OOD detection, and image composition. By replacing time-conditional velocity with a unified equilibrium landscape, EqM provides a stronger link between flow- and energy-based models, and presents a simple path to optimization-based inference.

Takeaways, Limitations

Takeaways:
We achieve superior generative performance over diffusion/flow models (FID 1.90 on ImageNet 256x256).
Learning and sampling from the data manifold is theoretically justified.
It can be applied to various tasks such as partial noise image denoising, OOD detection, and image composition.
We strengthen the link between flow- and energy-based models and present an optimization-based inference approach.
Limitations:
There is no specific mention of Limitations in the paper (it is not included in the abstract).
👍