Daily Arxiv

This is a page that curates AI-related papers published worldwide.
All content here is summarized using Google Gemini and operated on a non-profit basis.
Copyright for each paper belongs to the authors and their institutions; please make sure to credit the source when sharing.

Diffusion Models are Secretly Exchangeable: Parallelizing DDPMs via Autospeculation

Created by
  • Haebom

Author

Hengyuan Hu, Aniket Das, Dorsa Sadigh, Nima Anari

Outline

This paper exploits the relationship between DDPMs and probabilistic localization to overcome the inference bottleneck of denoising diffusion probabilistic models (DDPMs). By proving that the incrementality of DDPMs satisfies the exchangeability property, we demonstrate that various performance optimization techniques based on autoregressive models can be applied to the diffusion setting. Specifically, we propose "Automatic Predictive Decoding" (ASD), an extension of the predictive decoding algorithm widely used for DDPMs without requiring auxiliary models. We demonstrate through theoretical analysis that ASD achieves $\tilde{O}(K^{\frac{1}{3}})$ parallel execution speedups over K-stage sequential DDPMs, and experimentally demonstrate that it significantly accelerates DDPM inference in various applications.

Takeaways, Limitations

Takeaways:
We present ASD, a novel algorithm that dramatically improves the inference speed of DDPMs.
We provide a general framework for applying autoregressive model optimization techniques to DDPMs.
Theoretical analysis supports the speedup of ASD.
Experimentally verify the effectiveness of ASD in various fields.
Limitations:
Although the performance improvements of ASD are based on theoretical analysis and experimental results, they do not guarantee the same level of speedup for all DDPMs and in all situations.
The $\tilde{O} (K^{\frac{1}{3}})$ speedup is a theoretical maximum, and actual performance may vary depending on implementation and hardware.
This paper may not provide a detailed description of the implementation details of ASD.
👍