[공지사항]을 빙자한 안부와 근황 
Show more

Daily Arxiv

This is a page that curates AI-related papers published worldwide.
All content here is summarized using Google Gemini and operated on a non-profit basis.
Copyright for each paper belongs to the authors and their institutions; please make sure to credit the source when sharing.

Studying Classifier(-Free) Guidance From a Classifier-Centric Perspective

Created by
  • Haebom

Author

Xiaoming Zhao, Alexander G. Schwing

Outline

In this paper, we conduct an empirical study to provide a comprehensive understanding of classifier-free guidance, which has become a key technique in conditional generation using denoising diffusion models. Unlike previous studies, we go back to the fundamental classifier guidance, clarifying the core assumptions of its derivation, and systematically studying the role of classifiers. We find that both classifier guidance and classifier-free guidance achieve conditional generation by moving denoising diffusion trajectories away from the decision boundary, where conditional information is usually entangled and difficult to learn. Based on this classifier-centric understanding, we propose a general postprocessing step based on flow-matching to reduce the gap between the learned distribution of a pre-trained denoising diffusion model and the real data distribution, mainly around the decision boundary. We verify the effectiveness of the proposed approach through experiments on various datasets.

Takeaways, Limitations

Takeaways: Clearly explain the working principles of classifier-guided and classifier-free guidance in relation to decision boundaries, and suggest effective postprocessing techniques based on this. Verify the effectiveness of the proposed method on various datasets.
Limitations: Further research is needed on the generalization performance of the proposed postprocessing technique and its applicability to various models. Lack of clear criteria for defining and measuring decision boundaries.
👍