Daily Arxiv

This page organizes papers related to artificial intelligence published around the world.
This page is summarized using Google Gemini and is operated on a non-profit basis.
The copyright of the paper belongs to the author and the relevant institution. When sharing, simply cite the source.

Decoupled Classifier-Free Guidance for Counterfactual Diffusion Models

Created by
  • Haebom

Author

Tian Xia, Fabio De Sousa Ribeiro, Rajat R Rasal, Avinash Kori, Raghav Mehta, Ben Glocker

Outline

Counterfactual generation aims to simulate realistic hypothetical outcomes under causal intervention. Diffusion models have emerged as a powerful tool for this task, combining DDIM inversion, conditional generation, and classifier-free guidance (CFG). This study identifies a key limitation of CFG: its global guidance size for all attributes, leading to significant false changes in inferred counterfactuals. To mitigate this, we propose Decoupled Classifier-Free Guidance (DCFG), a flexible and model-agnostic guidance technique that enables attribute-specific control along the causal graph. DCFG is implemented through a simple attribute-partitioned embedding strategy that decouples semantic inputs, enabling selective guidance for user-defined attribute groups.

Takeaways, Limitations

Takeaways:
Discovered Limitations in CFG for counterfactual generation and presented a solution.
A new guidance technique DCFG is proposed to enable attribute-specific control.
DCFG is model agnostic and provides flexibility.
Implementation of DCFG via attribute split embedding strategy.
Limitations:
There is no specific mention of Limitations in the paper.
👍