Daily Arxiv

This is a page that curates AI-related papers published worldwide.
All content here is summarized using Google Gemini and operated on a non-profit basis.
Copyright for each paper belongs to the authors and their institutions; please make sure to credit the source when sharing.

VideoEraser: Concept Erasure in Text-to-Video Diffusion Models

Created by
  • Haebom

Author

Naen Xu, Jinghuai Zhang, Changjiang Li, Zhi Chen, Chunyi Zhou, Qingming Li, Tianyu Du, Shouling Ji

Outline

This paper proposes VideoEraser, a novel framework that requires no training, to address privacy, copyright, and security concerns arising from exploitation of text-to-video (T2V) diffusion models. VideoEraser is designed as a plug-and-play module that can be integrated into existing T2V diffusion models through a two-step process: Selective Prompted Embedding Adjustment (SPEA) and Adversarial-Resilient Noise Guidance (ARNG). VideoEraser effectively prevents the creation of videos containing unwanted concepts such as objects, artistic styles, celebrities, and explicit content. Experimental results show that VideoEraser outperforms existing methods in efficiency, integrity, fidelity, robustness, and generalization performance, achieving an average of 46% unwanted content reduction across four tasks, achieving state-of-the-art performance.

Takeaways, Limitations

Takeaways:
A novel method to effectively suppress negative content generation in the T2V diffusion model without training is presented.
It shows improved efficiency, integrity, fidelity, robustness, and generalization performance compared to existing methods.
Easy to integrate into existing models with plug-and-play functionality.
Contribute to solving privacy, copyright, and security issues.
Limitations:
This is a performance evaluation of the specific T2V diffusion model presented in the paper, and further research is needed to determine its generalizability to other models.
VideoEraser's performance needs to be verified against new types of unwanted content or more sophisticated prompts.
Analysis of the computational cost and performance degradation of VideoEraser is needed.
👍