Daily Arxiv

This is a page that curates AI-related papers published worldwide.
All content here is summarized using Google Gemini and operated on a non-profit basis.
Copyright for each paper belongs to the authors and their institutions; please make sure to credit the source when sharing.

OptMark: Robust Multi-bit Diffusion Watermarking via Inference Time Optimization

Created by
  • Haebom

Author

Jiazheng Xing, Hai Ci, Hongbin Xu, Hangjie Yuan, Yong Liu, Mike Zheng Shou

Outline

This paper proposes OptMark, a robust multi-bit watermarking method for copyright protection and user tracking of images generated using diffusion models. To overcome the limitations of existing methods, such as limited capacity and vulnerability to transformations and attacks, OptMark strategically embeds structural and detail watermarking into the intermediate latent variables of the diffusion noise removal process using an optimization-based approach. This ensures robust resistance to generative attacks and image transformations, while preserving image quality and rendering the watermark imperceptible. Furthermore, we improve memory efficiency by reducing memory usage from O(N) to O(1) using adjoint gradient methods. Experimental results demonstrate that OptMark achieves robust, unobtrusive multi-bit watermarking while remaining resilient to various transformations and attacks.

Takeaways, Limitations

Takeaways:
We demonstrate that robust and unobtrusive multi-bit watermarking on diffusion model images is possible using an optimization-based approach.
Simultaneously ensures strong resistance to generative attacks and image transformation.
Greatly improves memory efficiency by utilizing adjoint gradient methods.
Contributed to the development of diffusion model image watermarking technology for copyright protection and user tracking.
Limitations:
OptMark's performance may be limited against certain types of attacks or transformations (no specific limitations are provided).
Further research is needed on generalization performance across different diffusion models and image types.
👍