Daily Arxiv

This is a page that curates AI-related papers published worldwide.
All content here is summarized using Google Gemini and operated on a non-profit basis.
Copyright for each paper belongs to the authors and their institutions; please make sure to credit the source when sharing.

When Deepfakes Look Real: Detecting AI-Generated Faces with Unlabeled Data due to Annotation Challenges

Created by
  • Haebom

Author

Zhiqiang Yang, Renshuai Tao, Xiaolong Zheng, Guodong Yang, Chunjie Zhang

Outline

This paper proposes a Dual-Path Guidance Network (DPGNet) that utilizes large-scale unlabeled data to overcome the labeling data dependency of existing deepfake detection methods. Considering the reality that it is becoming difficult to distinguish deepfake images from real images, we focus on bridging the domain gap between different generative models and effectively utilizing unlabeled data. DPGNet solves this problem through a text-based cross-domain alignment module and a curriculum-based pseudo-label generation module, and prevents the forgetting problem through cross-domain knowledge distillation. Experimental results using 11 representative datasets show that DPGNet outperforms the existing state-of-the-art (SoTA) method by 6.3%.

Takeaways, Limitations

Takeaways:
We present new possibilities for deepfake detection using large-scale unlabeled data.
Overcome the limitations of existing methods through text-based cross-domain alignment and curriculum-based learning strategies.
We demonstrate the effectiveness of DPGNet through experimental results that outperform SoTA on 11 datasets.
Limitations:
Further validation of the generalization performance of the proposed method is required.
There is a lack of performance evaluation in real online environments.
Further research is needed to understand the adaptability of new deepfake generation models.
👍