Daily Arxiv

This is a page that curates AI-related papers published worldwide.
All content here is summarized using Google Gemini and operated on a non-profit basis.
Copyright for each paper belongs to the authors and their institutions; please make sure to credit the source when sharing.

FakeParts: a New Family of AI-Generated DeepFakes

Created by
  • Haebom

Author

Gaetan Brison, Soobash Daiboo, Samy Aimeur, Awais Hussain Sani, Xi Wang, Gianni Franchi, Vicky Kalogeiton

Outline

This paper introduces "FakeParts," a new type of deepfakes that alter specific spatial regions or temporal intervals of genuine videos through subtle, localized manipulations. Unlike fully synthesized content, partial manipulations, such as facial expression changes, object replacements, and background modifications, blend seamlessly with real elements, making them particularly deceptive and difficult to detect. To address this critical gap in detection performance, this paper presents "FakePartsBench," the first large-scale benchmark dataset specifically designed to capture the full spectrum of partial deepfakes. Comprising over 25,000 videos with pixel- and frame-level manipulation annotations, this dataset enables a comprehensive evaluation of detection methods. User studies demonstrate that FakeParts reduces human detection accuracy by over 30% compared to existing deepfakes, with similar degradation observed with state-of-the-art detection models. This research exposes critical vulnerabilities in current deepfake detection methods and provides a resource for developing more robust methods against partial video manipulation.

Takeaways, Limitations

Takeaways:
The existence and risks of a new type of deepfake (FakeParts) with partial manipulation are presented.
Revealing vulnerabilities in existing deepfake detection methods.
Providing a large-scale benchmark dataset (FakePartsBench) for partial deepfake detection.
Emphasizes the need to develop improved deepfake detection technology.
Limitations:
Further validation of the diversity and generalizability of the FakePartsBench dataset is needed.
It is possible that it may not cover all instances of deepfakes in the real world.
Lack of clear presentation of the limitations of the presented dataset and detection method.
👍