[공지사항]을 빙자한 안부와 근황 
Show more

Daily Arxiv

This is a page that curates AI-related papers published worldwide.
All content here is summarized using Google Gemini and operated on a non-profit basis.
Copyright for each paper belongs to the authors and their institutions; please make sure to credit the source when sharing.

TruthLens: Explainable DeepFake Detection for Face Manipulated and Fully Synthetic Data

Created by
  • Haebom

Author

Rohit Kundu, Shan Jia, Vishal Mohanty, Athula Balachandran, Amit K. Roy-Chowdhury

Outline

TruthLens is a novel DeepFake detection framework that goes beyond the limitations of traditional binary classification (real vs. fake) to determine if an image is real or fake and provides detailed text-based reasoning for that prediction. Its hybrid design combines the global contextual understanding of multi-modal large-scale language models, such as PaliGemma2, with the local feature extraction of vision-only models, such as DINOv2, to effectively handle both face-manipulation DeepFakes and AI-generated content. It can even answer questions about fine details such as eyes, nose, and mouth, and has shown 2-14% better detection accuracy and explainability than existing state-of-the-art methods on a variety of datasets. It generalizes well to existing and novel manipulation techniques.

Takeaways, Limitations

Takeaways:
We present a novel framework that simultaneously improves the accuracy and explainability of DeepFake detection.
Effectively applicable to both facial manipulation DeepFake and AI-generated content.
Provides high explainability by providing answers to questions about detailed parts.
Excellent generalization performance across a variety of datasets and manipulation techniques.
Limitations:
The specific Limitations is not mentioned in the paper. Additional experiments and analyses are needed to clarify this.
Consideration should be given to the computational cost and resource consumption of large-scale models such as PaliGemma2 and DINOv2.
Continuous adaptation and updates are needed for new DeepFake creation techniques.
👍