[공지사항]을 빙자한 안부와 근황 
Show more

Daily Arxiv

This is a page that curates AI-related papers published worldwide.
All content here is summarized using Google Gemini and operated on a non-profit basis.
Copyright for each paper belongs to the authors and their institutions; please make sure to credit the source when sharing.

SEER: Semantic Enhancement and Emotional Reasoning Network for Multimodal Fake News Detection

Created by
  • Haebom

Author

Peican Zhu, Yubo Jing, Le Cheng, Bin Chen, Xiaodong Cui, Lianwei Wu, Keke Tang

Outline

Previous multimodal fake news detection studies mainly focused on the alignment and integration of cross-modal features and the application of text-image consistency. However, they overlooked the semantic enhancement effect of large-scale multimodal models and paid little attention to the emotional features of news. Inspired by the fact that fake news is more likely to contain negative sentiments than genuine news, in this paper, we propose a novel semantic enhancement and sentiment inference (SEER) network for multimodal fake news detection. It generates summarized captions for image semantic understanding and enhances the meaning using the results of large-scale multimodal models. Focusing on the relationship between the authenticity of news and emotional tendencies, we propose an expert sentiment inference module that optimizes the emotional features and infers the authenticity of news by simulating real-world scenarios. Through extensive experiments on two real-world datasets, we demonstrate that SEER outperforms the state-of-the-art baseline models.

Takeaways, Limitations

Takeaways:
Improving fake news detection performance using large-scale multi-modal models.
Improve accuracy by leveraging semantic and emotional information through image caption summary and sentiment inference modules.
Achieving SOTA performance on real datasets.
Limitations:
Further validation of the generalization performance of the proposed model is needed.
There is a need to evaluate SEER's performance on different types of fake news and in different languages.
Further research is needed on the interpretability and reliability of the emotion inference module.
👍