TriDF: Evaluating Perception, Detection, and Hallucination for Interpretable DeepFake Detection
Not on the map. Why?
Abstract (arXiv)
Advances in generative modeling have made it increasingly easy to fabricate realistic portrayals of individuals, creating serious risks for security, communication, and public trust. Detecting such person-driven manipulations requires systems that not only distinguish altered content from authentic media but also provide clear and reliable reasoning. In this paper, we introduce TriDF, a comprehensive benchmark for interpretable DeepFake detection. TriDF contains high-quality forgeries from advanced synthesis models, covering 16 DeepFake types across image, video, and audio modalities. The benchmark evaluates three key aspects: Perception, which measures the ability of a model to identify fine-grained manipulation artifacts using human-annotated evidence; Detection, which assesses classification performance across diverse forgery families and generators; and Hallucination, which quantifies the reliability of model-generated explanations. Experiments on state-of-the-art multimodal large language models show that accurate perception is essential for reliable detection, but hallucination can severely disrupt decision-making, revealing the interdependence of these three aspects. TriDF provides a unified framework for understanding the interaction between detection accuracy, evidence identification, and explanation reliability, offering a foundation for building trustworthy systems that address real-world synthetic media threats.
Key facts. Cited by 4 papers in the map (data through 7 Oct 2026). Builds on 124 of its 160 references that are in the map. First posted on arXiv 11 Dec 2025.
Builds on
124 of 160 references.
References · 124
- 2014Microsoft COCO: Common Objects in Contextcited by 17,498
- 2018The Unreasonable Effectiveness of Deep Features as a Perceptual Metriccited by 11,029
- 2018A Style-Based Generator Architecture for Generative Adversarial Networkscited by 5,986
- 2022LAION-5B: An open large-scale dataset for training next generation image-text modelscited by 4,131
- 2024Scaling Rectified Flow Transformers for High-Resolution Image Synthesiscited by 4,094
- 2025Gemini 2.5: Pushing the Frontier with Advanced Reasoning, Multimodality, Long Context, and Next Generation Agentic Capabilitiescited by 3,655
- 2017Progressive Growing of GANs for Improved Quality, Stability, and Variationcited by 2,967
- 2024LLaVA-OneVision: Easy Visual Task Transfercited by 2,669
- 2025Wan: Open and Advanced Large-Scale Video Generative Modelscited by 2,536
- 2023InternVL: Scaling up Vision Foundation Models and Aligning for Generic Visual-Linguistic Taskscited by 2,534
- 2025Qwen3-VL Technical Reportcited by 2,534
- 2021CLIPScore: A Reference-free Evaluation Metric for Image Captioningcited by 2,388
38 more
- 2024CogVideoX: Text-to-Video Diffusion Models with An Expert Transformercited by 2,198
- 2023Evaluating Object Hallucination in Large Vision-Language Modelscited by 1,696
- 2024Expanding Performance Boundaries of Open-Source Multimodal Models with Model, Data, and Test-Time Scalingcited by 1,573
- 2025InternVL3.5: Advancing Open-Source Multimodal Models in Versatility, Reasoning, and Efficiencycited by 1,419
- 2015Flickr30k Entities: Collecting Region-to-Phrase Correspondences for Richer Image-to-Sentence Modelscited by 1,352
- 2019FaceForensics++: Learning to Detect Manipulated Facial Imagescited by 1,095
- 2024MiniCPM-V: A GPT-4V Level MLLM on Your Phonecited by 1,061
- 2025FLUX.1 Kontext: Flow Matching for In-Context Image Generation and Editing in Latent Spacecited by 960
- 2017VGGFace2: A dataset for recognising faces across pose and agecited by 911
- 2018VoxCeleb2: Deep Speaker Recognitioncited by 862
- 2020First Order Motion Model for Image Animationcited by 698
- 2024Phi-4 Technical Reportcited by 675
- 2020A Lip Sync Expert Is All You Need for Speech to Lip Generation In The Wildcited by 669
- 2018Object Hallucination in Image Captioningcited by 661
- 2019LibriTTS: A Corpus Derived from LibriSpeech for Text-to-Speechcited by 639
- 2019MaskGAN: Towards Diverse and Interactive Facial Image Manipulationcited by 624
- 2019Celeb-DF: A Large-scale Challenging Dataset for DeepFake Forensicscited by 573
- 2023HallusionBench: An Advanced Diagnostic Suite for Entangled Language Hallucination and Visual Illusion in Large Vision-Language Modelscited by 572
- 2024LTX-Video: Realtime Video Latent Diffusioncited by 549
- 2023InternVid: A Large-scale Video-Text Dataset for Multimodal Understanding and Generationcited by 488
- 2024From Generation to Judgment: Opportunities and Challenges of LLM-as-a-judgecited by 480
- 2025VACE: All-in-One Video Creation and Editingcited by 467
- 2023Large Language Models Are Not Robust Multiple Choice Selectorscited by 454
- 2025Qwen3-Omni Technical Reportcited by 451
- 2020One-Shot Free-View Neural Talking-Head Synthesis for Video Conferencingcited by 438
- 2025Step1X-Edit: A Practical Framework for General Image Editingcited by 417
- 2024Panda-70M: Captioning 70M Videos with Multiple Cross-Modality Teacherscited by 389
- 2022SadTalker: Learning Realistic 3D Motion Coefficients for Stylized Audio-Driven Single Image Talking Face Animationcited by 380
- 2024MLLM-as-a-Judge: Assessing Multimodal LLM-as-a-Judge with Vision-Language Benchmarkcited by 362
- 2023GPTScore: Evaluate as You Desirecited by 357
- 2024Pyramidal Flow Matching for Efficient Video Generative Modelingcited by 354
- 2024PixArt-Sigma: Weak-to-Strong Training of Diffusion Transformer for 4K Text-to-Image Generationcited by 326
- 2023Emu Edit: Precise Image Editing via Recognition and Generation Taskscited by 321
- 2024What matters when building vision-language models?cited by 321
- 2023GenImage: A Million-Scale Benchmark for Detecting AI-Generated Imagecited by 318
- 2023InternLM-XComposer: A Vision-Language Large Model for Advanced Text-image Comprehension and Compositioncited by 297
- 2023AMBER: An LLM-free Multi-dimensional Benchmark for MLLMs Hallucination Evaluationcited by 293
- 2024mPLUG-Owl3: Towards Long Image-Sequence Understanding in Multi-Modal Large Language Modelscited by 285
50 most cited of 124 All 124 (JSON)
Built on by
Citing papers per year: 2026: 4.
4 papers.
- 2026Explainable Deepfake Detection Challengecited by 2
- 2026DF-CBM: Region-Aware Concept Bottleneck Models for Deepfake Detectioncited by 0
- 2026Look Before You Judge: Training-Free Region Mining for Grounded and Explainable Deepfake Detectioncited by 0
- 2026SEAR: Spoofing Evidence-Grounded Audio Reasoning Benchmark for Audio Language Modelscited by 0
- 2026SEAR: Spoofing Evidence-Grounded Audio Reasoning Benchmark for Audio Language Models30 Sep 2026
- 2026Look Before You Judge: Training-Free Region Mining for Grounded and Explainable Deepfake Detection28 Sep 2026
- 2026DF-CBM: Region-Aware Concept Bottleneck Models for Deepfake Detection28 Sep 2026
- 2026Explainable Deepfake Detection Challenge23 Jul 2026
Similar, not cited
Close in wording, no citation either way
- 2025INSIGHT: An Interpretable Neural Vision-Language Framework for Reasoning of Generative Artifacts
- 2025Multiverse Through Deepfakes: The MultiFakeVerse Dataset of Person-Centric Visual and Conceptual Manipulations
- 2026Beyond Static Artifacts: A Forensic Benchmark for Video Deepfake Reasoning in Vision Language Models
- 2025LLMs Are Not Yet Ready for Deepfake Image Detection
- 2026Deepfake Forensics Adapter: A Dual-Stream Network for Generalizable Deepfake Detection
- 2024The Tug-of-War Between Deepfake Generation and Detection
- 2025Beyond Face Swapping: A Diffusion-Based Digital Human Benchmark for Multimodal Deepfake Detection
- 2024Evolving from Single-modal to Multi-modal Facial Deepfake Detection: Progress and Challenges