mlsanityData to 7 Oct 2026

TriDF: Evaluating Perception, Detection, and Hallucination for Interpretable DeepFake Detection

arXiv 2512.10652 ↗First posted 11 Dec 2025cs.CV cs.CRcited by 4

Not on the map. Why?

Abstract (arXiv)

Advances in generative modeling have made it increasingly easy to fabricate realistic portrayals of individuals, creating serious risks for security, communication, and public trust. Detecting such person-driven manipulations requires systems that not only distinguish altered content from authentic media but also provide clear and reliable reasoning. In this paper, we introduce TriDF, a comprehensive benchmark for interpretable DeepFake detection. TriDF contains high-quality forgeries from advanced synthesis models, covering 16 DeepFake types across image, video, and audio modalities. The benchmark evaluates three key aspects: Perception, which measures the ability of a model to identify fine-grained manipulation artifacts using human-annotated evidence; Detection, which assesses classification performance across diverse forgery families and generators; and Hallucination, which quantifies the reliability of model-generated explanations. Experiments on state-of-the-art multimodal large language models show that accurate perception is essential for reliable detection, but hallucination can severely disrupt decision-making, revealing the interdependence of these three aspects. TriDF provides a unified framework for understanding the interaction between detection accuracy, evidence identification, and explanation reliability, offering a foundation for building trustworthy systems that address real-world synthetic media threats.

Key facts. Cited by 4 papers in the map (data through 7 Oct 2026). Builds on 124 of its 160 references that are in the map. First posted on arXiv 11 Dec 2025.

Builds on

124 of 160 references.

References · 124

  1. 2014Microsoft COCO: Common Objects in Contextcited by 17,498
  2. 2018The Unreasonable Effectiveness of Deep Features as a Perceptual Metriccited by 11,029
  3. 2018A Style-Based Generator Architecture for Generative Adversarial Networkscited by 5,986
  4. 2022LAION-5B: An open large-scale dataset for training next generation image-text modelscited by 4,131
  5. 2024Scaling Rectified Flow Transformers for High-Resolution Image Synthesiscited by 4,094
  6. 2025Gemini 2.5: Pushing the Frontier with Advanced Reasoning, Multimodality, Long Context, and Next Generation Agentic Capabilitiescited by 3,655
  7. 2017Progressive Growing of GANs for Improved Quality, Stability, and Variationcited by 2,967
  8. 2024LLaVA-OneVision: Easy Visual Task Transfercited by 2,669
  9. 2025Wan: Open and Advanced Large-Scale Video Generative Modelscited by 2,536
  10. 2023InternVL: Scaling up Vision Foundation Models and Aligning for Generic Visual-Linguistic Taskscited by 2,534
  11. 2025Qwen3-VL Technical Reportcited by 2,534
  12. 2021CLIPScore: A Reference-free Evaluation Metric for Image Captioningcited by 2,388
38 more
  1. 2024CogVideoX: Text-to-Video Diffusion Models with An Expert Transformercited by 2,198
  2. 2023Evaluating Object Hallucination in Large Vision-Language Modelscited by 1,696
  3. 2024Expanding Performance Boundaries of Open-Source Multimodal Models with Model, Data, and Test-Time Scalingcited by 1,573
  4. 2025InternVL3.5: Advancing Open-Source Multimodal Models in Versatility, Reasoning, and Efficiencycited by 1,419
  5. 2015Flickr30k Entities: Collecting Region-to-Phrase Correspondences for Richer Image-to-Sentence Modelscited by 1,352
  6. 2019FaceForensics++: Learning to Detect Manipulated Facial Imagescited by 1,095
  7. 2024MiniCPM-V: A GPT-4V Level MLLM on Your Phonecited by 1,061
  8. 2025FLUX.1 Kontext: Flow Matching for In-Context Image Generation and Editing in Latent Spacecited by 960
  9. 2017VGGFace2: A dataset for recognising faces across pose and agecited by 911
  10. 2018VoxCeleb2: Deep Speaker Recognitioncited by 862
  11. 2020First Order Motion Model for Image Animationcited by 698
  12. 2024Phi-4 Technical Reportcited by 675
  13. 2020A Lip Sync Expert Is All You Need for Speech to Lip Generation In The Wildcited by 669
  14. 2018Object Hallucination in Image Captioningcited by 661
  15. 2019LibriTTS: A Corpus Derived from LibriSpeech for Text-to-Speechcited by 639
  16. 2019MaskGAN: Towards Diverse and Interactive Facial Image Manipulationcited by 624
  17. 2019Celeb-DF: A Large-scale Challenging Dataset for DeepFake Forensicscited by 573
  18. 2023HallusionBench: An Advanced Diagnostic Suite for Entangled Language Hallucination and Visual Illusion in Large Vision-Language Modelscited by 572
  19. 2024LTX-Video: Realtime Video Latent Diffusioncited by 549
  20. 2023InternVid: A Large-scale Video-Text Dataset for Multimodal Understanding and Generationcited by 488
  21. 2024From Generation to Judgment: Opportunities and Challenges of LLM-as-a-judgecited by 480
  22. 2025VACE: All-in-One Video Creation and Editingcited by 467
  23. 2023Large Language Models Are Not Robust Multiple Choice Selectorscited by 454
  24. 2025Qwen3-Omni Technical Reportcited by 451
  25. 2020One-Shot Free-View Neural Talking-Head Synthesis for Video Conferencingcited by 438
  26. 2025Step1X-Edit: A Practical Framework for General Image Editingcited by 417
  27. 2024Panda-70M: Captioning 70M Videos with Multiple Cross-Modality Teacherscited by 389
  28. 2022SadTalker: Learning Realistic 3D Motion Coefficients for Stylized Audio-Driven Single Image Talking Face Animationcited by 380
  29. 2024MLLM-as-a-Judge: Assessing Multimodal LLM-as-a-Judge with Vision-Language Benchmarkcited by 362
  30. 2023GPTScore: Evaluate as You Desirecited by 357
  31. 2024Pyramidal Flow Matching for Efficient Video Generative Modelingcited by 354
  32. 2024PixArt-Sigma: Weak-to-Strong Training of Diffusion Transformer for 4K Text-to-Image Generationcited by 326
  33. 2023Emu Edit: Precise Image Editing via Recognition and Generation Taskscited by 321
  34. 2024What matters when building vision-language models?cited by 321
  35. 2023GenImage: A Million-Scale Benchmark for Detecting AI-Generated Imagecited by 318
  36. 2023InternLM-XComposer: A Vision-Language Large Model for Advanced Text-image Comprehension and Compositioncited by 297
  37. 2023AMBER: An LLM-free Multi-dimensional Benchmark for MLLMs Hallucination Evaluationcited by 293
  38. 2024mPLUG-Owl3: Towards Long Image-Sequence Understanding in Multi-Modal Large Language Modelscited by 285

50 most cited of 124 All 124 (JSON)

Built on by

Cited by year (2026 to 7 Oct)

Citing papers per year: 2026: 4.

4 papers.

Similar, not cited

Close in wording, no citation either way

  1. 2025INSIGHT: An Interpretable Neural Vision-Language Framework for Reasoning of Generative Artifacts
  2. 2025Multiverse Through Deepfakes: The MultiFakeVerse Dataset of Person-Centric Visual and Conceptual Manipulations
  3. 2026Beyond Static Artifacts: A Forensic Benchmark for Video Deepfake Reasoning in Vision Language Models
  4. 2025LLMs Are Not Yet Ready for Deepfake Image Detection
  5. 2026Deepfake Forensics Adapter: A Dual-Stream Network for Generalizable Deepfake Detection
  6. 2024The Tug-of-War Between Deepfake Generation and Detection
  7. 2025Beyond Face Swapping: A Diffusion-Based Digital Human Benchmark for Multimodal Deepfake Detection
  8. 2024Evolving from Single-modal to Multi-modal Facial Deepfake Detection: Progress and Challenges