Cultivating Forensic Reasoning for Generalizable Multimodal Manipulation Detection
Not on the map. Why?
Abstract (arXiv)
Recent advances in generative AI have significantly enhanced the realism of multimodal media manipulation, thereby posing substantial challenges to manipulation detection. Existing manipulation detection and grounding approaches predominantly focus on manipulation type classification under result-oriented supervision, which not only lacks interpretability but also tends to overfit superficial artifacts. In this paper, we argue that generalizable detection requires incorporating explicit forensic reasoning, rather than merely classifying a limited set of manipulation types, which fails to generalize to unseen manipulation patterns. To this end, we propose REFORM, a reasoning-driven framework that shifts learning from outcome fitting to process modeling. REFORM adopts a three-stage curriculum that first induces forensic rationales, then aligns reasoning with final judgments, and finally refines logical consistency via reinforcement learning. To support this paradigm, we introduce ROM, a large-scale dataset with rich reasoning annotations. Extensive experiments show that REFORM establishes new state-of-the-art performance with superior generalization, achieving 81.52% ACC on ROM, 76.65% ACC on DGM4, and 74.9 F1 on MMFakeBench.
Key facts. Cited by 2 papers in the map (data through 7 Oct 2026). Builds on 23 of its 38 references that are in the map. First posted on arXiv 2 Mar 2026.
Builds on
23 of 38 references.
References · 23
- 2024DeepSeekMath: Pushing the Limits of Mathematical Reasoning in Open Language Modelscited by 8,851
- 2024Scaling Rectified Flow Transformers for High-Resolution Image Synthesiscited by 4,094
- 2025Gemini 2.5: Pushing the Frontier with Advanced Reasoning, Multimodality, Long Context, and Next Generation Agentic Capabilitiescited by 3,655
- 2023InstructBLIP: Towards General-purpose Vision-Language Models with Instruction Tuningcited by 2,855
- 2023FlashAttention-2: Faster Attention with Better Parallelism and Work Partitioningcited by 2,551
- 2025InternVL3.5: Advancing Open-Source Multimodal Models in Versatility, Reasoning, and Efficiencycited by 1,419
- 2021ViLT: Vision-and-Language Transformer Without Convolution or Region Supervisioncited by 1,224
- 2019TinyBERT: Distilling BERT for Natural Language Understandingcited by 1,153
- 2025SFT Memorizes, RL Generalizes: A Comparative Study of Foundation Model Post-trainingcited by 655
- 2024DeepSeek-VL2: Mixture-of-Experts Vision-Language Models for Advanced Multimodal Understandingcited by 559
- 2023PandaGPT: One Model To Instruction-Follow Them Allcited by 330
- 2023Detecting and Grounding Multi-Modal Media Manipulationcited by 98
11 more
- 2025Self-Rewarding Vision-Language Model via Reasoning Decompositioncited by 95
- 2024MMFakeBench: A Mixed-Source Multimodal Misinformation Detection Benchmark for LVLMscited by 60
- 2023Detecting and Grounding Multi-Modal Media Manipulation and Beyondcited by 55
- 2024FKA-Owl: Advancing Multimodal Fake News Detection through Knowledge-Augmented LVLMscited by 38
- 2024ASAP: Advancing Semantic Alignment Promotes Multi-Modal Manipulation Detecting and Groundingcited by 15
- 2022Challenges and Opportunities in Information Manipulation Detection: An Examination of Wartime Russian Mediacited by 10
- 2025TRUST-VL: An Explainable News Assistant for General Multimodal Misinformation Detectioncited by 10
- 2025The Coherence Trap: When MLLM-Crafted Narratives Exploit Manipulated Visual Contextscited by 8
- 2025FakeSV-VLM: Taming VLM for Detecting Fake Short-Video News via Progressive Mixture-Of-Experts Adaptercited by 7
- 2024Generating Attribution Reports for Manipulated Facial Images: A Dataset and Baselinecited by 6
- 2025Beyond Artificial Misalignment: Detecting and Grounding Semantic-Coordinated Multimodal Manipulationscited by 4
Built on by
Citing papers per year: 2026: 2.
2 papers.