LaP-Forensics: Latent-Pixel Consistency Guided Multimodal Reasoning for Deepfake Detection
On the map: LLM reasoning → Multimodal reasoning
also in 1 more
Abstract (arXiv)
Recent generative models can produce images with few obvious visual artifacts, weakening detectors and explanations that rely only on surface appearance. We present LaP-Forensics, a multimodal framework that augments RGB semantics with reconstruction-based forensic evidence. A frozen Stable Diffusion DDIM inversion-reconstruction model provides a fixed reconstruction reference, and its residual map measures local compatibility with that reference. Independent projectors encode the RGB image and residual map before a structured Where-What-Why model predicts a textual analysis and an artifact mask.Supervised fine-tuning is followed by Group Relative Policy Optimization (GRPO), whose reward combines mask overlap with output-structure and evidence-reference terms. These text-side terms encourage the model to refer to the consistency map but do not constitute a verifier of free-form textual truth. A separate image-level head fuses RGB and DDIM-residual class features. Experiments show cross-generator detection on UniversalFakeDetect and competitive artifact localization on the official SynthScars benchmark. Controlled cue-construction, inversion-horizon, component, reward-term, and counterfactual analyses support the utility of the residual stream under the evaluated settings, while free-form textual faithfulness and reliability under post-processing remain open limitations.
Key facts. Cited by 1 paper in the map (data through 14 Oct 2026). Placed in Multimodal reasoning, one of 17 directions in LLM reasoning. Builds on 29 of its 57 references that are in the map. First posted on arXiv 28 Jul 2026.
Builds on
29 of 57 references.
Closest ancestors · 3
Same direction, newest first
- 2025Locate-Then-Examine: Grounded Region Reasoning Improves Detection of AI-Generated Images5 Oct
- 2025Seeing Before Reasoning: A Unified Framework for Generalizable and Explainable Fake Image Detection29 Sep
- 2025Interpretable and Reliable Detection of AI-Generated Images via Grounded Reasoning in MLLMs8 Jun
Other references · 26
- 2021Learning Transferable Visual Models From Natural Language Supervisioncited by 33,744
- 2021LoRA: Low-Rank Adaptation of Large Language Modelscited by 14,380
- 2023Llama 2: Open Foundation and Fine-Tuned Chat Modelscited by 13,028
- 2020Denoising Diffusion Implicit Modelscited by 9,781
- 2024DeepSeekMath: Pushing the Limits of Mathematical Reasoning in Open Language Modelscited by 9,379
- 2023Improved Baselines with Visual Instruction Tuningcited by 4,418
- 2024Qwen2-VL: Enhancing Vision-Language Model's Perception of the World at Any Resolutioncited by 4,234
- 2023MiniGPT-4: Enhancing Vision-Language Understanding with Advanced Large Language Modelscited by 2,711
- 2023DIRE for Diffusion-Generated Image Detectioncited by 390
- 2020What makes fake images detectable? Understanding properties that generalizecited by 273
- 2024A Sanity Check for AI-generated Image Detectioncited by 189
- 2019Detecting GAN generated Fake Images using Co-occurrence Matricescited by 124
14 more
- 2024SIDA: Social Media Image Deepfake Detection, Localization and Explanation with Large Multimodal Modelcited by 108
- 2025LEGION: Learning to Ground and Explain for Synthetic Image Detectioncited by 65
- 2024D3: Scaling Up Deepfake Detection by Learning from Discrepancycited by 45
- 2025IMAGGarment: Fine-Grained Garment Generation for Controllable Fashion Designcited by 36
- 2025All Patches Matter, More Patches Better: Enhance AI-Generated Image Detection via Panoptic Patch Learningcited by 24
- 2025OpenSDI: Spotting Diffusion-Generated Images in the Open Worldcited by 23
- 2026DNA: Uncovering Universal Latent Forgery Knowledgecited by 14
- 2025Where, What, Why: Towards Explainable Driver Attention Predictioncited by 10
- 2025Few-Shot Synthetic Image Attribution: Identifying Unseen Generators with Limited Samplescited by 6
- 2026Beyond Surface Artifacts: Capturing Shared Latent Forgery Knowledge Across Modalitiescited by 6
- 2025No Pixel Left Behind: A Detail-Preserving Architecture for Robust High-Resolution AI-Generated Image Detectioncited by 5
- 2025ManipShield: A Unified Framework for Image Manipulation Detection, Localization and Explanationcited by 5
- 2026A Comprehensive Dataset for Human vs. AI Generated Image Detectioncited by 4
- 2025EditTrack: Detecting and Attributing AI-assisted Image Editingcited by 2
Built on by
Citing papers per year: 2026: 1.
1 paper.
Similar, not cited
Close in wording, no citation either way
- 2026Look Before You Judge: Training-Free Region Mining for Grounded and Explainable Deepfake Detection
- 2026Beyond Static Artifacts: A Forensic Benchmark for Video Deepfake Reasoning in Vision Language Models
- 2025FORGE: Forensic Reasoning with Grounded Evidence
- 2026VIGIL: Part-Grounded Structured Reasoning for Generalizable Deepfake Detection
- 2025INSIGHT: An Interpretable Neural Vision-Language Framework for Reasoning of Generative Artifacts
- 2026MSU Team at the Explainable Deepfake Detection Challenge 2026: Grounded Artifact Evidence for Deepfake Detection
- 2025Training-Free Multimodal Deepfake Detection via Graph Reasoning
- 2026Evidence Packing for Cross-Domain Image Deepfake Detection with LVLMs