mlsanityData to 14 Oct 2026

MAD-Guard: Controlled Study of Autoregressive Generation versus Direct Decision Interfaces for Closed Multimodal Forensic Tasks

arXiv 2609.33683 ↗First posted 27 Sep 2026cs.CV cs.CRcited by 0

Not on the map. Why?

Abstract (arXiv)

When should multimodal foundation models generate tokens, and when should they directly output a decision? We present MAD-Guard, a controlled study of output-decision interfaces for closed multimodal forensic tasks. Once a multimodal representation is computed, is autoregressive generation necessary for closed forensic decisions with high input complexity but low output entropy? Under a matched Qwen3-VL-8B backbone, 2,400 FakeClue training samples, and LoRA budget (r=16, α=32) on Huawei Ascend 910C NPUs, we evaluate a progression of decision interfaces (AR-SFT [generate] → Logit Slice → Binary Direct Head → +choice → +act → CLM-Head) and decompose latency into backbone representation (53.12 ms), 151,643-way vocabulary projection (+85.04 ms → 138.16 ms), and decoding (+248.26 ms → 386.42 ms). Under 1-to-1 binary supervision (LBCE), a Binary Direct Head cuts latency by 2.60×-7.27× (53.12 ms) and lowers calibration error by 1.88× (ECE = 0.0450 vs. 0.0845), with a -1.80% accuracy trade-off (93.10% vs. 94.90%; 0.9795 vs. 0.9871 ROC-AUC) from forfeiting token priors. Gains above AR-SFT arise either from multi-task attribution and uncertainty gating (+choice+act: 96.44% accuracy, 0.9940 ROC-AUC, 0.0187 ECE at 53.71 ms) or from a disaggregated contrastive head (CLM-Head: 96.55% binary and 96.44% multi-task accuracy, 0.0166 ECE, 98.79% 7-class attribution at 54.42 ms) retaining semantic priors without token decoding. Across 5,000 out-of-sample images from five benchmarks, our framework excels on synthetic, camouflage, and document forgeries (96.44% GenImage, 97.73% Chameleon, 91.84% Doc) while showing a clear boundary on compressed face manipulation (FF++ ROC-AUC = 0.5913).

Key facts. No citing papers in the map yet (data through 14 Oct 2026). Builds on 27 of its 37 references that are in the map. First posted on arXiv 27 Sep 2026.

Builds on

27 of 37 references.

References · 27

  1. 2023Visual Instruction Tuningcited by 7,869
  2. 2023Qwen-VL: A Versatile Vision-Language Model for Understanding, Localization, Text Reading, and Beyondcited by 2,224
  3. 2019FaceForensics++: Learning to Detect Manipulated Facial Imagescited by 1,101
  4. 2016Training Deep Nets with Sublinear Memory Costcited by 848
  5. 2019CNN-generated images are surprisingly easy to spot... for nowcited by 847
  6. 2020Thinking in Frequency: Face Forgery Detection by Mining Frequency-aware Cluescited by 523
  7. 2023Towards Universal Fake Image Detectors that Generalize Across Generative Modelscited by 490
  8. 2019Face X-ray for More General Face Forgery Detectioncited by 470
  9. 2023DIRE for Diffusion-Generated Image Detectioncited by 390
  10. 2021Spatial-Phase Shallow Learning: Rethinking Face Forgery Detection in Frequency Domaincited by 244
  11. 2024A Sanity Check for AI-generated Image Detectioncited by 189
  12. 2023UCF: Uncovering Common Features for Generalizable Deepfake Detectioncited by 180
15 more
  1. 2024C2P-CLIP: Injecting Category Common Prompt in CLIP to Enhance Generalization in Deepfake Detectioncited by 113
  2. 2023AltFreezing for More General Video Face Forgery Detectioncited by 78
  3. 2025Spot the Fake: Large Multimodal Model-Based Synthetic Image Detection with Artifact Explanationcited by 68
  4. 2024D3: Scaling Up Deepfake Detection by Learning from Discrepancycited by 45
  5. 2025Rethinking Vision-Language Model in Face Forensics: Multi-Modal Interpretable Forged Face Detectorcited by 40
  6. 2025Bridging the Gap Between Ideal and Real-world Evaluation: Benchmarking AI-Generated Image Detection in Challenging Scenarioscited by 24
  7. 2025Forensics-Bench: A Comprehensive Forgery Detection Benchmark Suite for Large Vision Language Modelscited by 13
  8. 2025PRPO: Paragraph-level Policy Optimization for Vision-Language Deepfake Detectioncited by 5
  9. 2026FakeVLM-R1: Internalizing Physical Laws via CoT for Synthetic Image Detectioncited by 4
  10. 2026VIGIL: Part-Grounded Structured Reasoning for Generalizable Deepfake Detectioncited by 3
  11. 2026Deep Residual Injection for Full-Spectrum Forensic Signal Perception in Multimodal Large Language Modelscited by 3
  12. 2026GLiNER Guard: Unified Encoder Family for Production LLM Safety and Privacycited by 2
  13. 2026Perception, Verdict, and Evolution: Hindsight-Driven Self-Refining Forensics Agent for AI-Generated Image Detectioncited by 1
  14. 2026Evidence-Grounded Forensic Reasoning for Detecting and Grounding Multi-Modal Media Manipulationcited by 1
  15. 2026Anchor-Regularized Adaptation for Generalizable AI-Generated Image Detection with DINOv3cited by 1

Built on by

Not cited yet.