mlsanityData to 7 Oct 2026

T-IMPACT: A Severity-Aware Benchmark for Contextual Image-Text Manipulation

arXiv 2606.22339 ↗First posted 21 Jun 2026cs.CVcited by 0

On the map: Multimodal LLMs / vision-language models → VLM benchmarks and visual reasoning

Abstract (arXiv)

Recent advances in vision-language models and generative editing systems have made it increasingly easy to produce persuasive multimodal misinformation by altering images, text, or both jointly. However, existing datasets focus mainly on authenticity, out-of-context mismatch, or manipulation type, and rarely capture how strongly an edit changes the likely interpretation of a post. We introduce T-IMPACT, a first-release severity-aware benchmark for manipulated news-style image-text pairs. T-IMPACT contains 98,786 examples spanning pristine, image-only, text-only, and joint manipulations, with a calibrated continuous severity signal, coarse low/medium/high labels, and supporting grounding metadata. Starting from a news image-text pair, the pipeline extracts semantic anchors, grounds them spatially, performs localized image edits and constrained caption rewrites, and calibrates contextual-impact scores using limited human ratings. In this release, the calibrated continuous score is the primary severity target, while the low/medium/high bands should be interpreted as coarse operating buckets rather than balanced classes. Experiments show that current models recover some authenticity signal, but severity prediction remains substantially harder and only weakly aligned with human judgment. T-IMPACT provides an initial benchmark for studying multimodal manipulation beyond binary real/fake classification toward graded contextual impact.

Key facts. No citing papers in the map yet (data through 7 Oct 2026). Placed in VLM benchmarks and visual reasoning, one of 16 directions in Multimodal LLMs / vision-language models. Builds on 13 of its 26 references that are in the map. First posted on arXiv 21 Jun 2026.

Builds on

13 of 26 references.

References · 13

  1. 2023SDXL: Improving Latent Diffusion Models for High-Resolution Image Synthesiscited by 4,290
  2. 2023Grounding DINO: Marrying DINO with Grounded Pre-Training for Open-Set Object Detectioncited by 3,274
  3. 2024LLaVA-OneVision: Easy Visual Task Transfercited by 2,669
  4. 2021Resolution-robust Large Mask Inpainting with Fourier Convolutionscited by 730
  5. 2019Rank consistent ordinal regression for neural networks with application to age estimationcited by 132
  6. 2024SIDA: Social Media Image Deepfake Detection, Localization and Explanation with Large Multimodal Modelcited by 107
  7. 2021NewsCLIPpings: Automatic Generation of Out-of-Context Multimodal Mediacited by 106
  8. 2023Detecting and Grounding Multi-Modal Media Manipulationcited by 98
  9. 2019r/Fakeddit: A New Multimodal Benchmark Dataset for Fine-grained Fake News Detectioncited by 53
  10. 2021A Survey on Multimodal Disinformation Detectioncited by 47
  11. 2021COSMOS: Catching Out-of-Context Misinformation with Self-Supervised Learningcited by 26
  12. 2025TRUST-VL: An Explainable News Assistant for General Multimodal Misinformation Detectioncited by 10
1 more
  1. 2025Multimodal Fake News Detection: MFND Dataset and Shallow-Deep Multitask Learningcited by 5

Built on by

Not cited yet.

Similar, not cited

Close in wording, no citation either way

  1. 2025"Humor, Art, or Misinformation?": A Multimodal Dataset for Intent-Aware Synthetic Image Detection
  2. 2025Unblocking Fine-Grained Evaluation of Detailed Captions: An Explaining AutoRater and Critic-and-Revise Pipeline
  3. 2022Benchmarking Robustness of Multimodal Image-Text Models under Distribution Shift
  4. 2025M3T2IBench: A Large-Scale Multi-Category, Multi-Instance, Multi-Relation Text-to-Image Benchmark
  5. 2026DEPICT: Scoring Text-to-Image Alignment by Answer Agreement
  6. 2026Evaluating Image Editing with LLMs: A Comprehensive Benchmark and Intermediate-Layer Probing Approach
  7. 2025E2LVLM:Evidence-Enhanced Large Vision-Language Model for Multimodal Out-of-Context Misinformation Detection
  8. 2025LMM4Edit: Benchmarking and Evaluating Multimodal Image Editing with LMMs