mlsanityData to 14 Oct 2026

DGM4+: Dataset Extension for Global Scene Inconsistency

arXiv 2509.26047 ↗First posted 30 Sep 2025cs.CVcited by 2

Not on the map. Why?

Abstract (arXiv)

The rapid advances in generative models have significantly lowered the barrier to producing convincing multimodal disinformation. Fabricated images and manipulated captions increasingly co-occur to create persuasive false narratives. While the Detecting and Grounding Multi-Modal Media Manipulation (DGM4) dataset established a foundation for research in this area, it is restricted to local manipulations such as face swaps, attribute edits, and caption changes. This leaves a critical gap: global inconsistencies, such as mismatched foregrounds and backgrounds, which are now prevalent in real-world forgeries. To address this, we extend DGM4 with 5,000 high-quality samples that introduce Foreground-Background (FG-BG) mismatches and their hybrids with text manipulations. Using OpenAI's gpt-image-1 and carefully designed prompts, we generate human-centric news-style images where authentic figures are placed into absurd or impossible backdrops (e.g., a teacher calmly addressing students on the surface of Mars). Captions are produced under three conditions: literal, text attribute, and text split, yielding three new manipulation categories: FG-BG, FG-BG+TA, and FG-BG+TS. Quality control pipelines enforce one-to-three visible faces, perceptual hash deduplication, OCR-based text scrubbing, and realistic headline length. By introducing global manipulations, our extension complements existing datasets, creating a benchmark DGM4+ that tests detectors on both local and global reasoning. This resource is intended to strengthen evaluation of multimodal models such as HAMMER, which currently struggle with FG-BG inconsistencies. We release our DGM4+ dataset and generation script at https://github.com/Gaganx0/DGM4plus

Key facts. Cited by 2 papers in the map (data through 14 Oct 2026). Builds on 16 of its 27 references that are in the map. First posted on arXiv 30 Sep 2025.

Builds on

16 of 27 references.

References · 16

  1. 2021High-Resolution Image Synthesis with Latent Diffusion Modelscited by 18,863
  2. 2023DINOv2: Learning Robust Visual Features without Supervisioncited by 7,974
  3. 2024Qwen2-VL: Enhancing Vision-Language Model's Perception of the World at Any Resolutioncited by 4,234
  4. 2023Sigmoid Loss for Language Image Pre-Trainingcited by 3,109
  5. 2022Reproducible scaling laws for contrastive language-image learningcited by 1,173
  6. 2019FaceForensics++: Learning to Detect Manipulated Facial Imagescited by 1,101
  7. 2016Joint Face Detection and Alignment using Multi-task Cascaded Convolutional Networkscited by 903
  8. 2017"Liar, Liar Pants on Fire": A New Benchmark Dataset for Fake News Detectioncited by 363
  9. 2019Fake News Detection on Social Media using Geometric Deep Learningcited by 118
  10. 2021NewsCLIPpings: Automatic Generation of Out-of-Context Multimodal Mediacited by 107
  11. 2023Detecting and Grounding Multi-Modal Media Manipulationcited by 99
  12. 2018Trends in the Diffusion of Misinformation on Social Mediacited by 25
4 more
  1. 2024ASAP: Advancing Semantic Alignment Promotes Multi-Modal Manipulation Detecting and Groundingcited by 15
  2. 2021Multimodal Fake News Detectioncited by 14
  3. 2023Unified Frequency-Assisted Transformer Framework for Detecting and Grounding Multi-Modal Manipulationcited by 14
  4. 2025AV-Deepfake1M++: A Large-Scale Audio-Visual Deepfake Benchmark with Real-World Perturbationscited by 8

Built on by

Cited by year (2026 to 14 Oct)

Citing papers per year: 2026: 2.

2 papers.