MinCU: A Fine-Grained Benchmark for Grounded Minimal-Change Understanding in Image Pairs
On the map: Multimodal LLMs / vision-language models → VLM benchmarks and visual reasoning also fits: Image editing and quality assessment
Abstract (arXiv)
Localizing and describing fine-grained differences between near-identical images is a critical yet underexplored capability for multimodal large language models (MLLMs). Existing benchmarks largely assess semantic comparison or single-image grounding in isolation, without jointly requiring faithful description and physical localization. To bridge this gap, we introduce MinCU, a benchmark for grounded minimal-change understanding, where each sample consists of an image pair differing by a single atomic variation in object category, attribute, count, or spatial position, and models are evaluated on their ability to describe the change, localize the changed regions, and identify the changed entity. We further propose Semantic-Guided Implicit Spatial Anchors (SG-ISA), a structured autoregressive method that decomposes prediction into a Think-Locate-Describe sequence. SG-ISA first predicts a semantic cue for the changed concept, then uses discrete spatial anchors as an implicit localization scaffold, and finally generates the change description together with the grounding box. Experiments reveal that even the strongest closed-source MLLMs and recent R1-style reasoning models struggle on MinCU, with most failing to jointly produce accurate descriptions and grounding boxes. Compared to the previous chain-of-thought method, fine-tuning with SG-ISA yields substantial joint improvements in grounding accuracy and description quality while reducing reasoning-token overhead by approximately 26%. These results suggest that an implicit intermediate spatial interface can be more effective than relying solely on model scale for grounded dual-image understanding.
Key facts. No citing papers in the map yet (data through 7 Oct 2026). Placed in VLM benchmarks and visual reasoning, one of 16 directions in Multimodal LLMs / vision-language models. Builds on 42 of its 61 references that are in the map. First posted on arXiv 20 Sep 2026.
Builds on
42 of 61 references.
Closest ancestors · 9
Same direction, newest first
- 2026GeM-VG: Towards Generalized Multi-image Visual Grounding with Multimodal Large Language Models8 Jan
- 2025Argus: Vision-Centric Reasoning with Grounded Chain-of-Thought29 May
- 2025Grounded Chain-of-Thought for Multimodal Large Language Models17 Mar
- 2025Migician: Revealing the Magic of Free-Form Multi-Image Grounding in Multimodal Large Language Models10 Jan
- 2024VisMin: Visual Minimal-Change Understanding23 Jul
- 2023Compositional Chain-of-Thought Prompting for Large Multimodal Models27 Nov
- 2023Ferret: Refer and Ground Anything Anywhere at Any Granularity11 Oct
- 2023Qwen-VL: A Versatile Vision-Language Model for Understanding, Localization, Text Reading, and Beyond24 Aug
- 2023Kosmos-2: Grounding Multimodal Large Language Models to the World26 Jun
Other references · 33
- 2023GPT-4 Technical Reportcited by 18,132
- 2014Microsoft COCO: Common Objects in Contextcited by 17,498
- 2024The Llama 3 Herd of Modelscited by 14,192
- 2022Chain-of-Thought Prompting Elicits Reasoning in Large Language Modelscited by 12,302
- 2019Sentence-BERT: Sentence Embeddings using Siamese BERT-Networkscited by 9,049
- 2024DeepSeekMath: Pushing the Limits of Mathematical Reasoning in Open Language Modelscited by 8,851
- 2019BERTScore: Evaluating Text Generation with BERTcited by 5,462
- 2023Grounding DINO: Marrying DINO with Grounded Pre-Training for Open-Set Object Detectioncited by 3,274
- 2014Sequence to Sequence Learning with Neural Networkscited by 2,974
- 2025Qwen3-VL Technical Reportcited by 2,534
- 2022Survey of Hallucination in Natural Language Generationcited by 2,056
- 2014CIDEr: Consensus-based Image Description Evaluationcited by 2,027
21 more
- 2023Evaluating Object Hallucination in Large Vision-Language Modelscited by 1,696
- 2025InternVL3.5: Advancing Open-Source Multimodal Models in Versatility, Reasoning, and Efficiencycited by 1,419
- 2019LVIS: A Dataset for Large Vocabulary Instance Segmentationcited by 1,215
- 2016Modeling Context in Referring Expressionscited by 1,054
- 2015Generation and Comprehension of Unambiguous Object Descriptionscited by 897
- 2023Shikra: Unleashing Multimodal LLM's Referential Dialogue Magiccited by 891
- 2016SPICE: Semantic Propositional Image Caption Evaluationcited by 820
- 2021MDETR -- Modulated Detection for End-to-End Multi-Modal Understandingcited by 811
- 2025VLM-R1: A Stable and Generalizable R1-style Large Vision-Language Modelcited by 515
- 2021Pix2seq: A Language Modeling Framework for Object Detectioncited by 345
- 2023Set-of-Mark Prompting Unleashes Extraordinary Visual Grounding in GPT-4Vcited by 291
- 2018Learning to Describe Differences Between Pairs of Similar Imagescited by 114
- 2025UniVG-R1: Reasoning Guided Universal Visual Grounding with Reinforcement Learningcited by 83
- 2019Expressing Visual Relationships via Languagecited by 49
- 2026Seed1.8 Model Card: Towards Generalized Real-World Agencycited by 47
- 2022Image Difference Captioning with Pre-training and Contrastive Learningcited by 39
- 2022CLIP4IDC: CLIP for Image Difference Captioningcited by 25
- 2024OneDiff: A Generalist Model for Image Difference Captioningcited by 15
- 2024VIXEN: Visual Text Comparison Network for Image Difference Captioningcited by 12
- 2025OmniDiff: A Comprehensive Benchmark for Fine-grained Image Difference Captioningcited by 12
- 2025Image Difference Grounding with Natural Languagecited by 1
Built on by
Not cited yet.
Similar, not cited
Close in wording, no citation either way
- 2026CCRC: A Change-Aware Captioning and Reasoning Chain for Image Change Captioning and Segmentation
- 2026VDiff-Bench: A Challenging Benchmark for Fine-Grained Image Difference Identification
- 2026Spot-the-shift: Evaluating Grounded Image Difference Captioning of Long-term Changes
- 2026DiffCap-Bench: A Comprehensive, Challenging, Robust Benchmark for Image Difference Captioning
- 2026C3-Bench: A Context-Aware Change Captioning Benchmark
- 2026An Open-Source Benchmark and Baseline for Multi-temporal Referring Segmentation
- 2026From Correspondence to Actions: Human-Like Multi-Image Spatial Reasoning in Multi-modal Large Language Models
- 2025Leveraging Textual Compositional Reasoning for Robust Change Captioning