PRIMA: Multi-Image Vision-Language Models for Reasoning Segmentation
On the map: LLM reasoning → Multimodal reasoning
Abstract (arXiv)
Despite significant advancements in Large Vision-Language Models (LVLMs)' capabilities, existing pixel-grounding models operate in single-image settings, limiting their ability to perform detailed, fine-grained comparisons across multiple images. Conversely, current multi-image understanding models lack pixel-level grounding. Our work addresses this gap by introducing the task of multi-image pixel-grounded reasoning alongside PRIMA, an LVLM that integrates pixel-level grounding with robust multi-image reasoning to produce contextually rich, pixel-grounded explanations. Central to PRIMA is SQuARE, a vision module that injects cross-image relational context into compact query-based visual tokens before fusing them with the language backbone. To support training and evaluation, we curate M4SEG, a new multi-image reasoning segmentation benchmark consisting of ~744K question-answer pairs that require fine-grained visual understanding across multiple images. PRIMA outperforms state-of-the-art baselines with 7.83% and 11.25% improvements in Recall and S-IoU, respectively. Ablation studies further demonstrate the effectiveness of the proposed SQuARE module in capturing cross-image relationships.
Key facts. Cited by 13 papers in the map (data through 14 Oct 2026). Placed in Multimodal reasoning, one of 17 directions in LLM reasoning. Builds on 12 of its 94 references that are in the map. First posted on arXiv 19 Dec 2024.
Builds on
12 of 94 references.
Closest ancestors · 1
Same direction, newest first
Other references · 11
- 2024GPT-4o System Cardcited by 4,588
- 2024Grounded SAM: Assembling Open-World Models for Diverse Visual Taskscited by 929
- 2023Shikra: Unleashing Multimodal LLM's Referential Dialogue Magiccited by 906
- 2023EVA-CLIP: Improved Training Techniques for CLIP at Scalecited by 798
- 2024LLaVA-NeXT-Interleave: Tackling Multi-image, Video, and 3D in Large Multimodal Modelscited by 584
- 2024Mini-Gemini: Mining the Potential of Multi-modality Vision Language Modelscited by 365
- 2023GPT4RoI: Instruction Tuning Large Language Model on Region-of-Interestcited by 302
- 2023Valley: Video Assistant with Large Language model Enhanced abilitYcited by 234
- 2024LongLLaVA: Scaling Multi-modal LLMs to 1000 Images Efficiently via a Hybrid Architecturecited by 102
- 2024MMRA: A Benchmark for Evaluating Multi-Granularity and Multi-Image Relational Association Capabilities in Large Visual Language Modelscited by 9
- 2024MMMModal -- Multi-Images Multi-Audio Multi-turn Multi-Modalcited by 2
Built on by
Citing papers per year: 2025: 8; 2026: 5.
13 papers.
Sort:
By area:
- 2025Fine-Grained Preference Optimization Improves Spatial Reasoning in VLMscited by 32
- 2025Multimodal Referring Segmentation: A Surveycited by 22
- 2025Reasoning Segmentation for Images and Videos: A Surveycited by 12
- 2025Counterfactual Segmentation Reasoning: Diagnosing and Mitigating Pixel-Grounding Hallucinationcited by 7
- 2026LMMs Meet Object-Centric Vision: Understanding, Segmentation, Editing and Generationcited by 6
- 2026WeatherReasonSeg: A Benchmark for Weather-Aware Reasoning Segmentation in Visual Language Modelscited by 5
- 2026EvoComp: Learning Visual Token Compression for Multimodal Large Language Models via Semantic-Guided Evolutionary Labelingcited by 5
- 2025URECA: Unique Region Caption Anythingcited by 2
- 2025See-in-Pairs: Reference Image-Guided Comparative Vision-Language Models for Medical Diagnosiscited by 2
- 2025PathMR: Multimodal Visual Reasoning for Interpretable Pathology Diagnosiscited by 2
- 2026DreamPartGen: Semantically Grounded Part-Level 3D Generation via Collaborative Latent Denoisingcited by 2
- 2025Analyze-Prompt-Reason: A Collaborative Agent-Based Framework for Multi-Image Vision-Language Reasoningcited by 1
- 2026From Structure to Synergy: A Survey of Vision-Language Perception Paradigm Evolution in Multimodal Large Language Models24 Jun 2026
- 2026EvoComp: Learning Visual Token Compression for Multimodal Large Language Models via Semantic-Guided Evolutionary Labeling18 Apr 2026
- 2026LMMs Meet Object-Centric Vision: Understanding, Segmentation, Editing and Generation13 Apr 2026
- 2026DreamPartGen: Semantically Grounded Part-Level 3D Generation via Collaborative Latent Denoising19 Mar 2026
- 2026WeatherReasonSeg: A Benchmark for Weather-Aware Reasoning Segmentation in Visual Language Models18 Mar 2026
- 2025PathMR: Multimodal Visual Reasoning for Interpretable Pathology Diagnosis28 Aug 2025
- 2025Analyze-Prompt-Reason: A Collaborative Agent-Based Framework for Multi-Image Vision-Language Reasoning1 Aug 2025
- 2025Multimodal Referring Segmentation: A Survey1 Aug 2025
- 2025Fine-Grained Preference Optimization Improves Spatial Reasoning in VLMs26 Jun 2025
- 2025Counterfactual Segmentation Reasoning: Diagnosing and Mitigating Pixel-Grounding Hallucination26 Jun 2025
- 2025See-in-Pairs: Reference Image-Guided Comparative Vision-Language Models for Medical Diagnosis22 Jun 2025
- 2025Reasoning Segmentation for Images and Videos: A Survey24 May 2025
1 more
- 2025URECA: Unique Region Caption Anything7 Apr 2025
- 2025Fine-Grained Preference Optimization Improves Spatial Reasoning in VLMscited by 32
- 2025Counterfactual Segmentation Reasoning: Diagnosing and Mitigating Pixel-Grounding Hallucinationcited by 7
- 2026LMMs Meet Object-Centric Vision: Understanding, Segmentation, Editing and Generationcited by 6
- 2026WeatherReasonSeg: A Benchmark for Weather-Aware Reasoning Segmentation in Visual Language Modelscited by 5
- 2025PathMR: Multimodal Visual Reasoning for Interpretable Pathology Diagnosiscited by 2
- 2025Analyze-Prompt-Reason: A Collaborative Agent-Based Framework for Multi-Image Vision-Language Reasoningcited by 1
- 2026LMMs Meet Object-Centric Vision: Understanding, Segmentation, Editing and Generation13 Apr 2026
- 2026WeatherReasonSeg: A Benchmark for Weather-Aware Reasoning Segmentation in Visual Language Models18 Mar 2026
- 2025PathMR: Multimodal Visual Reasoning for Interpretable Pathology Diagnosis28 Aug 2025
- 2025Analyze-Prompt-Reason: A Collaborative Agent-Based Framework for Multi-Image Vision-Language Reasoning1 Aug 2025
- 2025Fine-Grained Preference Optimization Improves Spatial Reasoning in VLMs26 Jun 2025
- 2025Counterfactual Segmentation Reasoning: Diagnosing and Mitigating Pixel-Grounding Hallucination26 Jun 2025
- 2026EvoComp: Learning Visual Token Compression for Multimodal Large Language Models via Semantic-Guided Evolutionary Labelingcited by 5
- 2025See-in-Pairs: Reference Image-Guided Comparative Vision-Language Models for Medical Diagnosiscited by 2
- 2026From Structure to Synergy: A Survey of Vision-Language Perception Paradigm Evolution in Multimodal Large Language Modelscited by 0
- 2026From Structure to Synergy: A Survey of Vision-Language Perception Paradigm Evolution in Multimodal Large Language Models24 Jun 2026
- 2026EvoComp: Learning Visual Token Compression for Multimodal Large Language Models via Semantic-Guided Evolutionary Labeling18 Apr 2026
- 2025See-in-Pairs: Reference Image-Guided Comparative Vision-Language Models for Medical Diagnosis22 Jun 2025
- 2025Multimodal Referring Segmentation: A Surveycited by 22
- 2025Reasoning Segmentation for Images and Videos: A Surveycited by 12
- 2025URECA: Unique Region Caption Anythingcited by 2
- 2026DreamPartGen: Semantically Grounded Part-Level 3D Generation via Collaborative Latent Denoisingcited by 2
- 2026DreamPartGen: Semantically Grounded Part-Level 3D Generation via Collaborative Latent Denoising19 Mar 2026
- 2025Multimodal Referring Segmentation: A Survey1 Aug 2025
- 2025Reasoning Segmentation for Images and Videos: A Survey24 May 2025
- 2025URECA: Unique Region Caption Anything7 Apr 2025
Similar, not cited
Close in wording, no citation either way
- 2024Benchmarking Multi-Image Understanding in Vision and Language Models: Perception, Knowledge, Reasoning, and Multi-Hop Reasoning
- 2025VGR: Visual Grounded Reasoning
- 2025LVLM_CSP: Accelerating Large Vision Language Models via Clustering, Scattering, and Pruning for Reasoning Segmentation
- 2026CoRe: A Comprehensive Framework for Cross-Image Comparative Reasoning in Vision-Language Models
- 2026GeM-VG: Towards Generalized Multi-image Visual Grounding with Multimodal Large Language Models
- 2026S2H-DPO: Hardness-Aware Preference Optimization for Vision-Language Models
- 2026Segmentation before Answering: Pixel Grounding for MLLM Visual Reasoning
- 2024Chain-of-Spot: Interactive Reasoning Improves Large Vision-Language Models