mlsanityData to 14 Oct 2026

PRIMA: Multi-Image Vision-Language Models for Reasoning Segmentation

arXiv 2412.15209 ↗First posted 19 Dec 2024cs.CV cs.AI cs.LGcited by 13

On the map: LLM reasoning → Multimodal reasoning

also in 1 more
Abstract (arXiv)

Despite significant advancements in Large Vision-Language Models (LVLMs)' capabilities, existing pixel-grounding models operate in single-image settings, limiting their ability to perform detailed, fine-grained comparisons across multiple images. Conversely, current multi-image understanding models lack pixel-level grounding. Our work addresses this gap by introducing the task of multi-image pixel-grounded reasoning alongside PRIMA, an LVLM that integrates pixel-level grounding with robust multi-image reasoning to produce contextually rich, pixel-grounded explanations. Central to PRIMA is SQuARE, a vision module that injects cross-image relational context into compact query-based visual tokens before fusing them with the language backbone. To support training and evaluation, we curate M4SEG, a new multi-image reasoning segmentation benchmark consisting of ~744K question-answer pairs that require fine-grained visual understanding across multiple images. PRIMA outperforms state-of-the-art baselines with 7.83% and 11.25% improvements in Recall and S-IoU, respectively. Ablation studies further demonstrate the effectiveness of the proposed SQuARE module in capturing cross-image relationships.

Key facts. Cited by 13 papers in the map (data through 14 Oct 2026). Placed in Multimodal reasoning, one of 17 directions in LLM reasoning. Builds on 12 of its 94 references that are in the map. First posted on arXiv 19 Dec 2024.

Builds on

12 of 94 references.

Closest ancestors · 1

Same direction, newest first

  1. 2023LISA++: An Improved Baseline for Reasoning Segmentation with Large Language Model28 Dec

Other references · 11

  1. 2024GPT-4o System Cardcited by 4,588
  2. 2024Grounded SAM: Assembling Open-World Models for Diverse Visual Taskscited by 929
  3. 2023Shikra: Unleashing Multimodal LLM's Referential Dialogue Magiccited by 906
  4. 2023EVA-CLIP: Improved Training Techniques for CLIP at Scalecited by 798
  5. 2024LLaVA-NeXT-Interleave: Tackling Multi-image, Video, and 3D in Large Multimodal Modelscited by 584
  6. 2024Mini-Gemini: Mining the Potential of Multi-modality Vision Language Modelscited by 365
  7. 2023GPT4RoI: Instruction Tuning Large Language Model on Region-of-Interestcited by 302
  8. 2023Valley: Video Assistant with Large Language model Enhanced abilitYcited by 234
  9. 2024LongLLaVA: Scaling Multi-modal LLMs to 1000 Images Efficiently via a Hybrid Architecturecited by 102
  10. 2024MMRA: A Benchmark for Evaluating Multi-Granularity and Multi-Image Relational Association Capabilities in Large Visual Language Modelscited by 9
  11. 2024MMMModal -- Multi-Images Multi-Audio Multi-turn Multi-Modalcited by 2

Built on by

Cited by year (2026 to 14 Oct)

Citing papers per year: 2025: 8; 2026: 5.

13 papers.

Sort:

By area:

Similar, not cited

Close in wording, no citation either way

  1. 2024Benchmarking Multi-Image Understanding in Vision and Language Models: Perception, Knowledge, Reasoning, and Multi-Hop Reasoning
  2. 2025VGR: Visual Grounded Reasoning
  3. 2025LVLM_CSP: Accelerating Large Vision Language Models via Clustering, Scattering, and Pruning for Reasoning Segmentation
  4. 2026CoRe: A Comprehensive Framework for Cross-Image Comparative Reasoning in Vision-Language Models
  5. 2026GeM-VG: Towards Generalized Multi-image Visual Grounding with Multimodal Large Language Models
  6. 2026S2H-DPO: Hardness-Aware Preference Optimization for Vision-Language Models
  7. 2026Segmentation before Answering: Pixel Grounding for MLLM Visual Reasoning
  8. 2024Chain-of-Spot: Interactive Reasoning Improves Large Vision-Language Models