RegionReasoner: Region-Grounded Multi-Round Visual Reasoning
On the map: LLM reasoning → Multimodal reasoning
Abstract (arXiv)
Large vision-language models have achieved remarkable progress in visual reasoning, yet most existing systems rely on single-step or text-only reasoning, limiting their ability to iteratively refine understanding across multiple visual contexts. To address this limitation, we introduce a new multi-round visual reasoning benchmark with training and test sets spanning both detection and segmentation tasks, enabling systematic evaluation under iterative reasoning scenarios. We further propose RegionReasoner, a reinforcement learning framework that enforces grounded reasoning by requiring each reasoning trace to explicitly cite the corresponding reference bounding boxes, while maintaining semantic coherence via a global-local consistency reward. This reward extracts key objects and nouns from both global scene captions and region-level captions, aligning them with the reasoning trace to ensure consistency across reasoning steps. RegionReasoner is optimized with structured rewards combining grounding fidelity and global-local semantic alignment. Experiments on detection and segmentation tasks show that RegionReasoner-7B, together with our newly introduced benchmark RegionDial-Bench, considerably improves multi-round reasoning accuracy, spatial grounding precision, and global-local consistency, establishing a strong baseline for this emerging research direction.
Key facts. Cited by 4 papers in the map (data through 7 Oct 2026). Placed in Multimodal reasoning, one of 17 directions in LLM reasoning. Builds on 29 of its 32 references that are in the map. First posted on arXiv 3 Feb 2026.
Builds on
29 of 32 references.
Closest ancestors · 13
Same direction, newest first
- 2025Self-Rewarding Vision-Language Model via Reasoning Decomposition27 Aug
- 2025Pixel Reasoner: Incentivizing Pixel-Space Reasoning with Curiosity-Driven Reinforcement Learning21 May
- 2025Visionary-R1: Mitigating Shortcuts in Visual Reasoning with Reinforcement Learning20 May
- 2025VL-Rethinker: Incentivizing Self-Reflection of Vision-Language Models with Reinforcement Learning10 Apr
- 2025VLM-R1: A Stable and Generalizable R1-style Large Vision-Language Model10 Apr
- 2025Video-R1: Reinforcing Video Reasoning in MLLMs27 Mar
- 2025LMM-R1: Empowering 3B LMMs with Strong Reasoning Abilities Through Two-Stage Rule-Based RL10 Mar
- 2025Vision-R1: Incentivizing Reasoning Capability in Multimodal Large Language Models9 Mar
- 2025Seg-Zero: Reasoning-Chain Guided Segmentation via Cognitive Reinforcement9 Mar
- 2024MAmmoTH-VL: Eliciting Multimodal Reasoning with Instruction Tuning at Scale6 Dec
- 2023PixelLM: Pixel Reasoning with Large Multimodal Model4 Dec
- 2023MathVista: Evaluating Mathematical Reasoning of Foundation Models in Visual Contexts3 Oct
1 more
Other references · 16
- 2014Microsoft COCO: Common Objects in Contextcited by 17,498
- 2017Proximal Policy Optimization Algorithmscited by 14,441
- 2022Chain-of-Thought Prompting Elicits Reasoning in Large Language Modelscited by 12,302
- 2024DeepSeekMath: Pushing the Limits of Mathematical Reasoning in Open Language Modelscited by 8,851
- 2023Visual Instruction Tuningcited by 7,792
- 2025Qwen2.5-VL Technical Reportcited by 5,418
- 2024GPT-4o System Cardcited by 4,467
- 2024Qwen2-VL: Enhancing Vision-Language Model's Perception of the World at Any Resolutioncited by 4,151
- 2024LLaVA-OneVision: Easy Visual Task Transfercited by 2,669
- 2016Visual Genome: Connecting Language and Vision Using Crowdsourced Dense Image Annotationscited by 2,646
- 2023MMMU: A Massive Multi-discipline Multimodal Understanding and Reasoning Benchmark for Expert AGIcited by 2,044
- 2024DeepSeek-VL2: Mixture-of-Experts Vision-Language Models for Advanced Multimodal Understandingcited by 559
4 more
- 2023V*: Guided Visual Search as a Core Mechanism in Multimodal LLMscited by 459
- 2023GLaMM: Pixel Grounding Large Multimodal Modelcited by 447
- 2024Infinity-MM: Scaling Multimodal Performance with Large-Scale and High-Quality Instruction Datacited by 67
- 2024MEGA-Bench: Scaling Multimodal Evaluation to over 500 Real-World Taskscited by 41
Built on by
Citing papers per year: 2026: 4.
4 papers.
- 2026Evidence-RL: Towards Evidence-intensive Visual Reasoningcited by 3
- 2026MIRAGE: Benchmarking and Aligning Multi-Instance Image Editingcited by 0
- 2026DRAGON: A Benchmark for Evidence-Grounded Visual Reasoning over Diagramscited by 0
- 2026Visual Evidence Under Cross-Examination: Evaluating and Controlling Decision-Level Evidence Use in Vision-Language Modelscited by 0
- 2026Visual Evidence Under Cross-Examination: Evaluating and Controlling Decision-Level Evidence Use in Vision-Language Models7 Oct 2026
- 2026Evidence-RL: Towards Evidence-intensive Visual Reasoning8 Aug 2026
- 2026DRAGON: A Benchmark for Evidence-Grounded Visual Reasoning over Diagrams28 Apr 2026
- 2026MIRAGE: Benchmarking and Aligning Multi-Instance Image Editing6 Apr 2026
Similar, not cited
Close in wording, no citation either way
- 2025No Labels, No Problem: Training Visual Reasoners with Multimodal Verifiers
- 2025RCI: A Score for Evaluating Global and Local Reasoning in Multimodal Benchmarks
- 2025VisionReasoner: Unified Reasoning-Integrated Visual Perception via Reinforcement Learning
- 2025SIFThinker: Spatially-Aware Image Focus for Visual Reasoning
- 2025Visual Reasoning Tracer: Object-Level Grounded Reasoning Benchmark
- 2024RegionGPT: Towards Region Understanding Vision Language Model
- 2025VGR: Visual Grounded Reasoning
- 2025SpatialThinker: Reinforcing Scene Graph-Grounded Spatial Reasoning via Dense Rewards