mlsanityData to 14 Oct 2026

SATORI-R1: Incentivizing Multimodal Reasoning through Explicit Visual Anchoring

arXiv 2505.19094 ↗First posted 25 May 2025cs.CV cs.AIcited by 17

On the map: LLM reasoning → Multimodal reasoning

Abstract (arXiv)

DeepSeek-R1 has demonstrated powerful reasoning capabilities in the text domain through stable reinforcement learning (RL). Recently, in the multimodal domain, works have begun to directly apply RL to generate R1-like free-form reasoning for Visual Question Answering (VQA) tasks. However, multimodal tasks share an intrinsically different nature from textual tasks, which heavily rely on the understanding of the input image to solve the problem. Therefore, such free-form reasoning faces two critical limitations in the VQA task: (1) Extended reasoning chains diffuse visual focus away from task-critical regions, degrading answer accuracy. (2) Unverifiable intermediate steps amplify policy-gradient variance and computational costs overhead. To address these issues, in this paper, we introduce SATORI (Spatially Anchored Task Optimization with ReInforcement Learning), which decomposes VQA into three verifiable stages, including global image captioning, region localization, and answer prediction, each supplying explicit reward signals. Furthermore, we also introduce VQA-Verify, a 12k dataset annotated with answer-aligned captions and bounding-boxes to facilitate training. Experiments demonstrate consistent performance improvements across seven VQA benchmarks, achieving up to 15.7% improvement in accuracy in accuracy compared to the R1-like baseline. Our analysis of the attention map confirms enhanced focus on critical regions, which brings improvements in accuracy. Our code is available at https://github.com/justairr/SATORI-R1.

Key facts. Cited by 17 papers in the map (data through 14 Oct 2026). Placed in Multimodal reasoning, one of 17 directions in LLM reasoning. Builds on 47 of its 85 references that are in the map. First posted on arXiv 25 May 2025.

Builds on

47 of 85 references.

Closest ancestors · 11

Same direction, newest first

  1. 2025SFT or RL? An Early Investigation into Training R1-Like Reasoning Large Vision-Language Models10 Apr
  2. 2025VL-Rethinker: Incentivizing Self-Reflection of Vision-Language Models with Reinforcement Learning10 Apr
  3. 2025OpenVLThinker: Complex Vision-Language Reasoning via Iterative SFT-RL Cycles21 Mar
  4. 2025Multimodal Chain-of-Thought Reasoning: A Comprehensive Survey16 Mar
  5. 2025R1-Onevision: Advancing Generalized Multimodal Reasoning through Cross-Modal Formalization13 Mar
  6. 2025MM-Eureka: Exploring the Frontiers of Multimodal Reasoning with Rule-based Reinforcement Learning10 Mar
  7. 2025Vision-R1: Incentivizing Reasoning Capability in Multimodal Large Language Models9 Mar
  8. 2025Visual-RFT: Visual Reinforcement Fine-Tuning3 Mar
  9. 2024Expanding Performance Boundaries of Open-Source Multimodal Models with Model, Data, and Test-Time Scaling6 Dec
  10. 2024LLaVA-CoT: Let Vision Language Models Reason Step-by-Step15 Nov
  11. 2023MathVista: Evaluating Mathematical Reasoning of Foundation Models in Visual Contexts3 Oct

Other references · 36

  1. 2020An Image is Worth 16x16 Words: Transformers for Image Recognition at Scalecited by 30,186
  2. 2017Proximal Policy Optimization Algorithmscited by 15,215
  3. 2024The Llama 3 Herd of Modelscited by 14,715
  4. 2024DeepSeekMath: Pushing the Limits of Mathematical Reasoning in Open Language Modelscited by 9,379
  5. 2025DeepSeek-R1: Incentivizing Reasoning Capability in LLMs via Reinforcement Learningcited by 6,330
  6. 2025Qwen2.5-VL Technical Reportcited by 5,587
  7. 2024GPT-4o System Cardcited by 4,588
  8. 2022Training a Helpful and Harmless Assistant with Reinforcement Learning from Human Feedbackcited by 3,720
  9. 2024Gemini 1.5: Unlocking multimodal understanding across millions of tokens of contextcited by 3,224
  10. 2025DAPO: An Open-Source LLM Reinforcement Learning System at Scalecited by 2,810
  11. 2023Qwen-VL: A Versatile Vision-Language Model for Understanding, Localization, Text Reading, and Beyondcited by 2,224
  12. 2023MMMU: A Massive Multi-discipline Multimodal Understanding and Reasoning Benchmark for Expert AGIcited by 2,080
24 more
  1. 2025InternVL3: Exploring Advanced Training and Test-Time Recipes for Open-Source Multimodal Modelscited by 1,834
  2. 2023MME: A Comprehensive Evaluation Benchmark for Multimodal Large Language Modelscited by 1,652
  3. 2023LLaVA-Med: Training a Large Language-and-Vision Assistant for Biomedicine in One Daycited by 1,305
  4. 2025Kimi k1.5: Scaling Reinforcement Learning with LLMscited by 1,210
  5. 2024Are We on the Right Way for Evaluating Large Vision-Language Models?cited by 914
  6. 2024VideoLLaMA 2: Advancing Spatial-Temporal Modeling and Audio Understanding in Video-LLMscited by 771
  7. 2023NExT-GPT: Any-to-Any Multimodal LLMcited by 615
  8. 2024ReST-MCTS*: LLM Self-Training via Process Reward Guided Tree Searchcited by 344
  9. 2023PMC-VQA: Visual Instruction Tuning for Medical Visual Question Answeringcited by 338
  10. 2025R1-VL: Learning to Reason with Multimodal Large Language Models via Step-wise Group Relative Policy Optimizationcited by 301
  11. 2023A Survey of Reinforcement Learning from Human Feedbackcited by 264
  12. 2024ReFT: Reasoning with Reinforced Fine-Tuningcited by 239
  13. 2016COCO-Text: Dataset and Benchmark for Text Detection and Recognition in Natural Imagescited by 236
  14. 2025MLLMs Know Where to Look: Training-free Perception of Small Visual Details with Multimodal LLMscited by 176
  15. 2024Mulberry: Empowering MLLM with o1-like Reasoning and Reflection via Collective Monte Carlo Tree Searchcited by 175
  16. 2024TextMonkey: An OCR-Free Large Multimodal Model for Understanding Documentcited by 174
  17. 2023Macaw-LLM: Multi-Modal Language Modeling with Image, Audio, Video, and Text Integrationcited by 172
  18. 2023mPLUG-DocOwl: Modularized Multimodal Large Language Model for Document Understandingcited by 168
  19. 2024Teaching Large Language Models to Reason with Reinforcement Learningcited by 160
  20. 2024InternLM-Math: Open Math Large Language Models Toward Verifiable Reasoningcited by 119
  21. 2024video-SALMONN: Speech-Enhanced Audio-Visual Large Language Modelscited by 102
  22. 2025GRPO-LEAD: A Difficulty-Aware Reinforcement Learning Approach for Concise Mathematical Reasoning in Language Modelscited by 82
  23. 2024Infinity-MM: Scaling Multimodal Performance with Large-Scale and High-Quality Instruction Datacited by 67
  24. 2025GEM: Empowering MLLM for Grounded ECG Understanding with Time Series and Imagescited by 39

Built on by

Cited by year (2026 to 14 Oct)

Citing papers per year: 2025: 10; 2026: 7.

17 papers.

Sort:

  1. 2025Thinking with Images for Multimodal Reasoning: Foundations, Methods, and Future Frontierscited by 199
  2. 2025Latent Visual Reasoningcited by 104
  3. 2025DiffThinker: Towards Generative Multimodal Reasoning with Diffusion Modelscited by 19
  4. 2025SpatialThinker: Reinforcing Scene Graph-Grounded Spatial Reasoning via Dense Rewardscited by 16
  5. 2026On Robustness and Chain-of-Thought Consistency of RL-Finetuned VLMscited by 11
  6. 2025Deep But Reliable: Advancing Multi-turn Reasoning for Thinking with Imagescited by 8
  7. 2025Asking like Socrates: Socrates helps VLMs understand remote sensing imagescited by 6
  8. 2025Reassessing the Role of Supervised Fine-Tuning: An Empirical Study in VLM Reasoningcited by 5
  9. 2026Walk the Talk: Bridging the Reasoning-Action Gap for Thinking with Images via Multimodal Agentic Policy Optimizationcited by 5
  10. 2025Locate-Then-Examine: Grounded Region Reasoning Improves Detection of AI-Generated Imagescited by 4
  11. 2025Intern-S1-MO: Long-horizon Reasoning Agent for Olympiad?Level Mathematical Problem Solvingcited by 4
  12. 2025Syn-GRPO: Self-Evolving Data Synthesis for MLLM Perception Reasoningcited by 1
5 more
  1. 2026PointVG-R: Internalizing Geometric Reasoning in MLLMs for Precise Pointing Localization via Visual Chain of Thoughtcited by 1
  2. 2026ROVER: Routing Object-Centric Visual Evidence for Grounded Multi-Image Reasoningcited by 0
  3. 2026SER: Learning to Ground Video Reasoning with Semantic Evidence Rewardscited by 0
  4. 2026Reasoning-Guided Part-Level Visual Grounding via Reinforcement Learningcited by 0
  5. 2026Stable-MM-R1: Anchoring Multimodal Reasoning Dynamics via Entropy-Guided Stratificationcited by 0

Similar, not cited

Close in wording, no citation either way

  1. 2026Faithful-MR1: Faithful Multimodal Reasoning via Anchoring and Reinforcing Visual Attention
  2. 2025WeThink: Toward General-purpose Vision-Language Reasoning via Reinforcement Learning
  3. 2025VTool-R1: VLMs Learn to Think with Images via Reinforcement Learning on Multimodal Tool Use
  4. 2026Wiki-R1: Incentivizing Multimodal Reasoning for Knowledge-based VQA via Data and Sampling Curriculum
  5. 2025Advancing Multimodal Reasoning: From Optimized Cold Start to Staged Reinforcement Learning
  6. 2025Visionary-R1: Mitigating Shortcuts in Visual Reasoning with Reinforcement Learning
  7. 2025Learning Only with Images: Visual Reinforcement Learning with Reasoning, Rendering, and Visual Feedback
  8. 2026Be Faithful When Response: Returning Fluent and Grounded Answers for Vision-Language Models Reinforcement Learning