STAR-R1: Spatial TrAnsformation Reasoning by Reinforcing Multimodal LLMs
On the map: LLM reasoning → Spatial and embodied reasoning
Abstract (arXiv)
Multimodal Large Language Models (MLLMs) have demonstrated remarkable capabilities across diverse tasks, yet they lag significantly behind humans in spatial reasoning. We investigate this gap through Transformation-Driven Visual Reasoning (TVR), a challenging task requiring identification of object transformations across images under varying viewpoints. While traditional Supervised Fine-Tuning (SFT) fails to generate coherent reasoning paths in cross-view settings, sparse-reward Reinforcement Learning (RL) suffers from inefficient exploration and slow convergence. To address these limitations, we propose STAR-R1, a novel framework that integrates a single-stage RL paradigm with a fine-grained reward mechanism tailored for TVR. Specifically, STAR-R1 rewards partial correctness while penalizing excessive enumeration and passive inaction, enabling efficient exploration and precise reasoning. Comprehensive evaluations demonstrate that STAR-R1 achieves state-of-the-art performance across all 11 metrics, outperforming SFT by 23% in cross-view scenarios. Further analysis reveals STAR-R1's anthropomorphic behavior and highlights its unique ability to compare all objects for improving spatial reasoning. Our work provides critical insights in advancing the research of MLLMs and reasoning models. The codes, model weights, and data will be publicly available at https://github.com/zongzhao23/STAR-R1.
Key facts. Cited by 21 papers in the map (data through 14 Oct 2026). Placed in Spatial and embodied reasoning, one of 17 directions in LLM reasoning. Builds on 47 of its 71 references that are in the map. First posted on arXiv 21 May 2025.
Builds on
47 of 71 references.
Closest ancestors · 2
Same direction, newest first
- 2025LEGO-Puzzles: How Good Are MLLMs at Multi-Step Spatial Reasoning?25 Mar
- 2025iVISPAR -- An Interactive Visual-Spatial Reasoning Benchmark for VLMs5 Feb
Other references · 45
- 2024The Llama 3 Herd of Modelscited by 14,715
- 2023LLaMA: Open and Efficient Foundation Language Modelscited by 14,132
- 2023Llama 2: Open Foundation and Fine-Tuned Chat Modelscited by 13,028
- 2021Training Verifiers to Solve Math Word Problemscited by 10,109
- 2024DeepSeekMath: Pushing the Limits of Mathematical Reasoning in Open Language Modelscited by 9,379
- 2020Measuring Massive Multitask Language Understandingcited by 7,963
- 2025DeepSeek-R1: Incentivizing Reasoning Capability in LLMs via Reinforcement Learningcited by 6,330
- 2025Qwen2.5-VL Technical Reportcited by 5,587
- 2021Measuring Mathematical Problem Solving With the MATH Datasetcited by 5,371
- 2024Qwen2.5 Technical Reportcited by 4,942
- 2024GPT-4o System Cardcited by 4,588
- 2024Qwen2-VL: Enhancing Vision-Language Model's Perception of the World at Any Resolutioncited by 4,234
33 more
- 2023Qwen Technical Reportcited by 3,344
- 2024Gemini 1.5: Unlocking multimodal understanding across millions of tokens of contextcited by 3,224
- 2024LLaVA-OneVision: Easy Visual Task Transfercited by 2,719
- 2023Qwen-VL: A Versatile Vision-Language Model for Understanding, Localization, Text Reading, and Beyondcited by 2,224
- 2024Phi-3 Technical Report: A Highly Capable Language Model Locally on Your Phonecited by 1,917
- 2025InternVL3: Exploring Advanced Training and Test-Time Recipes for Open-Source Multimodal Modelscited by 1,834
- 2024Expanding Performance Boundaries of Open-Source Multimodal Models with Model, Data, and Test-Time Scalingcited by 1,599
- 2024Video-MME: The First-Ever Comprehensive Evaluation Benchmark of Multi-modal LLMs in Video Analysiscited by 1,413
- 2023MM-Vet: Evaluating Large Multimodal Models for Integrated Capabilitiescited by 1,239
- 2024MiniCPM-V: A GPT-4V Level MLLM on Your Phonecited by 1,079
- 2024Are We on the Right Way for Evaluating Large Vision-Language Models?cited by 914
- 2025Janus-Pro: Unified Multimodal Understanding and Generation with Data and Model Scalingcited by 812
- 2023EVA-CLIP: Improved Training Techniques for CLIP at Scalecited by 798
- 2024Emu3: Next-Token Prediction is All You Needcited by 781
- 2024DeepSeek-VL: Towards Real-World Vision-Language Understandingcited by 733
- 2023AGIEval: A Human-Centric Benchmark for Evaluating Foundation Modelscited by 716
- 2024LLaVA-NeXT-Interleave: Tackling Multi-image, Video, and 3D in Large Multimodal Modelscited by 584
- 2025VLM-R1: A Stable and Generalizable R1-style Large Vision-Language Modelcited by 526
- 2025Video-R1: Reinforcing Video Reasoning in MLLMscited by 484
- 2024ELLA: Equip Diffusion Models with LLM for Enhanced Semantic Alignmentcited by 475
- 2024LLaVA-CoT: Let Vision Language Models Reason Step-by-Stepcited by 454
- 2024LVBench: An Extreme Long Video Understanding Benchmarkcited by 410
- 2025MM-Eureka: Exploring the Frontiers of Multimodal Reasoning with Rule-based Reinforcement Learningcited by 303
- 2024MLVU: Benchmarking Multi-task Long Video Understandingcited by 292
- 2024mPLUG-Owl3: Towards Long Image-Sequence Understanding in Multi-Modal Large Language Modelscited by 291
- 2025Logic-RL: Unleashing LLM Reasoning with Rule-Based Reinforcement Learningcited by 262
- 2025LMM-R1: Empowering 3B LMMs with Strong Reasoning Abilities Through Two-Stage Rule-Based RLcited by 248
- 2024Pixtral 12Bcited by 179
- 2025Towards Thinking-Optimal Scaling of Test-Time Compute for LLM Reasoningcited by 119
- 2023CMATH: Can Your Language Model Pass Chinese Elementary School Math Test?cited by 90
- 2024MME-Survey: A Comprehensive Survey on Evaluation of Multimodal LLMscited by 72
- 2025RedStar: Does Scaling Long-CoT Data Unlock Better Slow-Reasoning Systems?cited by 60
- 2025DeepCritic: Deliberate Critique with Large Language Modelscited by 17
Built on by
Citing papers per year: 2025: 9; 2026: 12.
21 papers.
Sort:
By area:
- 2025The Landscape of Agentic Reinforcement Learning for LLMs: A Surveycited by 205
- 2025Think Silently, Think Fast: Dynamic Latent Compression of LLM Reasoning Chainscited by 85
- 2025OneThinker: All-in-one Reasoning Model for Image and Videocited by 56
- 2025Look-Back: Implicit Visual Re-focusing in MLLM Reasoningcited by 55
- 2025UniPixel: Unified Object Referring and Segmentation for Pixel-Level Visual Reasoningcited by 28
- 2026On Robustness and Chain-of-Thought Consistency of RL-Finetuned VLMscited by 11
- 2025SaFeR-VLM: Toward Safety-aware Fine-grained Reasoning in Multimodal Modelscited by 10
- 2025Reinforcement Learning for Large Model: A Surveycited by 9
- 2025LaSeR: Reinforcement Learning with Last-Token Self-Rewardingcited by 9
- 2026CamReasoner: Reinforcing Camera Movement Understanding via Structured Spatial Reasoningcited by 9
- 2025VIDEOP2R: Video Understanding from Perception to Reasoningcited by 8
- 2026What does RL improve for Visual Reasoning? A Frankenstein-Style Analysiscited by 4
9 more
- 2026Graph-to-Frame RAG: Visual-Space Knowledge Fusion for Training-Free and Auditable Video Reasoningcited by 2
- 2026Reinforce to Learn, Elect to Reason: A Dual Paradigm for Video Reasoningcited by 2
- 2026OpenVLThinkerV2: A Generalist Multimodal Reasoning Model for Multi-domain Visual Taskscited by 2
- 2026Learning to Focus and Precise Cropping: A Reinforcement Learning Framework with Information Gaps and Grounding Loss for MLLMscited by 1
- 2026Reasoning Beyond Literal: Cross-style Multimodal Reasoning for Figurative Language Understandingcited by 0
- 2026SaFeR-ToolKit: Structured Reasoning via Virtual Tool Calling for Multimodal Safetycited by 0
- 2026Beyond Semantic Search: Towards Referential Anchoring in Composed Image Retrievalcited by 0
- 2026From Structure to Synergy: A Survey of Vision-Language Perception Paradigm Evolution in Multimodal Large Language Modelscited by 0
- 2026CoRe: A Comprehensive Framework for Cross-Image Comparative Reasoning in Vision-Language Modelscited by 0
- 2026CoRe: A Comprehensive Framework for Cross-Image Comparative Reasoning in Vision-Language Models14 Jul 2026
- 2026From Structure to Synergy: A Survey of Vision-Language Perception Paradigm Evolution in Multimodal Large Language Models24 Jun 2026
- 2026OpenVLThinkerV2: A Generalist Multimodal Reasoning Model for Multi-domain Visual Tasks9 Apr 2026
- 2026Beyond Semantic Search: Towards Referential Anchoring in Composed Image Retrieval7 Apr 2026
- 2026Reinforce to Learn, Elect to Reason: A Dual Paradigm for Video Reasoning6 Apr 2026
- 2026Graph-to-Frame RAG: Visual-Space Knowledge Fusion for Training-Free and Auditable Video Reasoning6 Apr 2026
- 2026Learning to Focus and Precise Cropping: A Reinforcement Learning Framework with Information Gaps and Grounding Loss for MLLMs29 Mar 2026
- 2026SaFeR-ToolKit: Structured Reasoning via Virtual Tool Calling for Multimodal Safety3 Mar 2026
- 2026On Robustness and Chain-of-Thought Consistency of RL-Finetuned VLMs13 Feb 2026
- 2026What does RL improve for Visual Reasoning? A Frankenstein-Style Analysis12 Feb 2026
- 2026CamReasoner: Reinforcing Camera Movement Understanding via Structured Spatial Reasoning30 Jan 2026
- 2026Reasoning Beyond Literal: Cross-style Multimodal Reasoning for Figurative Language Understanding23 Jan 2026
9 more
- 2025OneThinker: All-in-one Reasoning Model for Image and Video2 Dec 2025
- 2025VIDEOP2R: Video Understanding from Perception to Reasoning14 Nov 2025
- 2025LaSeR: Reinforcement Learning with Last-Token Self-Rewarding16 Oct 2025
- 2025SaFeR-VLM: Toward Safety-aware Fine-grained Reasoning in Multimodal Models8 Oct 2025
- 2025UniPixel: Unified Object Referring and Segmentation for Pixel-Level Visual Reasoning22 Sep 2025
- 2025The Landscape of Agentic Reinforcement Learning for LLMs: A Survey2 Sep 2025
- 2025Reinforcement Learning for Large Model: A Survey11 Aug 2025
- 2025Look-Back: Implicit Visual Re-focusing in MLLM Reasoning2 Jul 2025
- 2025Think Silently, Think Fast: Dynamic Latent Compression of LLM Reasoning Chains22 May 2025
- 2025Think Silently, Think Fast: Dynamic Latent Compression of LLM Reasoning Chainscited by 85
- 2025OneThinker: All-in-one Reasoning Model for Image and Videocited by 56
- 2025Look-Back: Implicit Visual Re-focusing in MLLM Reasoningcited by 55
- 2025UniPixel: Unified Object Referring and Segmentation for Pixel-Level Visual Reasoningcited by 28
- 2026On Robustness and Chain-of-Thought Consistency of RL-Finetuned VLMscited by 11
- 2025SaFeR-VLM: Toward Safety-aware Fine-grained Reasoning in Multimodal Modelscited by 10
- 2025LaSeR: Reinforcement Learning with Last-Token Self-Rewardingcited by 9
- 2026CamReasoner: Reinforcing Camera Movement Understanding via Structured Spatial Reasoningcited by 9
- 2025VIDEOP2R: Video Understanding from Perception to Reasoningcited by 8
- 2026What does RL improve for Visual Reasoning? A Frankenstein-Style Analysiscited by 4
- 2026OpenVLThinkerV2: A Generalist Multimodal Reasoning Model for Multi-domain Visual Taskscited by 2
- 2026Learning to Focus and Precise Cropping: A Reinforcement Learning Framework with Information Gaps and Grounding Loss for MLLMscited by 1
12 most cited of 15 All 15 (JSON)
- 2026CoRe: A Comprehensive Framework for Cross-Image Comparative Reasoning in Vision-Language Models14 Jul 2026
- 2026OpenVLThinkerV2: A Generalist Multimodal Reasoning Model for Multi-domain Visual Tasks9 Apr 2026
- 2026Learning to Focus and Precise Cropping: A Reinforcement Learning Framework with Information Gaps and Grounding Loss for MLLMs29 Mar 2026
- 2026SaFeR-ToolKit: Structured Reasoning via Virtual Tool Calling for Multimodal Safety3 Mar 2026
- 2026On Robustness and Chain-of-Thought Consistency of RL-Finetuned VLMs13 Feb 2026
- 2026What does RL improve for Visual Reasoning? A Frankenstein-Style Analysis12 Feb 2026
- 2026CamReasoner: Reinforcing Camera Movement Understanding via Structured Spatial Reasoning30 Jan 2026
- 2026Reasoning Beyond Literal: Cross-style Multimodal Reasoning for Figurative Language Understanding23 Jan 2026
- 2025OneThinker: All-in-one Reasoning Model for Image and Video2 Dec 2025
- 2025VIDEOP2R: Video Understanding from Perception to Reasoning14 Nov 2025
- 2025LaSeR: Reinforcement Learning with Last-Token Self-Rewarding16 Oct 2025
- 2025SaFeR-VLM: Toward Safety-aware Fine-grained Reasoning in Multimodal Models8 Oct 2025
12 newest of 15 All 15 (JSON)
- 2026Graph-to-Frame RAG: Visual-Space Knowledge Fusion for Training-Free and Auditable Video Reasoningcited by 2
- 2026Reinforce to Learn, Elect to Reason: A Dual Paradigm for Video Reasoningcited by 2
- 2026From Structure to Synergy: A Survey of Vision-Language Perception Paradigm Evolution in Multimodal Large Language Modelscited by 0
- 2026From Structure to Synergy: A Survey of Vision-Language Perception Paradigm Evolution in Multimodal Large Language Models24 Jun 2026
- 2026Reinforce to Learn, Elect to Reason: A Dual Paradigm for Video Reasoning6 Apr 2026
- 2026Graph-to-Frame RAG: Visual-Space Knowledge Fusion for Training-Free and Auditable Video Reasoning6 Apr 2026
- 2025Reinforcement Learning for Large Model: A Surveycited by 9
- 2025Reinforcement Learning for Large Model: A Survey11 Aug 2025
Similar, not cited
Close in wording, no citation either way
- 2025SpatialThinker: Reinforcing Scene Graph-Grounded Spatial Reasoning via Dense Rewards
- 2026Faithful GRPO: Improving Visual Spatial Reasoning in Multimodal Language Models via Constrained Policy Optimization
- 2025SVQA-R1: Reinforcing Spatial Reasoning in MLLMs via View-Consistent Reward Optimization
- 2025SpaceR: Reinforcing MLLMs in Video Spatial Reasoning
- 2026From Correspondence to Actions: Human-Like Multi-Image Spatial Reasoning in Multi-modal Large Language Models
- 2025Embodied-R: Collaborative Framework for Activating Embodied Spatial Reasoning in Foundation Models via Reinforcement Learning
- 2026Unfold The World: Factorize 4D Properties in Reinforcing Spatial Reasoning
- 2025RewardMap: Tackling Sparse Rewards in Fine-grained Visual Reasoning via Multi-Stage Reinforcement Learning