mlsanityData to 14 Oct 2026

STAR-R1: Spatial TrAnsformation Reasoning by Reinforcing Multimodal LLMs

arXiv 2505.15804 ↗First posted 21 May 2025cs.CVcited by 21

On the map: LLM reasoning → Spatial and embodied reasoning

also in 1 more
Abstract (arXiv)

Multimodal Large Language Models (MLLMs) have demonstrated remarkable capabilities across diverse tasks, yet they lag significantly behind humans in spatial reasoning. We investigate this gap through Transformation-Driven Visual Reasoning (TVR), a challenging task requiring identification of object transformations across images under varying viewpoints. While traditional Supervised Fine-Tuning (SFT) fails to generate coherent reasoning paths in cross-view settings, sparse-reward Reinforcement Learning (RL) suffers from inefficient exploration and slow convergence. To address these limitations, we propose STAR-R1, a novel framework that integrates a single-stage RL paradigm with a fine-grained reward mechanism tailored for TVR. Specifically, STAR-R1 rewards partial correctness while penalizing excessive enumeration and passive inaction, enabling efficient exploration and precise reasoning. Comprehensive evaluations demonstrate that STAR-R1 achieves state-of-the-art performance across all 11 metrics, outperforming SFT by 23% in cross-view scenarios. Further analysis reveals STAR-R1's anthropomorphic behavior and highlights its unique ability to compare all objects for improving spatial reasoning. Our work provides critical insights in advancing the research of MLLMs and reasoning models. The codes, model weights, and data will be publicly available at https://github.com/zongzhao23/STAR-R1.

Key facts. Cited by 21 papers in the map (data through 14 Oct 2026). Placed in Spatial and embodied reasoning, one of 17 directions in LLM reasoning. Builds on 47 of its 71 references that are in the map. First posted on arXiv 21 May 2025.

Builds on

47 of 71 references.

Closest ancestors · 2

Same direction, newest first

  1. 2025LEGO-Puzzles: How Good Are MLLMs at Multi-Step Spatial Reasoning?25 Mar
  2. 2025iVISPAR -- An Interactive Visual-Spatial Reasoning Benchmark for VLMs5 Feb

Other references · 45

  1. 2024The Llama 3 Herd of Modelscited by 14,715
  2. 2023LLaMA: Open and Efficient Foundation Language Modelscited by 14,132
  3. 2023Llama 2: Open Foundation and Fine-Tuned Chat Modelscited by 13,028
  4. 2021Training Verifiers to Solve Math Word Problemscited by 10,109
  5. 2024DeepSeekMath: Pushing the Limits of Mathematical Reasoning in Open Language Modelscited by 9,379
  6. 2020Measuring Massive Multitask Language Understandingcited by 7,963
  7. 2025DeepSeek-R1: Incentivizing Reasoning Capability in LLMs via Reinforcement Learningcited by 6,330
  8. 2025Qwen2.5-VL Technical Reportcited by 5,587
  9. 2021Measuring Mathematical Problem Solving With the MATH Datasetcited by 5,371
  10. 2024Qwen2.5 Technical Reportcited by 4,942
  11. 2024GPT-4o System Cardcited by 4,588
  12. 2024Qwen2-VL: Enhancing Vision-Language Model's Perception of the World at Any Resolutioncited by 4,234
33 more
  1. 2023Qwen Technical Reportcited by 3,344
  2. 2024Gemini 1.5: Unlocking multimodal understanding across millions of tokens of contextcited by 3,224
  3. 2024LLaVA-OneVision: Easy Visual Task Transfercited by 2,719
  4. 2023Qwen-VL: A Versatile Vision-Language Model for Understanding, Localization, Text Reading, and Beyondcited by 2,224
  5. 2024Phi-3 Technical Report: A Highly Capable Language Model Locally on Your Phonecited by 1,917
  6. 2025InternVL3: Exploring Advanced Training and Test-Time Recipes for Open-Source Multimodal Modelscited by 1,834
  7. 2024Expanding Performance Boundaries of Open-Source Multimodal Models with Model, Data, and Test-Time Scalingcited by 1,599
  8. 2024Video-MME: The First-Ever Comprehensive Evaluation Benchmark of Multi-modal LLMs in Video Analysiscited by 1,413
  9. 2023MM-Vet: Evaluating Large Multimodal Models for Integrated Capabilitiescited by 1,239
  10. 2024MiniCPM-V: A GPT-4V Level MLLM on Your Phonecited by 1,079
  11. 2024Are We on the Right Way for Evaluating Large Vision-Language Models?cited by 914
  12. 2025Janus-Pro: Unified Multimodal Understanding and Generation with Data and Model Scalingcited by 812
  13. 2023EVA-CLIP: Improved Training Techniques for CLIP at Scalecited by 798
  14. 2024Emu3: Next-Token Prediction is All You Needcited by 781
  15. 2024DeepSeek-VL: Towards Real-World Vision-Language Understandingcited by 733
  16. 2023AGIEval: A Human-Centric Benchmark for Evaluating Foundation Modelscited by 716
  17. 2024LLaVA-NeXT-Interleave: Tackling Multi-image, Video, and 3D in Large Multimodal Modelscited by 584
  18. 2025VLM-R1: A Stable and Generalizable R1-style Large Vision-Language Modelcited by 526
  19. 2025Video-R1: Reinforcing Video Reasoning in MLLMscited by 484
  20. 2024ELLA: Equip Diffusion Models with LLM for Enhanced Semantic Alignmentcited by 475
  21. 2024LLaVA-CoT: Let Vision Language Models Reason Step-by-Stepcited by 454
  22. 2024LVBench: An Extreme Long Video Understanding Benchmarkcited by 410
  23. 2025MM-Eureka: Exploring the Frontiers of Multimodal Reasoning with Rule-based Reinforcement Learningcited by 303
  24. 2024MLVU: Benchmarking Multi-task Long Video Understandingcited by 292
  25. 2024mPLUG-Owl3: Towards Long Image-Sequence Understanding in Multi-Modal Large Language Modelscited by 291
  26. 2025Logic-RL: Unleashing LLM Reasoning with Rule-Based Reinforcement Learningcited by 262
  27. 2025LMM-R1: Empowering 3B LMMs with Strong Reasoning Abilities Through Two-Stage Rule-Based RLcited by 248
  28. 2024Pixtral 12Bcited by 179
  29. 2025Towards Thinking-Optimal Scaling of Test-Time Compute for LLM Reasoningcited by 119
  30. 2023CMATH: Can Your Language Model Pass Chinese Elementary School Math Test?cited by 90
  31. 2024MME-Survey: A Comprehensive Survey on Evaluation of Multimodal LLMscited by 72
  32. 2025RedStar: Does Scaling Long-CoT Data Unlock Better Slow-Reasoning Systems?cited by 60
  33. 2025DeepCritic: Deliberate Critique with Large Language Modelscited by 17

Built on by

Cited by year (2026 to 14 Oct)

Citing papers per year: 2025: 9; 2026: 12.

21 papers.

Sort:

By area:

  1. 2025The Landscape of Agentic Reinforcement Learning for LLMs: A Surveycited by 205
  2. 2025Think Silently, Think Fast: Dynamic Latent Compression of LLM Reasoning Chainscited by 85
  3. 2025OneThinker: All-in-one Reasoning Model for Image and Videocited by 56
  4. 2025Look-Back: Implicit Visual Re-focusing in MLLM Reasoningcited by 55
  5. 2025UniPixel: Unified Object Referring and Segmentation for Pixel-Level Visual Reasoningcited by 28
  6. 2026On Robustness and Chain-of-Thought Consistency of RL-Finetuned VLMscited by 11
  7. 2025SaFeR-VLM: Toward Safety-aware Fine-grained Reasoning in Multimodal Modelscited by 10
  8. 2025Reinforcement Learning for Large Model: A Surveycited by 9
  9. 2025LaSeR: Reinforcement Learning with Last-Token Self-Rewardingcited by 9
  10. 2026CamReasoner: Reinforcing Camera Movement Understanding via Structured Spatial Reasoningcited by 9
  11. 2025VIDEOP2R: Video Understanding from Perception to Reasoningcited by 8
  12. 2026What does RL improve for Visual Reasoning? A Frankenstein-Style Analysiscited by 4
9 more
  1. 2026Graph-to-Frame RAG: Visual-Space Knowledge Fusion for Training-Free and Auditable Video Reasoningcited by 2
  2. 2026Reinforce to Learn, Elect to Reason: A Dual Paradigm for Video Reasoningcited by 2
  3. 2026OpenVLThinkerV2: A Generalist Multimodal Reasoning Model for Multi-domain Visual Taskscited by 2
  4. 2026Learning to Focus and Precise Cropping: A Reinforcement Learning Framework with Information Gaps and Grounding Loss for MLLMscited by 1
  5. 2026Reasoning Beyond Literal: Cross-style Multimodal Reasoning for Figurative Language Understandingcited by 0
  6. 2026SaFeR-ToolKit: Structured Reasoning via Virtual Tool Calling for Multimodal Safetycited by 0
  7. 2026Beyond Semantic Search: Towards Referential Anchoring in Composed Image Retrievalcited by 0
  8. 2026From Structure to Synergy: A Survey of Vision-Language Perception Paradigm Evolution in Multimodal Large Language Modelscited by 0
  9. 2026CoRe: A Comprehensive Framework for Cross-Image Comparative Reasoning in Vision-Language Modelscited by 0

Similar, not cited

Close in wording, no citation either way

  1. 2025SpatialThinker: Reinforcing Scene Graph-Grounded Spatial Reasoning via Dense Rewards
  2. 2026Faithful GRPO: Improving Visual Spatial Reasoning in Multimodal Language Models via Constrained Policy Optimization
  3. 2025SVQA-R1: Reinforcing Spatial Reasoning in MLLMs via View-Consistent Reward Optimization
  4. 2025SpaceR: Reinforcing MLLMs in Video Spatial Reasoning
  5. 2026From Correspondence to Actions: Human-Like Multi-Image Spatial Reasoning in Multi-modal Large Language Models
  6. 2025Embodied-R: Collaborative Framework for Activating Embodied Spatial Reasoning in Foundation Models via Reinforcement Learning
  7. 2026Unfold The World: Factorize 4D Properties in Reinforcing Spatial Reasoning
  8. 2025RewardMap: Tackling Sparse Rewards in Fine-grained Visual Reasoning via Multi-Stage Reinforcement Learning