mlsanityData to 7 Oct 2026

EmbodiedVSR: Dynamic Scene Graph-Guided Chain-of-Thought Reasoning for Visual Spatial Tasks

arXiv 2503.11089 ↗First posted 14 Mar 2025cs.RO cs.AI cs.CVcited by 9

On the map: LLM reasoning → Spatial and embodied reasoning

also in 1 more
Abstract (arXiv)

While multimodal large language models (MLLMs) have made groundbreaking progress in embodied intelligence, they still face significant challenges in spatial reasoning for complex long-horizon tasks. To address this gap, we propose EmbodiedVSR (Embodied Visual Spatial Reasoning), a novel framework that integrates dynamic scene graph-guided Chain-of-Thought (CoT) reasoning to enhance spatial understanding for embodied agents. By explicitly constructing structured knowledge representations through dynamic scene graphs, our method enables zero-shot spatial reasoning without task-specific fine-tuning. This approach not only disentangles intricate spatial relationships but also aligns reasoning steps with actionable environmental dynamics. To rigorously evaluate performance, we introduce the eSpatial-Benchmark, a comprehensive dataset including real-world embodied scenarios with fine-grained spatial annotations and adaptive task difficulty levels. Experiments demonstrate that our framework significantly outperforms existing MLLM-based methods in accuracy and reasoning coherence, particularly in long-horizon tasks requiring iterative environment interaction. The results reveal the untapped potential of MLLMs for embodied intelligence when equipped with structured, explainable reasoning mechanisms, paving the way for more reliable deployment in real-world spatial applications. The codes and datasets will be released soon.

Key facts. Cited by 9 papers in the map (data through 7 Oct 2026). Placed in Spatial and embodied reasoning, one of 17 directions in LLM reasoning. Builds on 36 of its 40 references that are in the map. First posted on arXiv 14 Mar 2025.

Builds on

36 of 40 references.

Closest ancestors · 2

Same direction, newest first

  1. 2024SpatialVLM: Endowing Vision-Language Models with Spatial Reasoning Capabilities22 Jan
  2. 2022Inner Monologue: Embodied Reasoning through Planning with Language Models12 Jul

Other references · 34

  1. 2023Visual Instruction Tuningcited by 7,792
  2. 2023BLIP-2: Bootstrapping Language-Image Pre-training with Frozen Image Encoders and Large Language Modelscited by 6,069
  3. 2024Qwen2-VL: Enhancing Vision-Language Model's Perception of the World at Any Resolutioncited by 4,151
  4. 2023RT-2: Vision-Language-Action Models Transfer Web Knowledge to Robotic Controlcited by 2,993
  5. 2024OpenVLA: An Open-Source Vision-Language-Action Modelcited by 2,777
  6. 2023MMBench: Is Your Multi-modal Model an All-around Player?cited by 2,105
  7. 2022RT-1: Robotics Transformer for Real-World Control at Scalecited by 2,007
  8. 2024Expanding Performance Boundaries of Open-Source Multimodal Models with Model, Data, and Test-Time Scalingcited by 1,573
  9. 2016CLEVR: A Diagnostic Dataset for Compositional Language and Elementary Visual Reasoningcited by 1,445
  10. 2022Code as Policies: Language Model Programs for Embodied Controlcited by 1,172
  11. 2023SEED-Bench: Benchmarking Multimodal LLMs with Generative Comprehensioncited by 929
  12. 2024DROID: A Large-Scale In-The-Wild Robot Manipulation Datasetcited by 801
22 more
  1. 2023CogVLM: Visual Expert for Pretrained Language Modelscited by 704
  2. 2022Perceiver-Actor: A Multi-Task Transformer for Robotic Manipulationcited by 545
  3. 2023Language Is Not All You Need: Aligning Perception with Language Modelscited by 543
  4. 2022Socratic Models: Composing Zero-Shot Multimodal Reasoning with Languagecited by 513
  5. 2022LLM-Planner: Few-Shot Grounded Planning for Embodied Agents with Large Language Modelscited by 459
  6. 2022VIMA: General Robot Manipulation with Multimodal Promptscited by 403
  7. 2023Describe, Explain, Plan and Select: Interactive Planning with Large Language Models Enables Open-World Multi-Task Agentscited by 396
  8. 2023Vision-Language Foundation Models as Effective Robot Imitatorscited by 344
  9. 2022Pre-Trained Language Models for Interactive Decision-Makingcited by 220
  10. 2024RT-H: Action Hierarchies Using Languagecited by 204
  11. 2024Pixtral 12Bcited by 174
  12. 2024RoboMIND: Benchmark on Multi-embodiment Intelligence Normative Data for Robot Manipulationcited by 166
  13. 2023Look Before You Leap: Unveiling the Power of GPT-4V in Robotic Vision-Language Planningcited by 161
  14. 2024SpatialBot: Precise Spatial Understanding with Vision Language Modelscited by 146
  15. 2024BEHAVIOR-1K: A Human-Centered, Embodied AI Benchmark with 1,000 Everyday Activities and Realistic Simulationcited by 140
  16. 2024MOKA: Open-World Robotic Manipulation through Mark-Based Visual Promptingcited by 126
  17. 2023RoboCat: A Self-Improving Generalist Agent for Robotic Manipulationcited by 108
  18. 2024VL-RewardBench: A Challenging Benchmark for Vision-Language Generative Reward Modelscited by 85
  19. 2021Embodied BERT: A Transformer Model for Embodied, Language-guided Visual Task Completioncited by 57
  20. 2024QueST: Self-Supervised Skill Abstractions for Learning Continuous Controlcited by 51
  21. 2024Closed-Loop Open-Vocabulary Mobile Manipulation with GPT-4Vcited by 40
  22. 2024PerAct2: Benchmarking and Learning for Robotic Bimanual Manipulation Taskscited by 37

Built on by

Cited by year (2026 to 7 Oct)

Citing papers per year: 2025: 8; 2026: 1.

9 papers.

Similar, not cited

Close in wording, no citation either way

  1. 2025Bridging the Dynamic Perception Gap: Training-Free Draft Chain-of-Thought for Dynamic Multimodal Spatial Reasoning
  2. 2025REM: Evaluating LLM Embodied Spatial Reasoning through Multi-Frame Trajectories
  3. 2025Multimodal Spatial Reasoning in the Large Model Era: A Survey and Benchmarks
  4. 2025Spatial Reasoning in Multimodal Large Language Models: A Survey of Tasks, Benchmarks and Methods
  5. 2025SpatialThinker: Reinforcing Scene Graph-Grounded Spatial Reasoning via Dense Rewards
  6. 2025Embodied-R: Collaborative Framework for Activating Embodied Spatial Reasoning in Foundation Models via Reinforcement Learning
  7. 2026When More Is Less: A Systematic Analysis of Spatial and Commonsense Information for Visual Spatial Reasoning
  8. 2026ESPIRE: A Diagnostic Benchmark for Embodied Spatial Reasoning of Vision-Language Models