EmbodiedVSR: Dynamic Scene Graph-Guided Chain-of-Thought Reasoning for Visual Spatial Tasks
On the map: LLM reasoning → Spatial and embodied reasoning
Abstract (arXiv)
While multimodal large language models (MLLMs) have made groundbreaking progress in embodied intelligence, they still face significant challenges in spatial reasoning for complex long-horizon tasks. To address this gap, we propose EmbodiedVSR (Embodied Visual Spatial Reasoning), a novel framework that integrates dynamic scene graph-guided Chain-of-Thought (CoT) reasoning to enhance spatial understanding for embodied agents. By explicitly constructing structured knowledge representations through dynamic scene graphs, our method enables zero-shot spatial reasoning without task-specific fine-tuning. This approach not only disentangles intricate spatial relationships but also aligns reasoning steps with actionable environmental dynamics. To rigorously evaluate performance, we introduce the eSpatial-Benchmark, a comprehensive dataset including real-world embodied scenarios with fine-grained spatial annotations and adaptive task difficulty levels. Experiments demonstrate that our framework significantly outperforms existing MLLM-based methods in accuracy and reasoning coherence, particularly in long-horizon tasks requiring iterative environment interaction. The results reveal the untapped potential of MLLMs for embodied intelligence when equipped with structured, explainable reasoning mechanisms, paving the way for more reliable deployment in real-world spatial applications. The codes and datasets will be released soon.
Key facts. Cited by 9 papers in the map (data through 7 Oct 2026). Placed in Spatial and embodied reasoning, one of 17 directions in LLM reasoning. Builds on 36 of its 40 references that are in the map. First posted on arXiv 14 Mar 2025.
Builds on
36 of 40 references.
Closest ancestors · 2
Same direction, newest first
- 2024SpatialVLM: Endowing Vision-Language Models with Spatial Reasoning Capabilities22 Jan
- 2022Inner Monologue: Embodied Reasoning through Planning with Language Models12 Jul
Other references · 34
- 2023Visual Instruction Tuningcited by 7,792
- 2023BLIP-2: Bootstrapping Language-Image Pre-training with Frozen Image Encoders and Large Language Modelscited by 6,069
- 2024Qwen2-VL: Enhancing Vision-Language Model's Perception of the World at Any Resolutioncited by 4,151
- 2023RT-2: Vision-Language-Action Models Transfer Web Knowledge to Robotic Controlcited by 2,993
- 2024OpenVLA: An Open-Source Vision-Language-Action Modelcited by 2,777
- 2023MMBench: Is Your Multi-modal Model an All-around Player?cited by 2,105
- 2022RT-1: Robotics Transformer for Real-World Control at Scalecited by 2,007
- 2024Expanding Performance Boundaries of Open-Source Multimodal Models with Model, Data, and Test-Time Scalingcited by 1,573
- 2016CLEVR: A Diagnostic Dataset for Compositional Language and Elementary Visual Reasoningcited by 1,445
- 2022Code as Policies: Language Model Programs for Embodied Controlcited by 1,172
- 2023SEED-Bench: Benchmarking Multimodal LLMs with Generative Comprehensioncited by 929
- 2024DROID: A Large-Scale In-The-Wild Robot Manipulation Datasetcited by 801
22 more
- 2023CogVLM: Visual Expert for Pretrained Language Modelscited by 704
- 2022Perceiver-Actor: A Multi-Task Transformer for Robotic Manipulationcited by 545
- 2023Language Is Not All You Need: Aligning Perception with Language Modelscited by 543
- 2022Socratic Models: Composing Zero-Shot Multimodal Reasoning with Languagecited by 513
- 2022LLM-Planner: Few-Shot Grounded Planning for Embodied Agents with Large Language Modelscited by 459
- 2022VIMA: General Robot Manipulation with Multimodal Promptscited by 403
- 2023Describe, Explain, Plan and Select: Interactive Planning with Large Language Models Enables Open-World Multi-Task Agentscited by 396
- 2023Vision-Language Foundation Models as Effective Robot Imitatorscited by 344
- 2022Pre-Trained Language Models for Interactive Decision-Makingcited by 220
- 2024RT-H: Action Hierarchies Using Languagecited by 204
- 2024Pixtral 12Bcited by 174
- 2024RoboMIND: Benchmark on Multi-embodiment Intelligence Normative Data for Robot Manipulationcited by 166
- 2023Look Before You Leap: Unveiling the Power of GPT-4V in Robotic Vision-Language Planningcited by 161
- 2024SpatialBot: Precise Spatial Understanding with Vision Language Modelscited by 146
- 2024BEHAVIOR-1K: A Human-Centered, Embodied AI Benchmark with 1,000 Everyday Activities and Realistic Simulationcited by 140
- 2024MOKA: Open-World Robotic Manipulation through Mark-Based Visual Promptingcited by 126
- 2023RoboCat: A Self-Improving Generalist Agent for Robotic Manipulationcited by 108
- 2024VL-RewardBench: A Challenging Benchmark for Vision-Language Generative Reward Modelscited by 85
- 2021Embodied BERT: A Transformer Model for Embodied, Language-guided Visual Task Completioncited by 57
- 2024QueST: Self-Supervised Skill Abstractions for Learning Continuous Controlcited by 51
- 2024Closed-Loop Open-Vocabulary Mobile Manipulation with GPT-4Vcited by 40
- 2024PerAct2: Benchmarking and Learning for Robotic Bimanual Manipulation Taskscited by 37
Built on by
Citing papers per year: 2025: 8; 2026: 1.
9 papers.
- 2025Can World Simulators Reason? Gen-ViRe: A Generative Visual Reasoning Benchmarkcited by 19
- 2025Think in Safety: Unveiling and Mitigating Safety Alignment Collapse in Multimodal Large Reasoning Modelcited by 18
- 2025Neural Brain: A Neuroscience-inspired Framework for Embodied Agentscited by 10
- 2025Enhancing Spatial Reasoning in Vision-Language Models via Chain-of-Thought Prompting and Reinforcement Learningcited by 9
- 2025Digital Twin Generation from Visual Data: A Surveycited by 7
- 2025Diagnosing Visual Reasoning: Challenges, Insights, and a Path Forwardcited by 6
- 2026SpaMEM: Benchmarking Dynamic Spatial Reasoning via Perception-Memory Integration in Embodied Environmentscited by 6
- 2025AutoLayout: Closed-Loop Layout Synthesis via Slow-Fast Collaborative Reasoningcited by 1
- 2025From Perception to Reasoning: Deep Thinking Empowers Multimodal Large Language Modelscited by 1
- 2026SpaMEM: Benchmarking Dynamic Spatial Reasoning via Perception-Memory Integration in Embodied Environments24 Apr 2026
- 2025Can World Simulators Reason? Gen-ViRe: A Generative Visual Reasoning Benchmark17 Nov 2025
- 2025From Perception to Reasoning: Deep Thinking Empowers Multimodal Large Language Models17 Nov 2025
- 2025Diagnosing Visual Reasoning: Challenges, Insights, and a Path Forward23 Oct 2025
- 2025Enhancing Spatial Reasoning in Vision-Language Models via Chain-of-Thought Prompting and Reinforcement Learning6 Jul 2025
- 2025AutoLayout: Closed-Loop Layout Synthesis via Slow-Fast Collaborative Reasoning6 Jul 2025
- 2025Neural Brain: A Neuroscience-inspired Framework for Embodied Agents12 May 2025
- 2025Think in Safety: Unveiling and Mitigating Safety Alignment Collapse in Multimodal Large Reasoning Model10 May 2025
- 2025Digital Twin Generation from Visual Data: A Survey17 Apr 2025
Similar, not cited
Close in wording, no citation either way
- 2025Bridging the Dynamic Perception Gap: Training-Free Draft Chain-of-Thought for Dynamic Multimodal Spatial Reasoning
- 2025REM: Evaluating LLM Embodied Spatial Reasoning through Multi-Frame Trajectories
- 2025Multimodal Spatial Reasoning in the Large Model Era: A Survey and Benchmarks
- 2025Spatial Reasoning in Multimodal Large Language Models: A Survey of Tasks, Benchmarks and Methods
- 2025SpatialThinker: Reinforcing Scene Graph-Grounded Spatial Reasoning via Dense Rewards
- 2025Embodied-R: Collaborative Framework for Activating Embodied Spatial Reasoning in Foundation Models via Reinforcement Learning
- 2026When More Is Less: A Systematic Analysis of Spatial and Commonsense Information for Visual Spatial Reasoning
- 2026ESPIRE: A Diagnostic Benchmark for Embodied Spatial Reasoning of Vision-Language Models