mlsanityData to 14 Oct 2026

SpaceEra++: A Unified Framework Towards 3D Spatial Reasoning in Video

arXiv 2607.01784 ↗First posted 2 Jul 2026cs.CVcited by 1

On the map: LLM reasoning → Spatial and embodied reasoning

Abstract (arXiv)

Visual-spatial understanding, defined as the ability to infer object relationships and scene layouts from visual inputs, is fundamental to downstream tasks such as robotic navigation and embodied interaction. However, pre-trained vision-language models (VLMs) remain constrained by spatial uncertainty stemming from inherently 2D observations and by the scarcity of data for 3D spatial understanding. To address these limitations, we proposed a novel framework, SpaceEra, in the NeurIPS 2025 Spotlight paper. Although it achieved significant performance gains, we further observed that its effectiveness is hindered by insufficient input from scanning videos and weak reasoning constraints. To tackle these newly emerged challenges, we extend the original framework into a comprehensive system, termed SpaceEra++, which spans data construction, model design, training optimization, and prompting inference. Specifically, to alleviate input insufficiency, we introduce ScenePick, a frame sampling strategy that balances spatial coverage with object semantics to produce compact yet comprehensive scene representations. In addition, to enhance spatial reasoning, we develop SpaceAlign, which enforces pairwise object constraints by jointly exploiting absolute coordinates and relative spatial relations, thereby aligning optimization with spatial accuracy. Extensive experiments across multiple benchmarks demonstrate consistent improvements over strong baselines, while ablation studies validate both the individual and joint contributions of each component, and further analyses provide guidance for future research.

Key facts. Cited by 1 paper in the map (data through 14 Oct 2026). Placed in Spatial and embodied reasoning, one of 17 directions in LLM reasoning. Builds on 53 of its 62 references that are in the map. First posted on arXiv 2 Jul 2026.

Builds on

53 of 62 references.

Closest ancestors · 11

Same direction, newest first

  1. 2025SpaceVista: All-Scale Visual Spatial Reasoning from mm to km10 Oct
  2. 2025SpaceR: Reinforcing MLLMs in Video Spatial Reasoning2 Apr
  3. 2025Improved Visual-Spatial Reasoning via R1-Zero-Like Training1 Apr
  4. 2025SpatialCoT: Advancing Spatial Reasoning through Coordinate Alignment and Chain-of-Thought for Embodied Task Planning17 Jan
  5. 2024Thinking in Space: How Multimodal Large Language Models See, Remember, and Recall Spaces18 Dec
  6. 2024Multi-modal Situated Reasoning in 3D Scenes4 Sep
  7. 2024SpatialRGPT: Grounded Spatial Reasoning in Vision Language Models3 Jun
  8. 2024SpatialPIN: Enhancing Spatial Reasoning Capabilities of Vision-Language Models through Prompting and Interacting 3D Priors18 Mar
  9. 2024SpatialVLM: Endowing Vision-Language Models with Spatial Reasoning Capabilities22 Jan
  10. 2023LL3DA: Visual Interactive Instruction Tuning for Omni-3D Understanding, Reasoning, and Planning30 Nov
  11. 2022SQA3D: Situated Question Answering in 3D Scenes14 Oct

Other references · 42

  1. 2024DeepSeekMath: Pushing the Limits of Mathematical Reasoning in Open Language Modelscited by 9,379
  2. 2025DeepSeek-R1: Incentivizing Reasoning Capability in LLMs via Reinforcement Learningcited by 6,330
  3. 2025Qwen2.5-VL Technical Reportcited by 5,587
  4. 2024GPT-4o System Cardcited by 4,588
  5. 2017ScanNet: Richly-annotated 3D Reconstructions of Indoor Scenescited by 3,117
  6. 2025Qwen3-VL Technical Reportcited by 2,793
  7. 2023PaLM-E: An Embodied Multimodal Language Modelcited by 2,071
  8. 2024Expanding Performance Boundaries of Open-Source Multimodal Models with Model, Data, and Test-Time Scalingcited by 1,599
  9. 2022Objaverse: A Universe of Annotated 3D Objectscited by 1,540
  10. 2025VGGT: Visual Geometry Grounded Transformercited by 1,539
  11. 2017Matterport3D: Learning from RGB-D Data in Indoor Environmentscited by 1,376
  12. 2025Kimi k1.5: Scaling Reinforcement Learning with LLMscited by 1,210
30 more
  1. 2023ScanNet++: A High-Fidelity Dataset of 3D Indoor Scenescited by 764
  2. 2021Habitat-Matterport 3D Dataset (HM3D): 1000 Large-scale 3D Environments for Embodied AIcited by 592
  3. 2023Point Transformer V3: Simpler, Faster, Strongercited by 589
  4. 2024DriveVLM: The Convergence of Autonomous Driving and Large Vision-Language Modelscited by 490
  5. 2021ARKitScenes: A Diverse Real-World Dataset For 3D Indoor Scene Understanding Using Mobile RGB-D Datacited by 454
  6. 20203D-FRONT: 3D Furnished Rooms with layOuts and semaNTicscited by 380
  7. 2022ProcTHOR: Large-Scale Embodied AI Using Procedural Generationcited by 380
  8. 2021ScanQA: 3D Question Answering for Spatial Scene Understandingcited by 346
  9. 2023PointLLM: Empowering Large Language Models to Understand Point Cloudscited by 333
  10. 2023Holodeck: Language Guided Generation of 3D Embodied AI Environmentscited by 268
  11. 2024RoboPoint: A Vision-Language Model for Spatial Affordance Prediction for Roboticscited by 251
  12. 2025LMM-R1: Empowering 3B LMMs with Strong Reasoning Abilities Through Two-Stage Rule-Based RLcited by 248
  13. 2025Spatial-MLLM: Boosting MLLM Capabilities in Visual-based Spatial Intelligencecited by 217
  14. 2022SoftGroup for 3D Instance Segmentation on Point Cloudscited by 200
  15. 2023Point-Bind & Point-LLM: Aligning Point Cloud with Multi-modality for 3D Understanding, Generation, and Instruction Followingcited by 194
  16. 2024SpatialBot: Precise Spatial Understanding with Vision Language Modelscited by 152
  17. 2024ShapeLLM: Universal 3D Object Understanding for Embodied Interactioncited by 137
  18. 2024RoboSpatial: Teaching Spatial Understanding to 2D and 3D Vision-Language Models for Roboticscited by 136
  19. 2023Open3DIS: Open-Vocabulary 3D Instance Segmentation with 2D Mask Guidancecited by 124
  20. 2024HourVideo: 1-Hour Video-Language Understandingcited by 113
  21. 2025GPT4Scene: Understand 3D Scenes from Videos with Vision-Language Modelscited by 109
  22. 2024EmbSpatial-Bench: Benchmarking Spatial Understanding for Embodied Tasks with Large Vision-Language Modelscited by 107
  23. 2024Lexicon3D: Probing Visual Foundation Models for Complex 3D Scene Understandingcited by 49
  24. 2024LION: Linear Group RNN for 3D Object Detection in Point Cloudscited by 38
  25. 2023UnScene3D: Unsupervised 3D Instance Segmentation for Indoor Scenescited by 31
  26. 2024SPHERE: Unveiling Spatial Blind Spots in Vision-Language Models Through Hierarchical Evaluationcited by 31
  27. 2025Spatial Understanding from Videos: Structured Prompts Meet Simulation Datacited by 28
  28. 2024SPARTUN3D: Situated Spatial Understanding of 3D World in Large Language Modelscited by 27
  29. 2025Exo2Ego: Exocentric Knowledge Guided MLLM for Egocentric Video Understandingcited by 25
  30. 2024LLaVA-VSD: Large Language-and-Vision Assistant for Visual Spatial Descriptioncited by 7

Built on by

Cited by year (2026 to 14 Oct)

Citing papers per year: 2026: 1.

1 paper.

Similar, not cited

Close in wording, no citation either way

  1. 2026SpaceCast-Bench: Evaluating Predictive Spatial Reasoning in Vision-Language Models
  2. 2026Chain of Spatial Thoughts: Modality-Agnostic Spatial Grounding for Vision Language Models
  3. 2025Video Spatial Reasoning with Object-Centric 3D Rollout
  4. 2026SpatialForge: Bootstrapping 3D-Aware Spatial Reasoning from Open-World 2D Images
  5. 2025InternSpatial: A Comprehensive Dataset for Spatial Reasoning in Vision-Language Models
  6. 2026From Reasoning Failures to Composable Video Spatial Intelligence
  7. 2025SURPRISE3D: A Dataset for Spatial Understanding and Reasoning in Complex 3D Scenes
  8. 2025Mind the Gap: Benchmarking Spatial Reasoning in Vision-Language Models