mlsanityData to 7 Oct 2026

3D-Layout-R1: Structured Reasoning for Language-Instructed Spatial Editing

arXiv 2603.22279 ↗First posted 23 Mar 2026cs.CV cs.AIcited by 3

On the map: LLM reasoning → Spatial and embodied reasoning

also in 1 more
Abstract (arXiv)

Large Language Models (LLMs) and Vision Language Models (VLMs) have shown impressive reasoning abilities, yet they struggle with spatial understanding and layout consistency when performing fine-grained visual editing. We introduce a Structured Reasoning framework that performs text-conditioned spatial layout editing via scene-graph reasoning. Given an input scene graph and a natural-language instruction, the model reasons over the graph to generate an updated scene graph that satisfies the text condition while maintaining spatial coherence. By explicitly guiding the reasoning process through structured relational representations, our approach improves both interpretability and control over spatial relationships. We evaluate our method on a new text-guided layout editing benchmark encompassing sorting, spatial alignment, and room-editing tasks. Our training paradigm yields an average 15% improvement in IoU and 25% reduction in center-distance error compared to Chain of Thought Fine-tuning (CoT-SFT) and vanilla GRPO baselines. Compared to SOTA zero-shot LLMs, our best models achieve up to 20% higher mIoU, demonstrating markedly improved spatial precision.

Key facts. Cited by 3 papers in the map (data through 7 Oct 2026). Placed in Spatial and embodied reasoning, one of 17 directions in LLM reasoning. Builds on 22 of its 44 references that are in the map. First posted on arXiv 23 Mar 2026.

Builds on

22 of 44 references.

Closest ancestors · 5

Same direction, newest first

  1. 20253D-R1: Enhancing Reasoning in 3D VLMs for Unified Scene Understanding31 Jul
  2. 2025Direct Numerical Layout Generation for 3D Indoor Scene Synthesis via Spatial Reasoning5 Jun
  3. 2025RoboRefer: Towards Spatial Referring with Reasoning in Vision-Language Models for Robotics4 Jun
  4. 2025SpatialReasoner: Towards Explicit and Generalizable 3D Spatial Reasoning28 Apr
  5. 2025SpatialCoT: Advancing Spatial Reasoning through Coordinate Alignment and Chain-of-Thought for Embodied Task Planning17 Jan

Other references · 17

  1. 2024DeepSeekMath: Pushing the Limits of Mathematical Reasoning in Open Language Modelscited by 8,851
  2. 2025Qwen3 Technical Reportcited by 8,195
  3. 2025DeepSeek-R1: Incentivizing Reasoning Capability in LLMs via Reinforcement Learningcited by 6,146
  4. 2025Gemini 2.5: Pushing the Frontier with Advanced Reasoning, Multimodality, Long Context, and Next Generation Agentic Capabilitiescited by 3,655
  5. 2025DAPO: An Open-Source LLM Reinforcement Learning System at Scalecited by 2,678
  6. 2025Group Sequence Policy Optimizationcited by 788
  7. 2024DeepSeek-V3 Technical Reportcited by 724
  8. 2024InstructScene: Instruction-Driven 3D Indoor Scene Synthesis with Semantic Graph Priorcited by 110
  9. 2025Grounded Reinforcement Learning for Visual Reasoningcited by 80
  10. 20253D Aware Region Prompted Vision Language Modelcited by 31
  11. 2025Temporal Chain of Thought: Long-Video Understanding by Thinking in Framescited by 27
  12. 2025FRAG: Frame Selection Augmented Generation for Long Video and Long Document Understandingcited by 26
5 more
  1. 2024Layout-your-3D: Controllable and Precise 3D Generation with 2D Blueprintcited by 21
  2. 2024EditRoom: LLM-parameterized Graph Diffusion for Composable 3D Room Layout Editingcited by 14
  3. 2025Reasoning-as-Logic-Units: Scaling Test-Time Reasoning in Large Language Models Through Logic Unit Alignmentcited by 12
  4. 2025PlaceIt3D: Language-Guided Object Placement in Real 3D Scenescited by 8
  5. 2025Structured Outputs Enable General-Purpose LLMs to be Medical Expertscited by 6

Built on by

Cited by year (2026 to 7 Oct)

Citing papers per year: 2026: 3.

3 papers.

Similar, not cited

Close in wording, no citation either way

  1. 2026SG-Layout: Structured Scene Graph-Guided Layout Generation with LLMs
  2. 2026SSR: Pushing the Limit of Spatial Intelligence with Structured Scene Reasoning
  3. 2024LayoutVLM: Differentiable Optimization of 3D Layout via Vision-Language Models
  4. 20263D Space as a Scratchpad for Editable Text-to-Image Generation
  5. 2026Spatial Chain-of-Thought: Bridging Understanding and Generation Models for Spatial Reasoning Generation
  6. 2026R3L: Reasoning 3D Layouts from Relative Spatial Relations
  7. 2026Autoregressive Mosaics: Probing 2D Spatial Reasoning in Text-Only Language Models
  8. 2026GraFT: A Training-Free Framework for Spatial Reasoning in Multimodal Large Language Models via 3D Scene Graphs