Direct Numerical Layout Generation for 3D Indoor Scene Synthesis via Spatial Reasoning
On the map: LLM reasoning → Spatial and embodied reasoning
Abstract (arXiv)
Realistic 3D indoor scene synthesis is vital for embodied AI and digital content creation. It can be naturally divided into two subtasks: object generation and layout generation. While recent generative models have significantly advanced object-level quality and controllability, layout generation remains challenging due to limited datasets. Existing methods either overfit to these datasets or rely on predefined constraints to optimize numerical layout that sacrifice flexibility. As a result, they fail to generate scenes that are both open-vocabulary and aligned with fine-grained user instructions. We introduce DirectLayout, a framework that directly generates numerical 3D layouts from text descriptions using generalizable spatial reasoning of large language models (LLMs). DirectLayout decomposes the generation into three stages: producing a Bird's-Eye View (BEV) layout, lifting it into 3D space, and refining object placements. To enable explicit spatial reasoning and help the model grasp basic principles of object placement, we employ Chain-of-Thought (CoT) Activation based on the 3D-Front dataset. Additionally, we design CoT-Grounded Generative Layout Reward to enhance generalization and spatial planning. During inference, DirectLayout addresses asset-layout mismatches via Iterative Asset-Layout Alignment through in-context learning. Extensive experiments demonstrate that DirectLayout achieves impressive semantic consistency, generalization and physical plausibility.
Key facts. Cited by 28 papers in the map (data through 14 Oct 2026). Placed in Spatial and embodied reasoning, one of 17 directions in LLM reasoning. Builds on 32 of its 48 references that are in the map. First posted on arXiv 5 Jun 2025.
Builds on
32 of 48 references.
Closest ancestors · 2
Same direction, newest first
- 2025SpatialCoT: Advancing Spatial Reasoning through Coordinate Alignment and Chain-of-Thought for Embodied Task Planning17 Jan
- 2024LayoutVLM: Differentiable Optimization of 3D Layout via Vision-Language Models3 Dec
Other references · 30
- 2021Learning Transferable Visual Models From Natural Language Supervisioncited by 33,744
- 2023Direct Preference Optimization: Your Language Model is Secretly a Reward Modelcited by 8,065
- 2025DeepSeek-R1: Incentivizing Reasoning Capability in LLMs via Reinforcement Learningcited by 6,330
- 2024GPT-4o System Cardcited by 4,588
- 2024Structured 3D Latents for Scalable and Versatile 3D Generationcited by 770
- 2024CLAY: A Controllable Large-scale Generative Model for Creating High-quality 3D Assetscited by 455
- 2024LLaVA-CoT: Let Vision Language Models Reason Step-by-Stepcited by 454
- 20203D-FRONT: 3D Furnished Rooms with layOuts and semaNTicscited by 380
- 2022ProcTHOR: Large-Scale Embodied AI Using Procedural Generationcited by 380
- 2025Hunyuan3D 2.0: Scaling Diffusion Models for High Resolution Textured 3D Assets Generationcited by 356
- 2023LayoutGPT: Compositional Visual Planning and Generation with Large Language Modelscited by 347
- 2023Holodeck: Language Guided Generation of 3D Embodied AI Environmentscited by 268
18 more
- 2021ATISS: Autoregressive Transformers for Indoor Scene Synthesiscited by 200
- 2020SceneFormer: Indoor Scene Generation with Transformerscited by 158
- 2024Infinigen Indoors: Photorealistic Indoor Scenes using Procedural Generationcited by 137
- 2025Can We Generate Images with CoT? Let's Verify and Reinforce Image Generation Step by Stepcited by 131
- 2024InstructScene: Instruction-Driven 3D Indoor Scene Synthesis with Semantic Graph Priorcited by 117
- 2024GALA3D: Towards Text-to-3D Complex Scene Generation via Layout-guided Generative Gaussian Splattingcited by 109
- 2023GraphDreamer: Compositional 3D Scene Synthesis from Scene Graphscited by 97
- 2024I-Design: Personalized LLM Interior Designercited by 87
- 2023AnyHome: Open-Vocabulary Generation of Structured and Textured 3D Homescited by 82
- 2023SceneWiz3D: Towards Text-guided 3D Scene Compositioncited by 54
- 2020Generative Layout Modeling using Constraint Graphscited by 46
- 2024Open-Universe Indoor Scene Generation using LLM Program Synthesis and Uncurated Object Databasescited by 45
- 2024LLplace: The 3D Indoor Scene Layout Generation and Editing via Large Language Modelcited by 34
- 2025Global-Local Tree Search in VLMs for 3D Indoor Scene Generationcited by 29
- 20243DGraphLLM: Combining Semantic Graphs and Large Language Models for 3D Scene Understandingcited by 27
- 2022LayoutEnhancer: Generating Good Indoor Layouts from Imperfect Datacited by 20
- 2023Reason out Your Layout: Evoking the Layout Master from Large Language Models for Text-to-Image Synthesiscited by 16
- 2024Proc-GS: Procedural Building Generation for City Assembly with 3D Gaussianscited by 6
Built on by
Citing papers per year: 2025: 3; 2026: 25.
28 papers.
Sort:
By area:
- 2026SceneReVis: A Self-Reflective Vision-Grounded Framework for 3D Indoor Scene Synthesis via Multi-Turn RLcited by 6
- 2025InfiniBench: Infinite Benchmarking for Visual Spatial Reasoning with Customizable Scene Complexitycited by 5
- 20263D-Layout-R1: Structured Reasoning for Language-Instructed Spatial Editingcited by 4
- 2026Edit-As-Act: Goal-Regressive Planning for Open-Vocabulary 3D Indoor Scene Editingcited by 3
- 2026StoryBlender: Inter-Shot Consistent and Editable 3D Storyboard with Spatial-temporal Dynamicscited by 3
- 2026SceneNAT: Masked Generative Modeling for Language-Guided Indoor Scene Synthesiscited by 2
- 2026SceneCritic: A Symbolic Evaluator for 3D Indoor Scene Synthesiscited by 2
- 2026SpatialGrammar: A Domain-Specific Language for LLM-Based 3D Indoor Scene Generationcited by 2
- 2026HDSL: A Hierarchical Domain-Specific Language for Structured 3D Indoor Scene Generation and Localized Editing with LLM Agentscited by 2
- 2026NaLA: A 3D Native LLM Layout Agent for High-quality 3D Scene Generationcited by 2
- 2025Apples on the Table? Evaluating Text-Guided 3D Scene Synthesis via Fine-Grained Constraint Verificationcited by 1
- 2025GeoSceneGraph: Geometric Scene Graph Diffusion Model for Text-guided 3D Indoor Scene Synthesiscited by 1
16 more
- 2026Pair2Scene: Learning Local Object Relations for Procedural Scene Generationcited by 1
- 2026Co-generation of Layout and Shape from Text via Autoregressive 3D Diffusioncited by 1
- 2026Perceive-then-Plan: Layout-as-Policy for Monocular 3D Scene Layout Estimationcited by 1
- 2026Function2Scene: 3D Indoor Scene Layout from Functional Specificationscited by 1
- 2026Global-Local Monte Carlo Tree Search in Vision-Language Models for Text-to-3D Indoor Scene Generationcited by 1
- 2026iARCS: Iterative Agentic RL for Controllable 3D Scene Generationcited by 1
- 2026PARSE: Part-Aware Relational Spatial Modelingcited by 0
- 2026SDesc3D: Towards Layout-Aware 3D Indoor Scene Generation from Short Descriptionscited by 0
- 2026Orchestrating Spatial Semantics via a Zone-Graph Paradigm for Intricate Indoor Scene Generationcited by 0
- 2026Closing the Loop: Unified 3D Scene Generation and Immersive Interaction via LLM-RL Couplingcited by 0
- 2026ThinkBLOX: 3D Indoor Scene Generation with Progressive Reasoningcited by 0
- 2026SG-Layout: Structured Scene Graph-Guided Layout Generation with LLMscited by 0
- 2026Learning an Interior Layout Policy in a Domain Specific Language Action Spacecited by 0
- 2026ScenePilot: Grow-and-Repair Policy for Text-Driven 3D Indoor Scene Generationcited by 0
- 2026SceneMosaic: Efficient and Diverse Simulation-Ready Scene Generation via Hybrid Agentic Layout Evolutioncited by 0
- 2026PlaceReasoner-Beta: Reasoning-Driven Macro Placement and Benchmarkingcited by 0
- 2026PlaceReasoner-Beta: Reasoning-Driven Macro Placement and Benchmarking18 Sep 2026
- 2026SceneMosaic: Efficient and Diverse Simulation-Ready Scene Generation via Hybrid Agentic Layout Evolution4 Sep 2026
- 2026ScenePilot: Grow-and-Repair Policy for Text-Driven 3D Indoor Scene Generation31 Aug 2026
- 2026iARCS: Iterative Agentic RL for Controllable 3D Scene Generation6 Aug 2026
- 2026SG-Layout: Structured Scene Graph-Guided Layout Generation with LLMs2 Aug 2026
- 2026Learning an Interior Layout Policy in a Domain Specific Language Action Space31 Jul 2026
- 2026ThinkBLOX: 3D Indoor Scene Generation with Progressive Reasoning15 Jul 2026
- 2026NaLA: A 3D Native LLM Layout Agent for High-quality 3D Scene Generation28 Jun 2026
- 2026HDSL: A Hierarchical Domain-Specific Language for Structured 3D Indoor Scene Generation and Localized Editing with LLM Agents8 Jun 2026
- 2026Global-Local Monte Carlo Tree Search in Vision-Language Models for Text-to-3D Indoor Scene Generation4 Jun 2026
- 2026Function2Scene: 3D Indoor Scene Layout from Functional Specifications29 May 2026
- 2026Perceive-then-Plan: Layout-as-Policy for Monocular 3D Scene Layout Estimation25 May 2026
16 more
- 2026Closing the Loop: Unified 3D Scene Generation and Immersive Interaction via LLM-RL Coupling7 May 2026
- 2026Orchestrating Spatial Semantics via a Zone-Graph Paradigm for Intricate Indoor Scene Generation4 May 2026
- 2026SpatialGrammar: A Domain-Specific Language for LLM-Based 3D Indoor Scene Generation30 Apr 2026
- 2026Co-generation of Layout and Shape from Text via Autoregressive 3D Diffusion17 Apr 2026
- 2026SceneCritic: A Symbolic Evaluator for 3D Indoor Scene Synthesis14 Apr 2026
- 2026Pair2Scene: Learning Local Object Relations for Procedural Scene Generation13 Apr 2026
- 2026SDesc3D: Towards Layout-Aware 3D Indoor Scene Generation from Short Descriptions2 Apr 2026
- 2026StoryBlender: Inter-Shot Consistent and Editable 3D Storyboard with Spatial-temporal Dynamics1 Apr 2026
- 20263D-Layout-R1: Structured Reasoning for Language-Instructed Spatial Editing23 Mar 2026
- 2026Edit-As-Act: Goal-Regressive Planning for Open-Vocabulary 3D Indoor Scene Editing18 Mar 2026
- 2026PARSE: Part-Aware Relational Spatial Modeling8 Mar 2026
- 2026SceneReVis: A Self-Reflective Vision-Grounded Framework for 3D Indoor Scene Synthesis via Multi-Turn RL10 Feb 2026
- 2026SceneNAT: Masked Generative Modeling for Language-Guided Indoor Scene Synthesis12 Jan 2026
- 2025InfiniBench: Infinite Benchmarking for Visual Spatial Reasoning with Customizable Scene Complexity22 Nov 2025
- 2025GeoSceneGraph: Geometric Scene Graph Diffusion Model for Text-guided 3D Indoor Scene Synthesis18 Nov 2025
- 2025Apples on the Table? Evaluating Text-Guided 3D Scene Synthesis via Fine-Grained Constraint Verification4 Nov 2025
- 2026HDSL: A Hierarchical Domain-Specific Language for Structured 3D Indoor Scene Generation and Localized Editing with LLM Agentscited by 2
- 2026NaLA: A 3D Native LLM Layout Agent for High-quality 3D Scene Generationcited by 2
- 2026iARCS: Iterative Agentic RL for Controllable 3D Scene Generationcited by 1
- 2026SceneMosaic: Efficient and Diverse Simulation-Ready Scene Generation via Hybrid Agentic Layout Evolutioncited by 0
- 2026SceneMosaic: Efficient and Diverse Simulation-Ready Scene Generation via Hybrid Agentic Layout Evolution4 Sep 2026
- 2026iARCS: Iterative Agentic RL for Controllable 3D Scene Generation6 Aug 2026
- 2026NaLA: A 3D Native LLM Layout Agent for High-quality 3D Scene Generation28 Jun 2026
- 2026HDSL: A Hierarchical Domain-Specific Language for Structured 3D Indoor Scene Generation and Localized Editing with LLM Agents8 Jun 2026
- 2025InfiniBench: Infinite Benchmarking for Visual Spatial Reasoning with Customizable Scene Complexitycited by 5
- 20263D-Layout-R1: Structured Reasoning for Language-Instructed Spatial Editingcited by 4
- 2026Global-Local Monte Carlo Tree Search in Vision-Language Models for Text-to-3D Indoor Scene Generationcited by 1
- 2026ThinkBLOX: 3D Indoor Scene Generation with Progressive Reasoningcited by 0
- 2026ThinkBLOX: 3D Indoor Scene Generation with Progressive Reasoning15 Jul 2026
- 2026Global-Local Monte Carlo Tree Search in Vision-Language Models for Text-to-3D Indoor Scene Generation4 Jun 2026
- 20263D-Layout-R1: Structured Reasoning for Language-Instructed Spatial Editing23 Mar 2026
- 2025InfiniBench: Infinite Benchmarking for Visual Spatial Reasoning with Customizable Scene Complexity22 Nov 2025
- 2026SceneReVis: A Self-Reflective Vision-Grounded Framework for 3D Indoor Scene Synthesis via Multi-Turn RLcited by 6
- 2026Edit-As-Act: Goal-Regressive Planning for Open-Vocabulary 3D Indoor Scene Editingcited by 3
- 2026StoryBlender: Inter-Shot Consistent and Editable 3D Storyboard with Spatial-temporal Dynamicscited by 3
- 2026SceneNAT: Masked Generative Modeling for Language-Guided Indoor Scene Synthesiscited by 2
- 2026SpatialGrammar: A Domain-Specific Language for LLM-Based 3D Indoor Scene Generationcited by 2
- 2025Apples on the Table? Evaluating Text-Guided 3D Scene Synthesis via Fine-Grained Constraint Verificationcited by 1
- 2026Pair2Scene: Learning Local Object Relations for Procedural Scene Generationcited by 1
- 2026Co-generation of Layout and Shape from Text via Autoregressive 3D Diffusioncited by 1
- 2026Perceive-then-Plan: Layout-as-Policy for Monocular 3D Scene Layout Estimationcited by 1
- 2026Function2Scene: 3D Indoor Scene Layout from Functional Specificationscited by 1
- 2026PARSE: Part-Aware Relational Spatial Modelingcited by 0
- 2026SDesc3D: Towards Layout-Aware 3D Indoor Scene Generation from Short Descriptionscited by 0
12 most cited of 17 All 17 (JSON)
- 2026PlaceReasoner-Beta: Reasoning-Driven Macro Placement and Benchmarking18 Sep 2026
- 2026SG-Layout: Structured Scene Graph-Guided Layout Generation with LLMs2 Aug 2026
- 2026Learning an Interior Layout Policy in a Domain Specific Language Action Space31 Jul 2026
- 2026Function2Scene: 3D Indoor Scene Layout from Functional Specifications29 May 2026
- 2026Perceive-then-Plan: Layout-as-Policy for Monocular 3D Scene Layout Estimation25 May 2026
- 2026Closing the Loop: Unified 3D Scene Generation and Immersive Interaction via LLM-RL Coupling7 May 2026
- 2026Orchestrating Spatial Semantics via a Zone-Graph Paradigm for Intricate Indoor Scene Generation4 May 2026
- 2026SpatialGrammar: A Domain-Specific Language for LLM-Based 3D Indoor Scene Generation30 Apr 2026
- 2026Co-generation of Layout and Shape from Text via Autoregressive 3D Diffusion17 Apr 2026
- 2026Pair2Scene: Learning Local Object Relations for Procedural Scene Generation13 Apr 2026
- 2026SDesc3D: Towards Layout-Aware 3D Indoor Scene Generation from Short Descriptions2 Apr 2026
- 2026StoryBlender: Inter-Shot Consistent and Editable 3D Storyboard with Spatial-temporal Dynamics1 Apr 2026
12 newest of 17 All 17 (JSON)
Similar, not cited
Close in wording, no citation either way
- 2025M3DLayout: A Multi-Source Dataset of 3D Indoor Layouts and Structured Descriptions for 3D Generation
- 2025SemLayoutDiff: Semantic Layout Generation with Diffusion Model for Indoor Scene Synthesis
- 2025OptiScene: LLM-driven Indoor Scene Layout Generation via Scaled Human-aligned Data Synthesis and Multi-Stage Preference Optimization
- 2025ReSpace: Text-Driven Autoregressive 3D Indoor Scene Synthesis and Editing
- 2025SPATIALGEN: Layout-guided 3D Indoor Scene Generation
- 2025SceneLCM: End-to-End Layout-Guided Interactive Indoor Scene Generation with Latent Consistency Model
- 2026CasLayout: Cascaded 3D Layout Diffusion for Indoor Scene Synthesis with Implicit Relation Modeling
- 2026R3L: Reasoning 3D Layouts from Relative Spatial Relations