Learning an Interior Layout Policy in a Domain Specific Language Action Space
Not on the map. Why?
Abstract (arXiv)
Indoor scene layout generation is a challenging task in interior design. Existing methods often oversimplify the task by reducing room conditions to coarse 3D bounding boxes and neglecting structural elements such as doors and windows. More fundamentally, many prior approaches formulate spatial reasoning as direct coordinate prediction, thereby casting interior layout design as continuous regression over raw geometric parameters, which hinders the model from learning the underlying reasoning logic of intelligent layout design. We propose LayoutDSL, a novel LLM-based framework for learning an interior layout policy in a domain-specific language (DSL) action space. The DSL provides an explicit symbolic representation of layout information and serves as a structured action space for layout reasoning, where each action corresponds to an interpretable design decision. Under this DSL-based policy learning paradigm, we construct 3D-FrontDSL, a dataset of room-structure annotations paired with synthetic DSL action sequences for supervised fine-tuning. To promote a more generalizable and scalable policy with verifiable feedback, we design rewards grounded in interior design principles and physical plausibility, and optimize the policy via reinforcement learning. Extensive experiments demonstrate that LayoutDSL substantially improves spatial plausibility and design logicality over strong baselines and existing methods.
Key facts. No citing papers in the map yet (data through 7 Oct 2026). Builds on 50 of its 56 references that are in the map. First posted on arXiv 31 Jul 2026.
Builds on
50 of 56 references.
References · 50
- 2022Training language models to follow instructions with human feedbackcited by 15,712
- 2024DeepSeekMath: Pushing the Limits of Mathematical Reasoning in Open Language Modelscited by 8,851
- 2025Qwen3 Technical Reportcited by 8,195
- 2017Deep reinforcement learning from human preferencescited by 3,846
- 2025Gemini 2.5: Pushing the Frontier with Advanced Reasoning, Multimodality, Long Context, and Next Generation Agentic Capabilitiescited by 3,655
- 2019Fine-Tuning Language Models from Human Preferencescited by 2,124
- 2024DeepSeek-Coder: When the Large Language Model Meets Programming -- The Rise of Code Intelligencecited by 1,154
- 2024Tulu 3: Pushing Frontiers in Open Language Model Post-Trainingcited by 988
- 2025SFT Memorizes, RL Generalizes: A Comparative Study of Foundation Model Post-trainingcited by 655
- 20203D-FRONT: 3D Furnished Rooms with layOuts and semaNTicscited by 375
- 2023LayoutGPT: Compositional Visual Planning and Generation with Large Language Modelscited by 337
- 2024Is DPO Superior to PPO for LLM Alignment? A Comprehensive Studycited by 262
38 more
- 2023Holodeck: Language Guided Generation of 3D Embodied AI Environmentscited by 257
- 2025LMM-R1: Empowering 3B LMMs with Strong Reasoning Abilities Through Two-Stage Rule-Based RLcited by 244
- 2021ATISS: Autoregressive Transformers for Indoor Scene Synthesiscited by 195
- 2025A Survey of Reinforcement Learning for Large Reasoning Modelscited by 175
- 2023DiffuScene: Denoising Diffusion Models for Generative Indoor Scene Synthesiscited by 159
- 2020SceneFormer: Indoor Scene Generation with Transformerscited by 154
- 2025Crossing the Reward Bridge: Expanding RL with Verifiable Rewards Across Diverse Domainscited by 150
- 2023Infinite Photorealistic Worlds using Procedural Generationcited by 142
- 2024Infinigen Indoors: Photorealistic Indoor Scenes using Procedural Generationcited by 129
- 2025LLM Post-Training: A Deep Dive into Reasoning Large Language Modelscited by 129
- 2024SceneCraft: An LLM Agent for Synthesizing 3D Scene as Blender Codecited by 125
- 2024PhyScene: Physically Interactable 3D Scene Synthesis for Embodied AIcited by 116
- 2024InstructScene: Instruction-Driven 3D Indoor Scene Synthesis with Semantic Graph Priorcited by 110
- 2025A Survey of Frontiers in LLM Reasoning: Inference Scaling, Learning to Reason, and Agentic Systemscited by 108
- 2024Rule Based Rewards for Language Model Safetycited by 106
- 2018Fast and Flexible Indoor Scene Synthesis via Deep Convolutional Generative Modelscited by 105
- 2023GraphDreamer: Compositional 3D Scene Synthesis from Scene Graphscited by 96
- 2024SceneScript: Reconstructing Scenes With An Autoregressive Structured Language Modelcited by 95
- 2024LayoutVLM: Differentiable Optimization of 3D Layout via Vision-Language Modelscited by 94
- 2024I-Design: Personalized LLM Interior Designercited by 87
- 2023AnyHome: Open-Vocabulary Generation of Structured and Textured 3D Homescited by 81
- 2023LEGO-Net: Learning Regular Rearrangements of Objects in Roomscited by 75
- 2018Human-centric Indoor Scene Synthesis Using Stochastic Grammarcited by 73
- 2018Deep Generative Modeling for Scene Synthesis via Hybrid Representationscited by 63
- 2023CommonScenes: Generating Commonsense 3D Indoor Scenes with Scene Graph Diffusioncited by 54
- 2025SceneWeaver: All-in-One 3D Scene Synthesis with an Extensible and Self-Reflective Agentcited by 53
- 2024Open-Universe Indoor Scene Generation using LLM Program Synthesis and Uncurated Object Databasescited by 43
- 2024LLplace: The 3D Indoor Scene Layout Generation and Editing via Large Language Modelcited by 34
- 2025Direct Numerical Layout Generation for 3D Indoor Scene Synthesis via Spatial Reasoningcited by 27
- 2025SceneEval: Evaluating Semantic Coherence in Text-Conditioned 3D Indoor Scene Synthesiscited by 26
- 2025FirePlace: Geometric Refinements of LLM Common Sense Reasoning for 3D Object Placementcited by 24
- 2025FlairGPT: Repurposing LLMs for Interior Designscited by 22
- 2025HSM: Hierarchical Scene Motifs for Multi-Scale Indoor Scene Generationcited by 22
- 2024Chat2Layout: Interactive 3D Furniture Layout with a Multimodal LLMcited by 20
- 2018Fast and Scalable Position-Based Layout Synthesiscited by 15
- 2025OptiScene: LLM-driven Indoor Scene Layout Generation via Scaled Human-aligned Data Synthesis and Multi-Stage Preference Optimizationcited by 14
- 2025Hierarchically-Structured Open-Vocabulary Indoor Scene Synthesis with Pre-trained Large Language Modelcited by 6
- 2026SpatialGrammar: A Domain-Specific Language for LLM-Based 3D Indoor Scene Generationcited by 2
Built on by
Not cited yet.
Similar, not cited
Close in wording, no citation either way
- 2026Function2Scene: 3D Indoor Scene Layout from Functional Specifications
- 2026CasLayout: Cascaded 3D Layout Diffusion for Indoor Scene Synthesis with Implicit Relation Modeling
- 2025Co-Layout: LLM-driven Co-optimization for Interior Layout
- 2026From Pixels to Policies: Reinforcing Spatial Reasoning in Language Models for Content-Aware Layout Design
- 2026Intelligent Co-Design: An Interactive LLM Framework for Interior Spatial Design via Multi-Modal Agents
- 2025M3DLayout: A Multi-Source Dataset of 3D Indoor Layouts and Structured Descriptions for 3D Generation
- 2024HouseTune: Two-Stage Floorplan Generation with LLM Assistance
- 2026Agentic Designer: Progressive Multi-Agent Collaboration for Structure-Aware Interior Layout Generation