mlsanityData to 7 Oct 2026

Learning an Interior Layout Policy in a Domain Specific Language Action Space

arXiv 2608.07547 ↗First posted 31 Jul 2026cs.CV cs.AIcited by 0

Not on the map. Why?

Abstract (arXiv)

Indoor scene layout generation is a challenging task in interior design. Existing methods often oversimplify the task by reducing room conditions to coarse 3D bounding boxes and neglecting structural elements such as doors and windows. More fundamentally, many prior approaches formulate spatial reasoning as direct coordinate prediction, thereby casting interior layout design as continuous regression over raw geometric parameters, which hinders the model from learning the underlying reasoning logic of intelligent layout design. We propose LayoutDSL, a novel LLM-based framework for learning an interior layout policy in a domain-specific language (DSL) action space. The DSL provides an explicit symbolic representation of layout information and serves as a structured action space for layout reasoning, where each action corresponds to an interpretable design decision. Under this DSL-based policy learning paradigm, we construct 3D-FrontDSL, a dataset of room-structure annotations paired with synthetic DSL action sequences for supervised fine-tuning. To promote a more generalizable and scalable policy with verifiable feedback, we design rewards grounded in interior design principles and physical plausibility, and optimize the policy via reinforcement learning. Extensive experiments demonstrate that LayoutDSL substantially improves spatial plausibility and design logicality over strong baselines and existing methods.

Key facts. No citing papers in the map yet (data through 7 Oct 2026). Builds on 50 of its 56 references that are in the map. First posted on arXiv 31 Jul 2026.

Builds on

50 of 56 references.

References · 50

  1. 2022Training language models to follow instructions with human feedbackcited by 15,712
  2. 2024DeepSeekMath: Pushing the Limits of Mathematical Reasoning in Open Language Modelscited by 8,851
  3. 2025Qwen3 Technical Reportcited by 8,195
  4. 2017Deep reinforcement learning from human preferencescited by 3,846
  5. 2025Gemini 2.5: Pushing the Frontier with Advanced Reasoning, Multimodality, Long Context, and Next Generation Agentic Capabilitiescited by 3,655
  6. 2019Fine-Tuning Language Models from Human Preferencescited by 2,124
  7. 2024DeepSeek-Coder: When the Large Language Model Meets Programming -- The Rise of Code Intelligencecited by 1,154
  8. 2024Tulu 3: Pushing Frontiers in Open Language Model Post-Trainingcited by 988
  9. 2025SFT Memorizes, RL Generalizes: A Comparative Study of Foundation Model Post-trainingcited by 655
  10. 20203D-FRONT: 3D Furnished Rooms with layOuts and semaNTicscited by 375
  11. 2023LayoutGPT: Compositional Visual Planning and Generation with Large Language Modelscited by 337
  12. 2024Is DPO Superior to PPO for LLM Alignment? A Comprehensive Studycited by 262
38 more
  1. 2023Holodeck: Language Guided Generation of 3D Embodied AI Environmentscited by 257
  2. 2025LMM-R1: Empowering 3B LMMs with Strong Reasoning Abilities Through Two-Stage Rule-Based RLcited by 244
  3. 2021ATISS: Autoregressive Transformers for Indoor Scene Synthesiscited by 195
  4. 2025A Survey of Reinforcement Learning for Large Reasoning Modelscited by 175
  5. 2023DiffuScene: Denoising Diffusion Models for Generative Indoor Scene Synthesiscited by 159
  6. 2020SceneFormer: Indoor Scene Generation with Transformerscited by 154
  7. 2025Crossing the Reward Bridge: Expanding RL with Verifiable Rewards Across Diverse Domainscited by 150
  8. 2023Infinite Photorealistic Worlds using Procedural Generationcited by 142
  9. 2024Infinigen Indoors: Photorealistic Indoor Scenes using Procedural Generationcited by 129
  10. 2025LLM Post-Training: A Deep Dive into Reasoning Large Language Modelscited by 129
  11. 2024SceneCraft: An LLM Agent for Synthesizing 3D Scene as Blender Codecited by 125
  12. 2024PhyScene: Physically Interactable 3D Scene Synthesis for Embodied AIcited by 116
  13. 2024InstructScene: Instruction-Driven 3D Indoor Scene Synthesis with Semantic Graph Priorcited by 110
  14. 2025A Survey of Frontiers in LLM Reasoning: Inference Scaling, Learning to Reason, and Agentic Systemscited by 108
  15. 2024Rule Based Rewards for Language Model Safetycited by 106
  16. 2018Fast and Flexible Indoor Scene Synthesis via Deep Convolutional Generative Modelscited by 105
  17. 2023GraphDreamer: Compositional 3D Scene Synthesis from Scene Graphscited by 96
  18. 2024SceneScript: Reconstructing Scenes With An Autoregressive Structured Language Modelcited by 95
  19. 2024LayoutVLM: Differentiable Optimization of 3D Layout via Vision-Language Modelscited by 94
  20. 2024I-Design: Personalized LLM Interior Designercited by 87
  21. 2023AnyHome: Open-Vocabulary Generation of Structured and Textured 3D Homescited by 81
  22. 2023LEGO-Net: Learning Regular Rearrangements of Objects in Roomscited by 75
  23. 2018Human-centric Indoor Scene Synthesis Using Stochastic Grammarcited by 73
  24. 2018Deep Generative Modeling for Scene Synthesis via Hybrid Representationscited by 63
  25. 2023CommonScenes: Generating Commonsense 3D Indoor Scenes with Scene Graph Diffusioncited by 54
  26. 2025SceneWeaver: All-in-One 3D Scene Synthesis with an Extensible and Self-Reflective Agentcited by 53
  27. 2024Open-Universe Indoor Scene Generation using LLM Program Synthesis and Uncurated Object Databasescited by 43
  28. 2024LLplace: The 3D Indoor Scene Layout Generation and Editing via Large Language Modelcited by 34
  29. 2025Direct Numerical Layout Generation for 3D Indoor Scene Synthesis via Spatial Reasoningcited by 27
  30. 2025SceneEval: Evaluating Semantic Coherence in Text-Conditioned 3D Indoor Scene Synthesiscited by 26
  31. 2025FirePlace: Geometric Refinements of LLM Common Sense Reasoning for 3D Object Placementcited by 24
  32. 2025FlairGPT: Repurposing LLMs for Interior Designscited by 22
  33. 2025HSM: Hierarchical Scene Motifs for Multi-Scale Indoor Scene Generationcited by 22
  34. 2024Chat2Layout: Interactive 3D Furniture Layout with a Multimodal LLMcited by 20
  35. 2018Fast and Scalable Position-Based Layout Synthesiscited by 15
  36. 2025OptiScene: LLM-driven Indoor Scene Layout Generation via Scaled Human-aligned Data Synthesis and Multi-Stage Preference Optimizationcited by 14
  37. 2025Hierarchically-Structured Open-Vocabulary Indoor Scene Synthesis with Pre-trained Large Language Modelcited by 6
  38. 2026SpatialGrammar: A Domain-Specific Language for LLM-Based 3D Indoor Scene Generationcited by 2

Built on by

Not cited yet.

Similar, not cited

Close in wording, no citation either way

  1. 2026Function2Scene: 3D Indoor Scene Layout from Functional Specifications
  2. 2026CasLayout: Cascaded 3D Layout Diffusion for Indoor Scene Synthesis with Implicit Relation Modeling
  3. 2025Co-Layout: LLM-driven Co-optimization for Interior Layout
  4. 2026From Pixels to Policies: Reinforcing Spatial Reasoning in Language Models for Content-Aware Layout Design
  5. 2026Intelligent Co-Design: An Interactive LLM Framework for Interior Spatial Design via Multi-Modal Agents
  6. 2025M3DLayout: A Multi-Source Dataset of 3D Indoor Layouts and Structured Descriptions for 3D Generation
  7. 2024HouseTune: Two-Stage Floorplan Generation with LLM Assistance
  8. 2026Agentic Designer: Progressive Multi-Agent Collaboration for Structure-Aware Interior Layout Generation