DisCo-Layout: Disentangling and Coordinating Semantic and Physical Refinement in a Multi-Agent Framework for 3D Indoor Layout Synthesis
On the map: LLM agents and tool use → Multimodal and embodied agents
Abstract (arXiv)
3D indoor layout synthesis is crucial for creating virtual environments. Traditional methods struggle with generalization due to fixed datasets. While recent LLM and VLM-based approaches offer improved semantic richness, they often lack robust and flexible refinement, resulting in suboptimal layouts. We develop DisCo-Layout, a novel framework that disentangles and coordinates physical and semantic refinement. For independent refinement, our Semantic Refinement Tool (SRT) corrects abstract object relationships, while the Physical Refinement Tool (PRT) resolves concrete spatial issues via a grid-matching algorithm. For collaborative refinement, a multi-agent framework intelligently orchestrates these tools, featuring a planner for placement rules, a designer for initial layouts, and an evaluator for assessment. Experiments demonstrate DisCo-Layout's state-of-the-art performance, generating realistic, coherent, and generalizable 3D indoor layouts. Our code will be publicly available.
Key facts. Cited by 5 papers in the map (data through 7 Oct 2026). Placed in Multimodal and embodied agents, one of 16 directions in LLM agents and tool use. Builds on 26 of its 43 references that are in the map. First posted on arXiv 2 Oct 2025.
Builds on
26 of 43 references.
Closest ancestors · 3
Same direction, newest first
- 2025JarvisArt: Liberating Human Artistic Creativity via an Intelligent Photo Retouching Agent21 Jun
- 2025Scenethesis: A Language and Vision Agentic Framework for 3D Scene Generation5 May
- 2024SceneCraft: An LLM Agent for Synthesizing 3D Scene as Blender Code2 Mar
Other references · 23
- 2023Generative Agents: Interactive Simulacra of Human Behaviorcited by 3,500
- 2023AutoGen: Enabling Next-Gen LLM Applications via Multi-Agent Conversationcited by 1,906
- 2023MetaGPT: Meta Programming for A Multi-Agent Collaborative Frameworkcited by 1,761
- 2022Objaverse: A Universe of Annotated 3D Objectscited by 1,522
- 2023CAMEL: Communicative Agents for "Mind" Exploration of Large Language Model Societycited by 1,348
- 2017AI2-THOR: An Interactive 3D Environment for Visual AIcited by 850
- 2020Beyond the Nav-Graph: Vision-and-Language Navigation in Continuous Environmentscited by 429
- 2024RoboCasa: Large-Scale Simulation of Everyday Tasks for Generalist Robotscited by 391
- 20203D-FRONT: 3D Furnished Rooms with layOuts and semaNTicscited by 375
- 2023LayoutGPT: Compositional Visual Planning and Generation with Large Language Modelscited by 337
- 2023Holodeck: Language Guided Generation of 3D Embodied AI Environmentscited by 257
- 2021ATISS: Autoregressive Transformers for Indoor Scene Synthesiscited by 195
11 more
- 2025Large Language Model Agent: A Survey on Methodology, Applications and Challengescited by 194
- 2023DiffuScene: Denoising Diffusion Models for Generative Indoor Scene Synthesiscited by 159
- 2024PhyScene: Physically Interactable 3D Scene Synthesis for Embodied AIcited by 116
- 2024LayoutVLM: Differentiable Optimization of 3D Layout via Vision-Language Modelscited by 94
- 2024I-Design: Personalized LLM Interior Designercited by 87
- 2025Global-Local Tree Search in VLMs for 3D Indoor Scene Generationcited by 29
- 2023Chemist-X: Large Language Model-empowered Agent for Reaction Condition Recommendation in Chemical Synthesiscited by 25
- 2025HSM: Hierarchical Scene Motifs for Multi-Scale Indoor Scene Generationcited by 22
- 2024Chat2Layout: Interactive 3D Furniture Layout with a Multimodal LLMcited by 20
- 2023Advances in Data-Driven Analysis and Synthesis of 3D Indoor Scenescited by 19
- 2025Hierarchically-Structured Open-Vocabulary Indoor Scene Synthesis with Pre-trained Large Language Modelcited by 6
Built on by
Citing papers per year: 2026: 5.
5 papers.
- 2026SceneReVis: A Self-Reflective Vision-Grounded Framework for 3D Indoor Scene Synthesis via Multi-turn RLcited by 6
- 2026SceneNAT: Masked Generative Modeling for Language-Guided Indoor Scene Synthesiscited by 2
- 2026SDesc3D: Towards Layout-Aware 3D Indoor Scene Generation from Short Descriptionscited by 0
- 20263D Generation for Embodied AI and Robotic Simulation: A Surveycited by 0
- 2026Function2Scene: 3D Indoor Scene Layout from Functional Specificationscited by 0
- 2026Function2Scene: 3D Indoor Scene Layout from Functional Specifications29 May 2026
- 20263D Generation for Embodied AI and Robotic Simulation: A Survey29 Apr 2026
- 2026SDesc3D: Towards Layout-Aware 3D Indoor Scene Generation from Short Descriptions2 Apr 2026
- 2026SceneReVis: A Self-Reflective Vision-Grounded Framework for 3D Indoor Scene Synthesis via Multi-turn RL10 Feb 2026
- 2026SceneNAT: Masked Generative Modeling for Language-Guided Indoor Scene Synthesis12 Jan 2026
Similar, not cited
Close in wording, no citation either way
- 2026Agentic Designer: Progressive Multi-Agent Collaboration for Structure-Aware Interior Layout Generation
- 2025OptiScene: LLM-driven Indoor Scene Layout Generation via Scaled Human-aligned Data Synthesis and Multi-Stage Preference Optimization
- 2025Direct Numerical Layout Generation for 3D Indoor Scene Synthesis via Spatial Reasoning
- 2026Intelligent Co-Design: An Interactive LLM Framework for Interior Spatial Design via Multi-Modal Agents
- 2026CasLayout: Cascaded 3D Layout Diffusion for Indoor Scene Synthesis with Implicit Relation Modeling
- 2025SemLayoutDiff: Semantic Layout Generation with Diffusion Model for Indoor Scene Synthesis
- 2024LLplace: The 3D Indoor Scene Layout Generation and Editing via Large Language Model
- 2026Orchestrating Spatial Semantics via a Zone-Graph Paradigm for Intricate Indoor Scene Generation