mlsanityData to 7 Oct 2026

Agentic Designer: Progressive Multi-Agent Collaboration for Structure-Aware Interior Layout Generation

arXiv 2607.20866 ↗First posted 23 Jul 2026cs.CVcited by 1

On the map: LLM agents and tool use → Multimodal and embodied agents

Abstract (arXiv)

Generating realistic interior furniture layouts that strictly adhere to architectural constraints (e.g., walls, doors, and windows) remains a fundamental challenge in automated spatial design. Existing approaches, primarily based on one-shot generation using diffusion models or Large Language Models (LLMs), lack explicit mechanisms for intermediate geometric constraint verification, often resulting in structural collisions and functionally infeasible arrangements under complex room constraints. To address these challenges, we propose Agentic Designer, a progressive, multi-agent framework that formulates structure-aware interior layout generation as an iterative and constraint-verified decision process. By decomposing layout synthesis into modular stages of proposal, verification, and adjustment, the framework coordinates three specialized agents, a Generator, an Evaluator, and a Refiner, through a Progressive Consensus Mechanism. This mechanism enforces stepwise geometric validation and correction before each placement is committed, thereby preventing error accumulation. To facilitate this structure-aware paradigm and standardize evaluation, we establish InStruct, a comprehensive benchmark that integrates a dataset comprising over 18,000 high-quality, parametrically annotated samples with a novel suite of structure-centric metrics. Extensive quantitative evaluations, qualitative analyses, and user studies show that Agentic Designer significantly outperforms state-of-the-art methods, demonstrating substantial improvements in strict structural adherence and functional design coherence.

Key facts. Cited by 1 paper in the map (data through 7 Oct 2026). Placed in Multimodal and embodied agents, one of 16 directions in LLM agents and tool use. Builds on 39 of its 44 references that are in the map. First posted on arXiv 23 Jul 2026.

Builds on

39 of 44 references.

Closest ancestors · 1

Same direction, newest first

  1. 2024SceneCraft: An LLM Agent for Synthesizing 3D Scene as Blender Code2 Mar

Other references · 38

  1. 2021LoRA: Low-Rank Adaptation of Large Language Modelscited by 14,084
  2. 2023Self-Refine: Iterative Refinement with Self-Feedbackcited by 3,317
  3. 2017ScanNet: Richly-annotated 3D Reconstructions of Indoor Scenescited by 3,088
  4. 2022Do As I Can, Not As I Say: Grounding Language in Robotic Affordancescited by 2,302
  5. 2023MetaGPT: Meta Programming for A Multi-Agent Collaborative Frameworkcited by 1,761
  6. 2017Matterport3D: Learning from RGB-D Data in Indoor Environmentscited by 1,354
  7. 2022Code as Policies: Language Model Programs for Embodied Controlcited by 1,172
  8. 2024Qwen2.5-Coder Technical Reportcited by 1,151
  9. 2023ScanNet++: A High-Fidelity Dataset of 3D Indoor Scenescited by 747
  10. 2021Habitat-Matterport 3D Dataset (HM3D): 1000 Large-scale 3D Environments for Embodied AIcited by 579
  11. 2016Semantic Scene Completion from a Single Depth Imagecited by 468
  12. 20203D-FRONT: 3D Furnished Rooms with layOuts and semaNTicscited by 375
26 more
  1. 2023LayoutGPT: Compositional Visual Planning and Generation with Large Language Modelscited by 337
  2. 2025From System 1 to System 2: A Survey of Reasoning Large Language Modelscited by 319
  3. 2019Structured3D: A Large Photo-realistic Dataset for Structured 3D Modelingcited by 285
  4. 2023Holodeck: Language Guided Generation of 3D Embodied AI Environmentscited by 257
  5. 2021ATISS: Autoregressive Transformers for Indoor Scene Synthesiscited by 195
  6. 2023DiffuScene: Denoising Diffusion Models for Generative Indoor Scene Synthesiscited by 159
  7. 2020SceneFormer: Indoor Scene Generation with Transformerscited by 154
  8. 2024Multi-Step Reasoning with Large Language Models, a Surveycited by 140
  9. 2023MTR++: Multi-Agent Motion Prediction with Symmetric Scene Modeling and Guided Intention Queryingcited by 139
  10. 2024PhyScene: Physically Interactable 3D Scene Synthesis for Embodied AIcited by 116
  11. 2024InstructScene: Instruction-Driven 3D Indoor Scene Synthesis with Semantic Graph Priorcited by 110
  12. 2018Fast and Flexible Indoor Scene Synthesis via Deep Convolutional Generative Modelscited by 105
  13. 2018InteriorNet: Mega-scale Multi-sensor Photo-realistic Indoor Scenes Datasetcited by 87
  14. 2024I-Design: Personalized LLM Interior Designercited by 87
  15. 2023AnyHome: Open-Vocabulary Generation of Structured and Textured 3D Homescited by 81
  16. 2023LEGO-Net: Learning Regular Rearrangements of Objects in Roomscited by 75
  17. 2024Demystifying Chains, Trees, and Graphs of Thoughtscited by 63
  18. 2024Mixed Diffusion for 3D Indoor Scene Synthesiscited by 30
  19. 2021Indoor Scene Generation from a Collection of Semantic-Segmented Depth Imagescited by 27
  20. 2024Chat2Layout: Interactive 3D Furniture Layout with a Multimodal LLMcited by 20
  21. 2022Interaction Pattern Disentangling for Multi-Agent Reinforcement Learningcited by 8
  22. 2024MAO: A Framework for Process Model Generation with Multi-Agent Orchestrationcited by 8
  23. 2025Contrastive Decoupled Representation Learning and Regularization for Speech-Preserving Facial Expression Manipulationcited by 7
  24. 2026MO-MIX: Multi-Objective Multi-Agent Cooperative Decision-Making With Deep Reinforcement Learningcited by 6
  25. 2024S-INF: Towards Realistic Indoor Scene Synthesis via Scene Implicit Neural Fieldcited by 3
  26. 2026Learning Spatial-Temporal Coherent Correlations for Speech-Preserving Facial Expression Manipulationcited by 2

Built on by

Cited by year (2026 to 7 Oct)

Citing papers per year: 2026: 1.

1 paper.

Similar, not cited

Close in wording, no citation either way

  1. 2025Co-Layout: LLM-driven Co-optimization for Interior Layout
  2. 2026Intelligent Co-Design: An Interactive LLM Framework for Interior Spatial Design via Multi-Modal Agents
  3. 2025DisCo-Layout: Disentangling and Coordinating Semantic and Physical Refinement in a Multi-Agent Framework for 3D Indoor Layout Synthesis
  4. 2026TO-Agents: A Multi-Agent AI Framework for Subjective Preference-Guided Topology Optimization
  5. 2026PlanCraft: Sketch, Refine, and Furnish for Architect-Inspired Progressive 3D Residential Scene Generation
  6. 2026Learning an Interior Layout Policy in a Domain Specific Language Action Space
  7. 2026Directly from Alpha to Omega: Controllable End-to-End Vector Floor Plan Generation ↗
  8. 2026MAGE: Human-Like Macro Placement via Agentic Multimodal Reasoning