mlsanityData to 7 Oct 2026

I-Design: Personalized LLM Interior Designer

arXiv 2404.02838 ↗First posted 3 Apr 2024cs.AIcited by 87

Not on the map. Why?

Abstract (arXiv)

Interior design allows us to be who we are and live how we want - each design is as unique as our distinct personality. However, it is not trivial for non-professionals to express and materialize this since it requires aligning functional and visual expectations with the constraints of physical space; this renders interior design a luxury. To make it more accessible, we present I-Design, a personalized interior designer that allows users to generate and visualize their design goals through natural language communication. I-Design starts with a team of large language model agents that engage in dialogues and logical reasoning with one another, transforming textual user input into feasible scene graph designs with relative object relationships. Subsequently, an effective placement algorithm determines optimal locations for each object within the scene. The final design is then constructed in 3D by retrieving and integrating assets from an existing object database. Additionally, we propose a new evaluation protocol that utilizes a vision-language model and complements the design pipeline. Extensive quantitative and qualitative experiments show that I-Design outperforms existing methods in delivering high-quality 3D design solutions and aligning with abstract concepts that match user input, showcasing its advantages across detailed 3D arrangement and conceptual fidelity.

Key facts. Cited by 87 papers in the map (data through 7 Oct 2026). Builds on 53 of its 69 references that are in the map. First posted on arXiv 3 Apr 2024.

Builds on

53 of 69 references.

References · 53

  1. 2021Learning Transferable Visual Models From Natural Language Supervisioncited by 33,456
  2. 2020Denoising Diffusion Probabilistic Modelscited by 20,851
  3. 2021High-Resolution Image Synthesis with Latent Diffusion Modelscited by 18,694
  4. 2023GPT-4 Technical Reportcited by 18,132
  5. 2022Chain-of-Thought Prompting Elicits Reasoning in Large Language Modelscited by 12,302
  6. 2021Diffusion Models Beat GANs on Image Synthesiscited by 8,185
  7. 2023Adding Conditional Control to Text-to-Image Diffusion Modelscited by 5,466
  8. 2022DreamFusion: Text-to-3D using 2D Diffusioncited by 3,006
  9. 2015ShapeNet: An Information-Rich 3D Model Repositorycited by 2,880
  10. 2022Objaverse: A Universe of Annotated 3D Objectscited by 1,522
  11. 2023HuggingGPT: Solving AI Tasks with ChatGPT and its Friends in Hugging Facecited by 1,173
  12. 2023LRM: Large Reconstruction Model for Single Image to 3Dcited by 834
38 more
  1. 2023Wonder3D: Single Image to 3D using Cross-Domain Diffusioncited by 682
  2. 2023One-2-3-45: Any Single Image to 3D Mesh in 45 Seconds without Per-Shape Optimizationcited by 555
  3. 2016Semantic Scene Completion from a Single Depth Imagecited by 468
  4. 2022LLM-Planner: Few-Shot Grounded Planning for Embodied Agents with Large Language Modelscited by 459
  5. 2023Harnessing the Power of LLMs in Practice: A Survey on ChatGPT and Beyondcited by 409
  6. 20203D-FRONT: 3D Furnished Rooms with layOuts and semaNTicscited by 375
  7. 2022ProcTHOR: Large-Scale Embodied AI Using Procedural Generationcited by 369
  8. 2023LayoutGPT: Compositional Visual Planning and Generation with Large Language Modelscited by 337
  9. 20203D-FUTURE: 3D Furniture shape with TextUREcited by 306
  10. 2019Structured3D: A Large Photo-realistic Dataset for Structured 3D Modelingcited by 285
  11. 20193D Scene Graph: A Structure for Unified Semantics, 3D Space, and Cameracited by 280
  12. 2023Auto-GPT for Online Decision Making: Benchmarks and Additional Opinionscited by 250
  13. 2023Text2Room: Extracting Textured 3D Meshes from 2D Text-to-Image Modelscited by 245
  14. 2023LucidDreamer: Domain-free Generation of 3D Gaussian Splatting Scenescited by 228
  15. 2023AutoAgents: A Framework for Automatic Agent Generationcited by 211
  16. 2023MVDiffusion: Enabling Holistic Multi-view Image Generation with Correspondence-Aware Diffusioncited by 210
  17. 2021ATISS: Autoregressive Transformers for Indoor Scene Synthesiscited by 195
  18. 2023OpenShape: Scaling Up 3D Shape Representation Towards Open-World Understandingcited by 183
  19. 2023JARVIS-1: Open-World Multi-task Agents with Memory-Augmented Multimodal Language Modelscited by 170
  20. 2023SwiftSage: A Generative Agent with Fast and Slow Thinking for Complex Interactive Taskscited by 166
  21. 2023SceneScape: Text-Driven Consistent Scene Generationcited by 160
  22. 2023WonderJourney: Going from Anywhere to Everywherecited by 157
  23. 2020SceneFormer: Indoor Scene Generation with Transformerscited by 154
  24. 2024GPT-4V(ision) is a Human-Aligned Evaluator for Text-to-3D Generationcited by 151
  25. 2022GAUDI: A Neural Architect for Immersive 3D Scene Generationcited by 136
  26. 2019Meta-Sim: Learning to Generate Synthetic Datasetscited by 128
  27. 2023Consistent View Synthesis with Pose-Guided Diffusion Modelscited by 117
  28. 2023GeneGPT: Augmenting Large Language Models with Domain Tools for Improved Access to Biomedical Informationcited by 115
  29. 2024InstructScene: Instruction-Driven 3D Indoor Scene Synthesis with Semantic Graph Priorcited by 110
  30. 2018InteriorNet: Mega-scale Multi-sensor Photo-realistic Indoor Scenes Datasetcited by 87
  31. 2023AnyHome: Open-Vocabulary Generation of Structured and Textured 3D Homescited by 81
  32. 2023LEGO-Net: Learning Regular Rearrangements of Objects in Roomscited by 75
  33. 2018Human-centric Indoor Scene Synthesis Using Stochastic Grammarcited by 73
  34. 2023Ctrl-Room: Controllable Text-to-3D Room Meshes Generation with Layout Constraintscited by 59
  35. 2022DiffDreamer: Towards Consistent Unsupervised Single-view Scene Extrapolation with Conditional Diffusion Modelscited by 51
  36. 2015Text to 3D Scene Generation with Rich Lexical Groundingcited by 36
  37. 2023Make-It-4D: Synthesizing a Consistent Long-Term Dynamic Scene Video from a Single Imagecited by 19
  38. 2023Breathing New Life into 3D Assets with Generative Repaintingcited by 17

50 most cited of 53 All 53 (JSON)

Built on by

Cited by year (2026 to 7 Oct)

Citing papers per year: 2024: 5; 2025: 35; 2026: 47.

87 papers.

Sort:

By area:

  1. 2024LayoutVLM: Differentiable Optimization of 3D Layout via Vision-Language Modelscited by 94
  2. 2025SceneWeaver: All-in-One 3D Scene Synthesis with an Extensible and Self-Reflective Agentcited by 53
  3. 2025MetaSpatial: Reinforcing 3D Spatial Reasoning in VLMs for the Metaversecited by 50
  4. 2026SAGE: Scalable Agentic 3D Scene Generation for Embodied AIcited by 40
  5. 2024LLplace: The 3D Indoor Scene Layout Generation and Editing via Large Language Modelcited by 34
  6. 2025FlashWorld: High-quality 3D Scene Generation within Secondscited by 30
  7. 2025Direct Numerical Layout Generation for 3D Indoor Scene Synthesis via Spatial Reasoningcited by 27
  8. 2025SceneEval: Evaluating Semantic Coherence in Text-Conditioned 3D Indoor Scene Synthesiscited by 26
  9. 20253D Scene Generation: A Surveycited by 24
  10. 2025FlairGPT: Repurposing LLMs for Interior Designscited by 22
  11. 2025HSM: Hierarchical Scene Motifs for Multi-Scale Indoor Scene Generationcited by 22
  12. 2025MMGDreamer: Mixed-Modality Graph for Geometry-Controllable 3D Indoor Scene Generationcited by 18
38 more
  1. 2025Large Language Models for Computer-Aided Design: A Surveycited by 16
  2. 2025MesaTask: Towards Task-Driven Tabletop Scene Generation via 3D Spatial Reasoningcited by 15
  3. 2025OptiScene: LLM-driven Indoor Scene Layout Generation via Scaled Human-aligned Data Synthesis and Multi-Stage Preference Optimizationcited by 14
  4. 2025HOLODECK 2.0: Vision-Language-Guided 3D World Generation with Editingcited by 14
  5. 2025FROSS: Faster-than-Real-Time Online 3D Semantic Scene Graph Generation from RGB-D Imagescited by 10
  6. 2024Text2BIM: Generating Building Models Using a Large Language Model-based Multi-Agent Frameworkcited by 9
  7. 2025Yo'City: Personalized and Boundless 3D Realistic City Scene Generation via Self-Critic Expansioncited by 8
  8. 2024GRASP: A Grid-Based Benchmark for Evaluating Commonsense Spatial Reasoningcited by 7
  9. 2025Video Perception Models for 3D Scene Synthesiscited by 7
  10. 2025SemLayoutDiff: Semantic Layout Generation with Diffusion Model for Indoor Scene Synthesiscited by 6
  11. 2026WorldClaw: Agentic 3D Open-World Generation at Scalecited by 6
  12. 2025ReSpace: Text-Driven Autoregressive 3D Indoor Scene Synthesis and Editingcited by 5
  13. 2025DisCo-Layout: Disentangling and Coordinating Semantic and Physical Refinement in a Multi-Agent Framework for 3D Indoor Layout Synthesiscited by 5
  14. 2026SceneAssistant: A Visual Feedback Agent for Open-Vocabulary 3D Scene Generationcited by 5
  15. 2026Code-as-Room: Generating 3D Rooms from Top-Down View Images via Agentic Code Synthesiscited by 5
  16. 2025ScanEdit: Hierarchically-Guided Functional 3D Scan Editingcited by 4
  17. 2025HLG: Comprehensive 3D Room Construction via Hierarchical Layout Generationcited by 4
  18. 2026TowerMind: A Tower Defence Game Learning Environment and Benchmark for LLM as Agentscited by 4
  19. 2026FlowScene: Style-Consistent Indoor Scene Generation with Multimodal Graph Rectified Flowcited by 4
  20. 2024A Misleading Gallery of Fluid Motion by Generative Artificial Intelligencecited by 3
  21. 20253D-Generalist: Self-Improving Vision-Language-Action Models for Crafting 3D Worldscited by 3
  22. 20253D Software Synthesis Driven by Constraint-Expressive Intermediate Representationcited by 3
  23. 2025IL3D: A Large-Scale Indoor Layout Dataset for LLM-Driven 3D Scene Generationcited by 3
  24. 2025Self-Evolving 3D Scene Generation from a Single Imagecited by 3
  25. 2026SceneLinker: Compositional 3D Scene Generation via Semantic Scene Graph from RGB Sequencescited by 3
  26. 2026Edit-As-Act: Goal-Regressive Planning for Open-Vocabulary 3D Indoor Scene Editingcited by 3
  27. 2026StoryBlender: Inter-Shot Consistent and Editable 3D Storyboard with Spatial-temporal Dynamicscited by 3
  28. 2026Repurposing 3D Generative Model for Autoregressive Layout Generationcited by 3
  29. 2026LychSim: A Controllable and Interactive Simulation Framework for Vision Researchcited by 3
  30. 2025Constructing a 3D Scene from a Single Imagecited by 2
  31. 2025TabletopGen: Tabletop Scene Generation and Interactive Simulation for Robotic Manipulationcited by 2
  32. 2026SceneNAT: Masked Generative Modeling for Language-Guided Indoor Scene Synthesiscited by 2
  33. 2026SceneCritic: A Symbolic Evaluator for 3D Indoor Scene Synthesiscited by 2
  34. 2026SceneOrchestra: Efficient Agentic 3D Scene Synthesis via Full Tool-Call Trajectory Generationcited by 2
  35. 2026STABLE: Simulation-Ready Tabletop Layout Generation via a Semantics-Physics Dual Systemcited by 2
  36. 2026HDSL: A Hierarchical Domain-Specific Language for Structured 3D Indoor Scene Generation and Localized Editing with LLM Agentscited by 2
  37. 2025AccioScene: Compositional 3D Scene Generation via Graph Diffusion and Interaction-driven Criticscited by 1
  38. 2025AutoLayout: Closed-Loop Layout Synthesis via Slow-Fast Collaborative Reasoningcited by 1

50 most cited of 87 All 87 (JSON)

Similar, not cited

Close in wording, no citation either way

  1. 2024Chat2Layout: Interactive 3D Furniture Layout with a Multimodal LLM
  2. 2025Co-Layout: LLM-driven Co-optimization for Interior Layout
  3. 2025DecoMind: A Generative AI System for Personalized Interior Design Layouts
  4. 2025Text Semantics to Flexible Design: A Residential Layout Generation Method Based on Stable Diffusion Model
  5. 2024ChatHouseDiffusion: Prompt-Guided Generation and Editing of Floor Plans
  6. 2024Mediating Modes of Thought: LLM's for design scripting
  7. 2025Decorum: A Language-Based Approach For Style-Conditioned Synthesis of Indoor 3D Scenes
  8. 2024Layout Generation Agents with Large Language Models