mlsanityData to 7 Oct 2026

Text-Driven 3D Indoor Scene Synthesis in Non-Manhattan Environments

arXiv 2607.02407 ↗First posted 2 Jul 2026cs.AI cs.CVcited by 0

Not on the map. Why?

Abstract (arXiv)

Large Language Models (LLMs) have demonstrated remarkable capabilities in 3D indoor synthesis for Manhattan environments. However, existing methods often fail to capture plausible object layout patterns in non-Manhattan settings, primarily because they struggle to model non-orthogonal spatial relationships, leading to high geometric violations and low physical fidelity. To address this challenge, we propose SPG-Layout, a novel text-driven framework designed to generate physically plausible indoor scenes within complex non-Manhattan environments. Specifically, we first utilize statistical priors of object distributions to guide the training process, enhancing environmental understanding and fidelity. Furthermore, mirroring human design workflows, we adopt a hierarchical layout strategy that prioritizes the placement of large objects, thereby substantially minimizing layout violations. By synergizing these components, SPG-Layout achieves a balanced optimization of semantic realism and physical plausibility. To evaluate performance in these complex settings, we constructed a new benchmark comprising 500 diverse non-Manhattan environments. Extensive experiments demonstrate that SPG-Layout consistently and significantly outperforms existing methods across both Manhattan and non-Manhattan environments. The code will be publicly released.

Key facts. No citing papers in the map yet (data through 7 Oct 2026). Builds on 30 of its 41 references that are in the map. First posted on arXiv 2 Jul 2026.

Builds on

30 of 41 references.

References · 30

  1. 2024DeepSeekMath: Pushing the Limits of Mathematical Reasoning in Open Language Modelscited by 8,851
  2. 20203D-FRONT: 3D Furnished Rooms with layOuts and semaNTicscited by 375
  3. 2019Structured3D: A Large Photo-realistic Dataset for Structured 3D Modelingcited by 285
  4. 2023Holodeck: Language Guided Generation of 3D Embodied AI Environmentscited by 257
  5. 2023RoboGen: Towards Unleashing Infinite Data for Automated Robot Learning via Generative Simulationcited by 206
  6. 2021ATISS: Autoregressive Transformers for Indoor Scene Synthesiscited by 195
  7. 2023DiffuScene: Denoising Diffusion Models for Generative Indoor Scene Synthesiscited by 159
  8. 2020SceneFormer: Indoor Scene Generation with Transformerscited by 154
  9. 2024PhyScene: Physically Interactable 3D Scene Synthesis for Embodied AIcited by 116
  10. 2024InstructScene: Instruction-Driven 3D Indoor Scene Synthesis with Semantic Graph Priorcited by 110
  11. 2019HorizonNet: Learning Room Layout with 1D Representation and Pano Stretch Data Augmentationcited by 107
  12. 2018Fast and Flexible Indoor Scene Synthesis via Deep Convolutional Generative Modelscited by 105
18 more
  1. 2024I-Design: Personalized LLM Interior Designercited by 87
  2. 2023AnyHome: Open-Vocabulary Generation of Structured and Textured 3D Homescited by 81
  3. 2023LEGO-Net: Learning Regular Rearrangements of Objects in Roomscited by 75
  4. 2018Human-centric Indoor Scene Synthesis Using Stochastic Grammarcited by 73
  5. 2024EchoScene: Indoor Scene Generation via Information Echo over Scene Graph Diffusioncited by 66
  6. 2023Ctrl-Room: Controllable Text-to-3D Room Meshes Generation with Layout Constraintscited by 59
  7. 2025SceneWeaver: All-in-One 3D Scene Synthesis with an Extensible and Self-Reflective Agentcited by 53
  8. 2019CubiCasa5K: A Dataset and an Improved Multi-Task Model for Floorplan Image Analysiscited by 49
  9. 2025MiMo-Embodied: X-Embodied Foundation Model Technical Reportcited by 36
  10. 2024Mixed Diffusion for 3D Indoor Scene Synthesiscited by 30
  11. 2025SceneEval: Evaluating Semantic Coherence in Text-Conditioned 3D Indoor Scene Synthesiscited by 26
  12. 2025FlairGPT: Repurposing LLMs for Interior Designscited by 22
  13. 2024Chat2Layout: Interactive 3D Furniture Layout with a Multimodal LLMcited by 20
  14. 2024DeBaRA: Denoising-Based 3D Room Arrangement Generationcited by 20
  15. 2024Hazards in Daily Life? Enabling Robots to Proactively Detect and Resolve Anomaliescited by 19
  16. 2018Fast and Scalable Position-Based Layout Synthesiscited by 15
  17. 2025CasaGPT: Cuboid Arrangement and Scene Assembly for Interior Designcited by 14
  18. 2024SceneGenAgent: Precise Industrial Scene Generation with Coding Agentcited by 12

Built on by

Not cited yet.