RoomPlanner: Explicit Layout Planner for Easier LLM-Driven 3D Room Generation
Not on the map. Why?
Abstract (arXiv)
In this paper, we propose RoomPlanner, the first fully automatic 3D room generation framework for painlessly creating realistic indoor scenes with only short text as input. Without any manual layout design or panoramic image guidance, our framework can generate explicit layout criteria for rational spatial placement. We begin by introducing a hierarchical structure of language-driven agent planners that can automatically parse short and ambiguous prompts into detailed scene descriptions. These descriptions include raw spatial and semantic attributes for each object and the background, which are then used to initialize 3D point clouds. To position objects within bounded environments, we implement two arrangement constraints that iteratively optimize spatial arrangements, ensuring a collision-free and accessible layout solution. In the final rendering stage, we propose a novel AnyReach Sampling strategy for camera trajectory, along with the Interval Timestep Flow Sampling (ITFS) strategy, to efficiently optimize the coarse 3D Gaussian scene representation. These approaches help reduce the total generation time to under 30 minutes. Extensive experiments demonstrate that our method can produce geometrically rational 3D indoor scenes, surpassing prior approaches in both rendering speed and visual quality while preserving editability. The code will be available soon.
Key facts. Cited by 1 paper in the map (data through 7 Oct 2026). Builds on 25 of its 38 references that are in the map. First posted on arXiv 21 Nov 2025.
Builds on
25 of 38 references.
References · 25
- 2020Denoising Diffusion Probabilistic Modelscited by 20,851
- 2020Denoising Diffusion Implicit Modelscited by 9,655
- 20233D Gaussian Splatting for Real-Time Radiance Field Renderingcited by 6,141
- 2024Scaling Rectified Flow Transformers for High-Resolution Image Synthesiscited by 4,094
- 2021CLIPScore: A Reference-free Evaluation Metric for Image Captioningcited by 2,388
- 2023ProlificDreamer: High-Fidelity and Diverse Text-to-3D Generation with Variational Score Distillationcited by 1,207
- 2024Structured 3D Latents for Scalable and Versatile 3D Generationcited by 742
- 2022Point-E: A System for Generating 3D Point Clouds from Complex Promptscited by 694
- 2023Shap-E: Generating Conditional 3D Implicit Functionscited by 379
- 2023LayoutGPT: Compositional Visual Planning and Generation with Large Language Modelscited by 337
- 2023LucidDreamer: Towards High-Fidelity Text-to-3D Generation via Interval Score Matchingcited by 290
- 2023Holodeck: Language Guided Generation of 3D Embodied AI Environmentscited by 257
13 more
- 2024WonderWorld: Interactive 3D Scene Generation from a Single Imagecited by 197
- 2023DiffuScene: Denoising Diffusion Models for Generative Indoor Scene Synthesiscited by 159
- 2023EmbodiedScan: A Holistic Multi-Modal 3D Perception Suite Towards Embodied AIcited by 146
- 2024URDFormer: A Pipeline for Constructing Articulated Simulation Environments from Real-World Imagescited by 106
- 2023GraphDreamer: Compositional 3D Scene Synthesis from Scene Graphscited by 96
- 2023Set-the-Scene: Global-Local Training for Generating Controllable NeRF Scenescited by 75
- 2024DreamScene: 3D Gaussian-based Text-to-3D Scene Generation via Formation Pattern Samplingcited by 72
- 2024Director3D: Real-world Camera Trajectory and 3D Scene Generation from Textcited by 50
- 2024SceneTeller: Language-to-3D Scene Generationcited by 43
- 2024DeBaRA: Denoising-Based 3D Room Arrangement Generationcited by 20
- 2024Pano2Room: Novel View Synthesis from a Single Indoor Panoramacited by 16
- 2024Forest2Seq: Revitalizing Order Prior for Sequential Indoor Scene Synthesiscited by 12
- 2025Scene4U: Hierarchical Layered 3D Scene Reconstruction from Single Panoramic Image for Your Immerse Explorationcited by 11
Built on by
Citing papers per year: 2026: 1.
1 paper.