HomeWorld: A Unified Floorplan-to-Furnished Framework for Generating Controllable, Densely Interactive Whole-Home Scenes
Not on the map. Why?
Abstract (arXiv)
Indoor scene generation is crucial for robot simulation and modern interior design. However, complex layouts together with scarce 3D scene data make learning-based generation challenging. Existing methods often rely on hand-crafted rules or focus on isolated sub-tasks (e.g., floorplan synthesis or single-room furnishing), producing whole-home scenes that lack global coherence, realism, and simulation readiness. To mitigate these limitations, we propose a unified hierarchical framework that decomposes indoor scene synthesis into controllable stages. First, we curate a large-scale dataset of 300K real residential floorplans to train a large language model for whole-home floorplan generation. With detailed descriptions and a K-D tree-based representation, our method enables fine-grained, controllable whole-home floorplan generation. Building upon the generated whole-home floorplan, we leverage image generation models to draft furniture layouts from multi-level roaming viewpoints, and then generate the layouts of small manipulable objects on different supporting surfaces (e.g., cabinets, desks, and dining tables) for embodied AI simulation. During furniture and object layout generation, a VLM-based refiner iteratively corrects furniture and object placement, and a 3D generative model enables flexible replacement of individual assets. We further attach basic physical attributes and simple surface texture and lighting setups to complete the pipeline for embodied AI use. Experiments and user studies demonstrate that our pipeline produces indoor spaces with greater layout diversity and stronger 3D design appeal, outperforming prior methods on both quantitative and qualitative metrics. Finally, alongside our generation pipeline, we will release the floorplan dataset and 5K fully furnished scenes to the community. Project Page: https://kairos-homeworld.github.io/
Key facts. No citing papers in the map yet (data through 14 Oct 2026). Builds on 32 of its 38 references that are in the map. First posted on arXiv 4 Jun 2026.
Builds on
32 of 38 references.
References · 32
- 2025Qwen3 Technical Reportcited by 8,820
- 2017ScanNet: Richly-annotated 3D Reconstructions of Indoor Scenescited by 3,117
- 2017Matterport3D: Learning from RGB-D Data in Indoor Environmentscited by 1,376
- 2025SAM 3: Segment Anything with Conceptscited by 906
- 20203D-FRONT: 3D Furnished Rooms with layOuts and semaNTicscited by 380
- 2022ProcTHOR: Large-Scale Embodied AI Using Procedural Generationcited by 380
- 2023LayoutGPT: Compositional Visual Planning and Generation with Large Language Modelscited by 347
- 2019Structured3D: A Large Photo-realistic Dataset for Structured 3D Modelingcited by 286
- 2023Holodeck: Language Guided Generation of 3D Embodied AI Environmentscited by 268
- 2025SAM 3D: 3Dfy Anything in Imagescited by 247
- 2023Text2Room: Extracting Textured 3D Meshes from 2D Text-to-Image Modelscited by 245
- 2023LucidDreamer: Domain-free Generation of 3D Gaussian Splatting Scenescited by 231
20 more
- 2023DiffuScene: Denoising Diffusion Models for Generative Indoor Scene Synthesiscited by 166
- 2024Infinigen Indoors: Photorealistic Indoor Scenes using Procedural Generationcited by 137
- 2024SceneVerse: Scaling 3D Vision-Language Learning for Grounded Scene Understandingcited by 133
- 2024PhyScene: Physically Interactable 3D Scene Synthesis for Embodied AIcited by 125
- 2024MIDI: Multi-Instance Diffusion for Single Image to 3D Scene Generationcited by 117
- 2024LayoutVLM: Differentiable Optimization of 3D Layout via Vision-Language Modelscited by 96
- 2024I-Design: Personalized LLM Interior Designercited by 87
- 2024BlockFusion: Expandable 3D Scene Generation using Latent Tri-plane Extrapolationcited by 83
- 2017MINOS: Multimodal Indoor Simulator for Navigation in Complex Environmentscited by 66
- 2025PhysX-Anything: Simulation-Ready Physical 3D Assets from Single Imagecited by 37
- 2025EmbodiedGen: Towards a Generative 3D World Engine for Embodied Intelligencecited by 36
- 2024LLplace: The 3D Indoor Scene Layout Generation and Editing via Large Language Modelcited by 34
- 2024SceneFactor: Factored Latent 3D Diffusion for Controllable 3D Scene Generationcited by 24
- 2023DiffInDScene: Diffusion-based High-Quality 3D Indoor Scene Generationcited by 23
- 2025WorldCraft: Photo-Realistic 3D World Creation and Customization via LLM Agentscited by 21
- 2025InternScenes: A Large-scale Simulatable Indoor Scene Dataset with Realistic Layoutscited by 20
- 2024MSD: A Benchmark Dataset for Floor Plan Generation of Building Complexescited by 14
- 2025CHOrD: Generation of Collision-Free, House-Scale, and Organized Digital Twins for 3D Indoor Scenes with Controllable Floor Plans and Optimal Layoutscited by 10
- 2024HouseCrafter: Lifting Floorplans to 3D Scenes with 2D Diffusion Modelcited by 9
- 2025ResPlan: A Large-Scale Vector-Graph Dataset of 17,000 Residential Floor Planscited by 8
Built on by
Not cited yet.
Similar, not cited
Close in wording, no citation either way
- 2021ATISS: Autoregressive Transformers for Indoor Scene Synthesis
- 2026SceneSmith: Agentic Generation of Simulation-Ready Indoor Scenes
- 2026MANSION: Multi-floor lANguage-to-3D Scene generatIOn for loNg-horizon tasks
- 2025OptiScene: LLM-driven Indoor Scene Layout Generation via Scaled Human-aligned Data Synthesis and Multi-Stage Preference Optimization
- 2026Directly from Alpha to Omega: Controllable End-to-End Vector Floor Plan Generation ↗
- 2025RoomCraft: Controllable and Complete 3D Indoor Scene Generation
- 20263D Scene Graph Prediction: Generating Hierarchical Models from Partially Observed Environments
- 2025M3DLayout: A Multi-Source Dataset of 3D Indoor Layouts and Structured Descriptions for 3D Generation