SceneFoundry: Generating Interactive Infinite 3D Worlds
Not on the map. Why?
Abstract (arXiv)
The ability to automatically generate large-scale, interactive, and physically realistic 3D environments is crucial for advancing robotic learning and embodied intelligence. However, existing generative approaches often fail to capture the functional complexity of real-world interiors, particularly those containing articulated objects with movable parts essential for manipulation and navigation. This paper presents SceneFoundry, a language-guided diffusion framework that generates apartment-scale 3D worlds with functionally articulated furniture and semantically diverse layouts for robotic training. From natural language prompts, an LLM module controls floor layout generation, while diffusion-based posterior sampling efficiently populates the scene with articulated assets from large-scale 3D repositories. To ensure physical usability, SceneFoundry employs differentiable guidance functions to regulate object quantity, prevent articulation collisions, and maintain sufficient walkable space for robotic navigation. Extensive experiments demonstrate that our framework generates structurally valid, semantically coherent, and functionally interactive environments across diverse scene types and conditions, enabling scalable embodied AI research. project page: https://anc891203.github.io/SceneFoundry-Demo/
Key facts. Cited by 4 papers in the map (data through 7 Oct 2026). Builds on 10 of its 15 references that are in the map. First posted on arXiv 9 Jan 2026.
Builds on
10 of 15 references.
References · 10
- 2021Diffusion Models Beat GANs on Image Synthesiscited by 8,185
- 2022Classifier-Free Diffusion Guidancecited by 5,717
- 2017Matterport3D: Learning from RGB-D Data in Indoor Environmentscited by 1,354
- 2019Habitat: A Platform for Embodied AI Researchcited by 1,163
- 20203D-FUTURE: 3D Furniture shape with TextUREcited by 306
- 2023DiffuScene: Denoising Diffusion Models for Generative Indoor Scene Synthesiscited by 159
- 2024Infinigen Indoors: Photorealistic Indoor Scenes using Procedural Generationcited by 129
- 2024PhyScene: Physically Interactable 3D Scene Synthesis for Embodied AIcited by 116
- 2023GenAug: Retargeting behaviors to unseen situations via Generative Augmentationcited by 103
- 2024S-INF: Towards Realistic Indoor Scene Synthesis via Scene Implicit Neural Fieldcited by 3
Built on by
Citing papers per year: 2026: 4.
4 papers.
- 2026REST3D: Reconstructing Physically Stable 3D Scenes from a Single Imagecited by 6
- 2026SceneCritic: A Symbolic Evaluator for 3D Indoor Scene Synthesiscited by 2
- 20263D Generation for Embodied AI and Robotic Simulation: A Surveycited by 0
- 2026VoxScene: Anchor-Conditioned Voxel Diffusion for Indoor Scene Arrangementcited by 0
- 2026REST3D: Reconstructing Physically Stable 3D Scenes from a Single Image28 May 2026
- 2026VoxScene: Anchor-Conditioned Voxel Diffusion for Indoor Scene Arrangement16 May 2026
- 20263D Generation for Embodied AI and Robotic Simulation: A Survey29 Apr 2026
- 2026SceneCritic: A Symbolic Evaluator for 3D Indoor Scene Synthesis14 Apr 2026
Similar, not cited
Close in wording, no citation either way
- 2025Scenethesis: A Language and Vision Agentic Framework for 3D Scene Generation
- 2026SceneSmith: Agentic Generation of Simulation-Ready Indoor Scenes
- 2026SceneCode: Executable World Programs for Editable Indoor Scenes with Articulated Objects
- 2025SceneWeaver: All-in-One 3D Scene Synthesis with an Extensible and Self-Reflective Agent
- 2026RoboLayout: Differentiable 3D Scene Generation for Embodied Agents
- 2026MANSION: Multi-floor lANguage-to-3D Scene generatIOn for loNg-horizon tasks
- 2024Architect: Generating Vivid and Interactive 3D Scenes with Hierarchical 2D Inpainting
- 2025LayoutAgent: A Vision-Language Agent Guided Compositional Diffusion for Spatial Layout Planning