mlsanityData to 7 Oct 2026

SceneFoundry: Generating Interactive Infinite 3D Worlds

arXiv 2601.05810 ↗First posted 9 Jan 2026cs.CV cs.AI cs.LGcited by 4

Not on the map. Why?

Abstract (arXiv)

The ability to automatically generate large-scale, interactive, and physically realistic 3D environments is crucial for advancing robotic learning and embodied intelligence. However, existing generative approaches often fail to capture the functional complexity of real-world interiors, particularly those containing articulated objects with movable parts essential for manipulation and navigation. This paper presents SceneFoundry, a language-guided diffusion framework that generates apartment-scale 3D worlds with functionally articulated furniture and semantically diverse layouts for robotic training. From natural language prompts, an LLM module controls floor layout generation, while diffusion-based posterior sampling efficiently populates the scene with articulated assets from large-scale 3D repositories. To ensure physical usability, SceneFoundry employs differentiable guidance functions to regulate object quantity, prevent articulation collisions, and maintain sufficient walkable space for robotic navigation. Extensive experiments demonstrate that our framework generates structurally valid, semantically coherent, and functionally interactive environments across diverse scene types and conditions, enabling scalable embodied AI research. project page: https://anc891203.github.io/SceneFoundry-Demo/

Key facts. Cited by 4 papers in the map (data through 7 Oct 2026). Builds on 10 of its 15 references that are in the map. First posted on arXiv 9 Jan 2026.

Builds on

10 of 15 references.

References · 10

  1. 2021Diffusion Models Beat GANs on Image Synthesiscited by 8,185
  2. 2022Classifier-Free Diffusion Guidancecited by 5,717
  3. 2017Matterport3D: Learning from RGB-D Data in Indoor Environmentscited by 1,354
  4. 2019Habitat: A Platform for Embodied AI Researchcited by 1,163
  5. 20203D-FUTURE: 3D Furniture shape with TextUREcited by 306
  6. 2023DiffuScene: Denoising Diffusion Models for Generative Indoor Scene Synthesiscited by 159
  7. 2024Infinigen Indoors: Photorealistic Indoor Scenes using Procedural Generationcited by 129
  8. 2024PhyScene: Physically Interactable 3D Scene Synthesis for Embodied AIcited by 116
  9. 2023GenAug: Retargeting behaviors to unseen situations via Generative Augmentationcited by 103
  10. 2024S-INF: Towards Realistic Indoor Scene Synthesis via Scene Implicit Neural Fieldcited by 3

Built on by

Cited by year (2026 to 7 Oct)

Citing papers per year: 2026: 4.

4 papers.

Similar, not cited

Close in wording, no citation either way

  1. 2025Scenethesis: A Language and Vision Agentic Framework for 3D Scene Generation
  2. 2026SceneSmith: Agentic Generation of Simulation-Ready Indoor Scenes
  3. 2026SceneCode: Executable World Programs for Editable Indoor Scenes with Articulated Objects
  4. 2025SceneWeaver: All-in-One 3D Scene Synthesis with an Extensible and Self-Reflective Agent
  5. 2026RoboLayout: Differentiable 3D Scene Generation for Embodied Agents
  6. 2026MANSION: Multi-floor lANguage-to-3D Scene generatIOn for loNg-horizon tasks
  7. 2024Architect: Generating Vivid and Interactive 3D Scenes with Hierarchical 2D Inpainting
  8. 2025LayoutAgent: A Vision-Language Agent Guided Compositional Diffusion for Spatial Layout Planning