I-Scene: 3D Instance Models are Implicit Generalizable Spatial Learners
Not on the map. Why?
Abstract (arXiv)
Generalization remains the central challenge for interactive 3D scene generation. Existing learning-based approaches ground spatial understanding in limited scene dataset, restricting generalization to new layouts. We instead reprogram a pre-trained 3D instance generator to act as a scene level learner, replacing dataset-bounded supervision with model-centric spatial supervision. This reprogramming unlocks the generator transferable spatial knowledge, enabling generalization to unseen layouts and novel object compositions. Remarkably, spatial reasoning still emerges even when the training scenes are randomly composed objects. This demonstrates that the generator's transferable scene prior provides a rich learning signal for inferring proximity, support, and symmetry from purely geometric cues. Replacing widely used canonical space, we instantiate this insight with a view-centric formulation of the scene space, yielding a fully feed-forward, generalizable scene generator that learns spatial relations directly from the instance model. Quantitative and qualitative results show that a 3D instance generator is an implicit spatial learner and reasoner, pointing toward foundation models for interactive 3D scene understanding and generation. Project page: https://luling06.github.io/I-Scene-project/
Key facts. Cited by 6 papers in the map (data through 7 Oct 2026). Builds on 31 of its 32 references that are in the map. First posted on arXiv 15 Dec 2025.
Builds on
31 of 32 references.
References · 31
- 2023Segment Anythingcited by 8,158
- 2022Objaverse: A Universe of Annotated 3D Objectscited by 1,522
- 2023ScanNet++: A High-Fidelity Dataset of 3D Indoor Scenescited by 747
- 2024Structured 3D Latents for Scalable and Versatile 3D Generationcited by 742
- 2023DL3DV-10K: A Large-Scale Scene Dataset for Deep Learning-based 3D Visioncited by 514
- 20203D-FRONT: 3D Furnished Rooms with layOuts and semaNTicscited by 375
- 2023LayoutGPT: Compositional Visual Planning and Generation with Large Language Modelscited by 337
- 2021Neural RGB-D Surface Reconstructioncited by 312
- 2023Holodeck: Language Guided Generation of 3D Embodied AI Environmentscited by 257
- 2024TripoSR: Fast 3D Object Reconstruction from a Single Imagecited by 227
- 2024WonderWorld: Interactive 3D Scene Generation from a Single Imagecited by 197
- 2021ATISS: Autoregressive Transformers for Indoor Scene Synthesiscited by 195
19 more
- 2023DiffuScene: Denoising Diffusion Models for Generative Indoor Scene Synthesiscited by 159
- 2020SceneFormer: Indoor Scene Generation with Transformerscited by 154
- 2024PhyScene: Physically Interactable 3D Scene Synthesis for Embodied AIcited by 116
- 2024MIDI: Multi-Instance Diffusion for Single Image to 3D Scene Generationcited by 113
- 2024MV-Adapter: Multi-view Consistent Image Generation Made Easycited by 111
- 2024GALA3D: Towards Text-to-3D Complex Scene Generation via Layout-guided Generative Gaussian Splattingcited by 104
- 2025CAST: Component-Aligned 3D Scene Reconstruction from an RGB Imagecited by 101
- 2024Wonderland: Navigating 3D Scenes from a Single Imagecited by 98
- 2025PartCrafter: Structured 3D Mesh Generation via Compositional Latent Diffusion Transformerscited by 78
- 2025Scenethesis: A Language and Vision Agentic Framework for 3D Scene Generationcited by 65
- 2024Gen3DSR: Generalizable 3D Scene Reconstruction via Divide and Conquer from a Single Viewcited by 59
- 2025SceneWeaver: All-in-One 3D Scene Synthesis with an Extensible and Self-Reflective Agentcited by 53
- 2025SceneGen: Single-Image 3D Scene Generation in One Feedforward Passcited by 49
- 2024REPARO: Compositional 3D Assets Generation with Differentiable 3D Layout Alignmentcited by 45
- 2024Zero-Shot Scene Reconstruction from Single Images with Deep Prior Assemblycited by 34
- 2024Mixed Diffusion for 3D Indoor Scene Synthesiscited by 30
- 2025WorldExplorer: Towards Generating Fully Navigable 3D Scenescited by 26
- 2024MegaSynth: Scaling Up 3D Scene Reconstruction with Synthesized Datacited by 21
- 2024DeBaRA: Denoising-Based 3D Room Arrangement Generationcited by 20
Built on by
Citing papers per year: 2026: 6.
6 papers.
- 2026PhyMix: Towards Physically Consistent Single-Image 3D Indoor Scene Generation with Implicit--Explicit Optimizationcited by 2
- 2026One Video, One World: Turning Monocular Video into Physical 4D Scenescited by 2
- 2026Scene-SAM3D: Multi-View Scene Asset Generation Without Fine-Tuningcited by 0
- 2026Mira-Scene: Pixel-Aligned Layouts for Generative 3D Scene Reconstructioncited by 0
- 2026Fysiverse-3D-Vision Technical Report: Generating Executable 3D Worlds from Images through Unified Spatial Reasoningcited by 0
- 2026SPOON: Towards Coherent Compositional 3D Scene Generation from Uncalibrated Multi-view Imagescited by 0
- 2026SPOON: Towards Coherent Compositional 3D Scene Generation from Uncalibrated Multi-view Images30 Sep 2026
- 2026Fysiverse-3D-Vision Technical Report: Generating Executable 3D Worlds from Images through Unified Spatial Reasoning22 Sep 2026
- 2026Mira-Scene: Pixel-Aligned Layouts for Generative 3D Scene Reconstruction20 Sep 2026
- 2026Scene-SAM3D: Multi-View Scene Asset Generation Without Fine-Tuning18 Jul 2026
- 2026One Video, One World: Turning Monocular Video into Physical 4D Scenes30 Jun 2026
- 2026PhyMix: Towards Physically Consistent Single-Image 3D Indoor Scene Generation with Implicit--Explicit Optimization11 Apr 2026
Similar, not cited
Close in wording, no citation either way
- 2026Pair2Scene: Learning Local Object Relations for Procedural Scene Generation
- 2026Flame3D: Zero-shot Compositional Reasoning of 3D Scenes with Agentic Language Models
- 2025Seeing through Imagination: Learning Scene Geometry via Implicit Spatial World Modeling
- 2025Spatial Understanding from Videos: Structured Prompts Meet Simulation Data
- 2026SSR: Pushing the Limit of Spatial Intelligence with Structured Scene Reasoning
- 2025Direct Numerical Layout Generation for 3D Indoor Scene Synthesis via Spatial Reasoning
- 2026SpaceEra++: A Unified Framework Towards 3D Spatial Reasoning in Video
- 2024SceneGPT: A Language Model for 3D Scene Understanding