mlsanityData to 14 Oct 2026

InSpace: Structure-Aware 3D Indoor Scene Generation from a Single 360deg Image

arXiv 2607.03990 ↗First posted 4 Jul 2026cs.CVcited by 0

Not on the map. Why?

Abstract (arXiv)

Recent advances in single image-to-3D generation have enabled high-quality asset synthesis, yet extending these capabilities to indoor scene generation remains challenging. Existing methods focus on asset-level generation while neglecting the structural layout, which is essential for downstream applications and serves as the spatial anchor for grounding assets. However, a single image with a limited field of view lacks the spatial coverage to recover a coherent global layout. To this end, we use a 360deg image represented in equirectangular projection (ERP) and propose InSpace, a structure-aware framework for 3D indoor scene generation. InSpace comprises three stages: (1) estimating partial scene geometry as spatial priors, (2) generating coarse scene structure with view-selective cross-attention, and (3) producing detailed layout and asset geometry with textures through a global-local hybrid attention, using flow matching. We also propose ERP-FRONT, a paired ERP-Image-to-3D indoor scene dataset based on 3D-FRONT. Experiments show that InSpace generates complete 3D indoor scenes with structural layout, along with separate textured assets from a single ERP image, achieving strong performance across 3D and 2D metrics. Project Page: https://kookie12.github.io/InSpace-Project-Page/

Key facts. No citing papers in the map yet (data through 14 Oct 2026). Builds on 70 of its 78 references that are in the map. First posted on arXiv 4 Jul 2026.

Builds on

70 of 78 references.

References · 70

  1. 2021High-Resolution Image Synthesis with Latent Diffusion Modelscited by 18,863
  2. 2023Segment Anythingcited by 8,234
  3. 2020End-to-End Object Detection with Transformerscited by 7,414
  4. 2022Scalable Diffusion Models with Transformerscited by 6,054
  5. 2022Flow Matching for Generative Modelingcited by 5,702
  6. 2022Flow Straight and Fast: Learning to Generate and Transfer Data with Rectified Flowcited by 3,700
  7. 2021SDEdit: Guided Image Synthesis and Editing with Stochastic Differential Equationscited by 1,937
  8. 2023Zero-1-to-3: Zero-shot One Image to 3D Objectcited by 1,489
  9. 2025DINOv3cited by 1,414
  10. 2019Generating Diverse High-Fidelity Images with VQ-VAE-2cited by 1,387
  11. 2017Matterport3D: Learning from RGB-D Data in Indoor Environmentscited by 1,376
  12. 2020Center-based 3D Object Detection and Trackingcited by 1,144
38 more
  1. 2021Perceiver: General Perception with Iterative Attentioncited by 1,104
  2. 2025FLUX.1 Kontext: Flow Matching for In-Context Image Generation and Editing in Latent Spacecited by 1,006
  3. 2019The Replica Dataset: A Digital Replica of Indoor Spacescited by 904
  4. 2023LRM: Large Reconstruction Model for Single Image to 3Dcited by 849
  5. 2024Structured 3D Latents for Scalable and Versatile 3D Generationcited by 770
  6. 2018CornerNet: Detecting Objects as Paired Keypointscited by 763
  7. 2022DiffEdit: Diffusion-based semantic image editing with mask guidancecited by 647
  8. 2022PETR: Position Embedding Transformation for Multi-View 3D Object Detectioncited by 552
  9. 20233DShape2VecSet: A 3D Shape Representation for Neural Fields and Generative Diffusion Modelscited by 458
  10. 2024CLAY: A Controllable Large-scale Generative Model for Creating High-quality 3D Assetscited by 455
  11. 2024InstantMesh: Efficient 3D Mesh Generation from a Single Image with Sparse-view Large Reconstruction Modelscited by 433
  12. 20203D-FRONT: 3D Furnished Rooms with layOuts and semaNTicscited by 380
  13. 2025Hunyuan3D 2.0: Scaling Diffusion Models for High Resolution Textured 3D Assets Generationcited by 356
  14. 20203D-FUTURE: 3D Furniture shape with TextUREcited by 311
  15. 2023DragDiffusion: Harnessing Diffusion Models for Interactive Point-based Image Editingcited by 294
  16. 2019Structured3D: A Large Photo-realistic Dataset for Structured 3D Modelingcited by 286
  17. 2025SAM 3D: 3Dfy Anything in Imagescited by 247
  18. 2023Michelangelo: Conditional 3D Shape Generation based on Shape-Image-Text Aligned Latent Representationcited by 228
  19. 2025TripoSG: High-Fidelity 3D Shape Synthesis using Large-Scale Rectified Flow Modelscited by 213
  20. 2023XCube: Large-Scale 3D Generative Modeling using Sparse Voxel Hierarchiescited by 189
  21. 2025Native and Compact Structured Latents for 3D Generationcited by 175
  22. 2025Hunyuan3D 2.1: From Images to High-Fidelity 3D Assets with Production-Ready PBR Materialcited by 165
  23. 2024MIDI: Multi-Instance Diffusion for Single Image to 3D Scene Generationcited by 117
  24. 2025Direct3D-S2: Gigascale 3D Generation Made Easy with Spatial Sparse Attentioncited by 110
  25. 2025CAST: Component-Aligned 3D Scene Reconstruction from an RGB Imagecited by 106
  26. 2025Hi3DGen: High-fidelity 3D Geometry Generation from Images via Normal Bridgingcited by 99
  27. 2025Sparc3D: Sparse Representation and Construction for High-Resolution 3D Shapes Modelingcited by 89
  28. 2025Step1X-3D: Towards High-Fidelity and Controllable Generation of Textured 3D Assetscited by 87
  29. 2025PartCrafter: Structured 3D Mesh Generation via Compositional Latent Diffusion Transformerscited by 84
  30. 2025SparseFlex: High-Resolution and Arbitrary-Topology 3D Shape Modelingcited by 79
  31. 2019BlenderProccited by 77
  32. 2021ROCA: Robust CAD Model Retrieval and Alignment from a Single Imagecited by 67
  33. 2025Scenethesis: A Language and Vision Agentic Framework for 3D Scene Generationcited by 67
  34. 2020Mask2CAD: 3D Shape Prediction by Learning to Segment and Retrievecited by 65
  35. 2025OmniPart: Part-Aware 3D Generation with Semantic Decoupling and Structural Cohesioncited by 61
  36. 2025SceneWeaver: All-in-One 3D Scene Synthesis with an Extensible and Self-Reflective Agentcited by 56
  37. 2025SceneGen: Single-Image 3D Scene Generation in One Feedforward Passcited by 54
  38. 2023DiffCAD: Weakly-Supervised Probabilistic CAD Model Retrieval and Alignment from an RGB Imagecited by 48

50 most cited of 70 All 70 (JSON)

Built on by

Not cited yet.

Similar, not cited

Close in wording, no citation either way

  1. 2025MVRoom: Controllable 3D Indoor Scene Generation with Multi-View Diffusion Models
  2. 2025SPATIALGEN: Layout-guided 3D Indoor Scene Generation
  3. 2024SceneCraft: Layout-Guided 3D Scene Generation
  4. 2025SemLayoutDiff: Semantic Layout Generation with Diffusion Model for Indoor Scene Synthesis
  5. 2025ReSpace: Text-Driven Autoregressive 3D Indoor Scene Synthesis and Editing
  6. 2026AnchoredDream: Zero-Shot 360deg Indoor Scene Generation from a Single View via Geometric Grounding
  7. 2026SDesc3D: Towards Layout-Aware 3D Indoor Scene Generation from Short Descriptions
  8. 2026Scene Generation at Absolute Scale: Utilizing Semantic and Geometric Guidance From Text for Accurate and Interpretable 3D Indoor Scene Generation