mlsanityData to 14 Oct 2026

Mira-Scene: Pixel-Aligned Layouts for Generative 3D Scene Reconstruction

arXiv 2609.23796 ↗First posted 20 Sep 2026cs.CV cs.GRcited by 0

Not on the map. Why?

Abstract (arXiv)

Single-image 3D object generation can now produce high-fidelity assets, yet accurately placing them into a coherent scene layout remains an open challenge. A central difficulty lies in how object layout is represented. Holistic methods absorb placement into a scene-level generation process, sacrificing object-level detail. Compositional methods preserve object fidelity by decoupling geometry from layout, but typically parameterize layout as sparse, unbounded pose variables that are difficult to learn and generalize poorly under scarce scene-level supervision. We present Mira-Scene, a compositional 3D scene reconstruction framework that replaces sparse pose regression with dense, bounded correspondence recovery. At its core is the Canonical Coordinate Map (CCM), a pixel-aligned field that maps each visible object pixel to a surface coordinate in the object's bounded canonical space. When paired with a scene-space Point Cloud Map (PCM) from monocular geometry estimation, CCM induces dense canonical-to-scene correspondences from which object transformations are recovered through robust geometric alignment. Because CCM operates in bounded canonical space, it provides a stable prediction target that can be trained from scalable object-level 3D data without requiring scene-level layout annotations. Mira-Scene further introduces a multimodal diffusion transformer that jointly generates object geometry and CCMs, using modality-specific expert streams with shared attention and positional encoding to promote geometry-layout consistency. Experiments on indoor, outdoor, synthetic, and in-the-wild scenes show that Mira-Scene substantially outperforms strong baselines in layout accuracy, achieving relative gains of 39.8% in 3D-IoU and 16.5% in 2D-IoU over SAM3D, using limited open-source training data.

Key facts. No citing papers in the map yet (data through 14 Oct 2026). Builds on 74 of its 82 references that are in the map. First posted on arXiv 20 Sep 2026.

Builds on

74 of 82 references.

References · 74

  1. 2023DINOv2: Learning Robust Visual Features without Supervisioncited by 7,974
  2. 2022Scalable Diffusion Models with Transformerscited by 6,054
  3. 2022Classifier-Free Diffusion Guidancecited by 5,847
  4. 2022Flow Matching for Generative Modelingcited by 5,702
  5. 2024Scaling Rectified Flow Transformers for High-Resolution Image Synthesiscited by 4,181
  6. 2022DreamFusion: Text-to-3D using 2D Diffusioncited by 3,025
  7. 2022Objaverse: A Universe of Annotated 3D Objectscited by 1,540
  8. 2023ProlificDreamer: High-Fidelity and Diverse Text-to-3D Generation with Variational Score Distillationcited by 1,219
  9. 2025SAM 3: Segment Anything with Conceptscited by 906
  10. 2025Emerging Properties in Unified Multimodal Pretrainingcited by 897
  11. 2023LRM: Large Reconstruction Model for Single Image to 3Dcited by 849
  12. 2017PoseCNN: A Convolutional Neural Network for 6D Object Pose Estimation in Cluttered Scenescited by 775
38 more
  1. 2024Structured 3D Latents for Scalable and Versatile 3D Generationcited by 770
  2. 2023Wonder3D: Single Image to 3D using Cross-Domain Diffusioncited by 689
  3. 2023SyncDreamer: Generating Multiview-consistent Images from a Single-view Imagecited by 645
  4. 2019Normalized Object Coordinate Space for Category-Level 6D Object Pose and Size Estimationcited by 495
  5. 20233DShape2VecSet: A 3D Shape Representation for Neural Fields and Generative Diffusion Modelscited by 458
  6. 2024CLAY: A Controllable Large-scale Generative Model for Creating High-quality 3D Assetscited by 455
  7. 2023FoundationPose: Unified 6D Pose Estimation and Tracking of Novel Objectscited by 429
  8. 20203D-FRONT: 3D Furnished Rooms with layOuts and semaNTicscited by 380
  9. 2023LayoutGPT: Compositional Visual Planning and Generation with Large Language Modelscited by 347
  10. 20203D-FUTURE: 3D Furniture shape with TextUREcited by 311
  11. 2024MoGe: Unlocking Accurate Monocular Geometry Estimation for Open-Domain Images with Optimal Training Supervisioncited by 299
  12. 2023Holodeck: Language Guided Generation of 3D Embodied AI Environmentscited by 268
  13. 2025SAM 3D: 3Dfy Anything in Imagescited by 247
  14. 2026LTX-2: Efficient Joint Audio-Visual Foundation Modelcited by 236
  15. 2025TripoSG: High-Fidelity 3D Shape Synthesis using Large-Scale Rectified Flow Modelscited by 213
  16. 2024Direct3D: Scalable Image-to-3D Generation via 3D Latent Diffusion Transformercited by 210
  17. 2022MegaPose: 6D Pose Estimation of Novel Objects via Render & Comparecited by 201
  18. 2021ATISS: Autoregressive Transformers for Indoor Scene Synthesiscited by 200
  19. 2025Native and Compact Structured Latents for 3D Generationcited by 175
  20. 2023DiffuScene: Denoising Diffusion Models for Generative Indoor Scene Synthesiscited by 166
  21. 2024Mixture-of-Transformers: A Sparse and Scalable Architecture for Multi-Modal Foundation Modelscited by 163
  22. 2020SceneFormer: Indoor Scene Generation with Transformerscited by 158
  23. 2023Text-to-3D with Classifier Score Distillationcited by 128
  24. 2024PhyScene: Physically Interactable 3D Scene Synthesis for Embodied AIcited by 125
  25. 2025Hunyuan3D 2.5: Towards High-Fidelity 3D Assets Generation with Ultimate Detailscited by 125
  26. 2024MIDI: Multi-Instance Diffusion for Single Image to 3D Scene Generationcited by 117
  27. 2024GALA3D: Towards Text-to-3D Complex Scene Generation via Layout-guided Generative Gaussian Splattingcited by 109
  28. 2025CAST: Component-Aligned 3D Scene Reconstruction from an RGB Imagecited by 106
  29. 2024SceneScript: Reconstructing Scenes With An Autoregressive Structured Language Modelcited by 96
  30. 2024LayoutVLM: Differentiable Optimization of 3D Layout via Vision-Language Modelscited by 96
  31. 2024Automated Creation of Digital Cousins for Robust Policy Learningcited by 91
  32. 2025Sparc3D: Sparse Representation and Construction for High-Resolution 3D Shapes Modelingcited by 89
  33. 2025JavisDiT: Joint Audio-Video Diffusion Transformer with Hierarchical Spatio-Temporal Prior Synchronizationcited by 88
  34. 2025PartCrafter: Structured 3D Mesh Generation via Compositional Latent Diffusion Transformerscited by 84
  35. 2025Scenethesis: A Language and Vision Agentic Framework for 3D Scene Generationcited by 67
  36. 2024Gen3DSR: Generalizable 3D Scene Reconstruction via Divide and Conquer from a Single Viewcited by 61
  37. 2024ComboVerse: Compositional 3D Assets Creation Using Spatially-Aware Diffusion Guidancecited by 59
  38. 2025SceneWeaver: All-in-One 3D Scene Synthesis with an Extensible and Self-Reflective Agentcited by 56

50 most cited of 74 All 74 (JSON)

Built on by

Not cited yet.

Similar, not cited

Close in wording, no citation either way

  1. 2026SceneAE: Scene Generation and Reconstruction in Queryable 3D-Anchored Latent Space
  2. 2023SceneWiz3D: Towards Text-guided 3D Scene Composition
  3. 2025G4Splat: Geometry-Guided Gaussian Splatting with Generative Prior
  4. 2026φ-Scene: Physically Grounded Image-to-3D Scene Reconstruction
  5. 2026PixWorld: Unifying 3D Scene Generation and Reconstruction in Pixel Space
  6. 2025SPAR3D: Stable Point-Aware Reconstruction of 3D Objects from Single Images
  7. 2024Gaussian Scenes: Pose-Free Sparse-View Scene Reconstruction using Depth-Enhanced Diffusion Priors
  8. 2025TRELLISWorld: Training-Free World Generation from Object Generators