Mira-Scene: Pixel-Aligned Layouts for Generative 3D Scene Reconstruction
Not on the map. Why?
Abstract (arXiv)
Single-image 3D object generation can now produce high-fidelity assets, yet accurately placing them into a coherent scene layout remains an open challenge. A central difficulty lies in how object layout is represented. Holistic methods absorb placement into a scene-level generation process, sacrificing object-level detail. Compositional methods preserve object fidelity by decoupling geometry from layout, but typically parameterize layout as sparse, unbounded pose variables that are difficult to learn and generalize poorly under scarce scene-level supervision. We present Mira-Scene, a compositional 3D scene reconstruction framework that replaces sparse pose regression with dense, bounded correspondence recovery. At its core is the Canonical Coordinate Map (CCM), a pixel-aligned field that maps each visible object pixel to a surface coordinate in the object's bounded canonical space. When paired with a scene-space Point Cloud Map (PCM) from monocular geometry estimation, CCM induces dense canonical-to-scene correspondences from which object transformations are recovered through robust geometric alignment. Because CCM operates in bounded canonical space, it provides a stable prediction target that can be trained from scalable object-level 3D data without requiring scene-level layout annotations. Mira-Scene further introduces a multimodal diffusion transformer that jointly generates object geometry and CCMs, using modality-specific expert streams with shared attention and positional encoding to promote geometry-layout consistency. Experiments on indoor, outdoor, synthetic, and in-the-wild scenes show that Mira-Scene substantially outperforms strong baselines in layout accuracy, achieving relative gains of 39.8% in 3D-IoU and 16.5% in 2D-IoU over SAM3D, using limited open-source training data.
Key facts. No citing papers in the map yet (data through 14 Oct 2026). Builds on 74 of its 82 references that are in the map. First posted on arXiv 20 Sep 2026.
Builds on
74 of 82 references.
References · 74
- 2023DINOv2: Learning Robust Visual Features without Supervisioncited by 7,974
- 2022Scalable Diffusion Models with Transformerscited by 6,054
- 2022Classifier-Free Diffusion Guidancecited by 5,847
- 2022Flow Matching for Generative Modelingcited by 5,702
- 2024Scaling Rectified Flow Transformers for High-Resolution Image Synthesiscited by 4,181
- 2022DreamFusion: Text-to-3D using 2D Diffusioncited by 3,025
- 2022Objaverse: A Universe of Annotated 3D Objectscited by 1,540
- 2023ProlificDreamer: High-Fidelity and Diverse Text-to-3D Generation with Variational Score Distillationcited by 1,219
- 2025SAM 3: Segment Anything with Conceptscited by 906
- 2025Emerging Properties in Unified Multimodal Pretrainingcited by 897
- 2023LRM: Large Reconstruction Model for Single Image to 3Dcited by 849
- 2017PoseCNN: A Convolutional Neural Network for 6D Object Pose Estimation in Cluttered Scenescited by 775
38 more
- 2024Structured 3D Latents for Scalable and Versatile 3D Generationcited by 770
- 2023Wonder3D: Single Image to 3D using Cross-Domain Diffusioncited by 689
- 2023SyncDreamer: Generating Multiview-consistent Images from a Single-view Imagecited by 645
- 2019Normalized Object Coordinate Space for Category-Level 6D Object Pose and Size Estimationcited by 495
- 20233DShape2VecSet: A 3D Shape Representation for Neural Fields and Generative Diffusion Modelscited by 458
- 2024CLAY: A Controllable Large-scale Generative Model for Creating High-quality 3D Assetscited by 455
- 2023FoundationPose: Unified 6D Pose Estimation and Tracking of Novel Objectscited by 429
- 20203D-FRONT: 3D Furnished Rooms with layOuts and semaNTicscited by 380
- 2023LayoutGPT: Compositional Visual Planning and Generation with Large Language Modelscited by 347
- 20203D-FUTURE: 3D Furniture shape with TextUREcited by 311
- 2024MoGe: Unlocking Accurate Monocular Geometry Estimation for Open-Domain Images with Optimal Training Supervisioncited by 299
- 2023Holodeck: Language Guided Generation of 3D Embodied AI Environmentscited by 268
- 2025SAM 3D: 3Dfy Anything in Imagescited by 247
- 2026LTX-2: Efficient Joint Audio-Visual Foundation Modelcited by 236
- 2025TripoSG: High-Fidelity 3D Shape Synthesis using Large-Scale Rectified Flow Modelscited by 213
- 2024Direct3D: Scalable Image-to-3D Generation via 3D Latent Diffusion Transformercited by 210
- 2022MegaPose: 6D Pose Estimation of Novel Objects via Render & Comparecited by 201
- 2021ATISS: Autoregressive Transformers for Indoor Scene Synthesiscited by 200
- 2025Native and Compact Structured Latents for 3D Generationcited by 175
- 2023DiffuScene: Denoising Diffusion Models for Generative Indoor Scene Synthesiscited by 166
- 2024Mixture-of-Transformers: A Sparse and Scalable Architecture for Multi-Modal Foundation Modelscited by 163
- 2020SceneFormer: Indoor Scene Generation with Transformerscited by 158
- 2023Text-to-3D with Classifier Score Distillationcited by 128
- 2024PhyScene: Physically Interactable 3D Scene Synthesis for Embodied AIcited by 125
- 2025Hunyuan3D 2.5: Towards High-Fidelity 3D Assets Generation with Ultimate Detailscited by 125
- 2024MIDI: Multi-Instance Diffusion for Single Image to 3D Scene Generationcited by 117
- 2024GALA3D: Towards Text-to-3D Complex Scene Generation via Layout-guided Generative Gaussian Splattingcited by 109
- 2025CAST: Component-Aligned 3D Scene Reconstruction from an RGB Imagecited by 106
- 2024SceneScript: Reconstructing Scenes With An Autoregressive Structured Language Modelcited by 96
- 2024LayoutVLM: Differentiable Optimization of 3D Layout via Vision-Language Modelscited by 96
- 2024Automated Creation of Digital Cousins for Robust Policy Learningcited by 91
- 2025Sparc3D: Sparse Representation and Construction for High-Resolution 3D Shapes Modelingcited by 89
- 2025JavisDiT: Joint Audio-Video Diffusion Transformer with Hierarchical Spatio-Temporal Prior Synchronizationcited by 88
- 2025PartCrafter: Structured 3D Mesh Generation via Compositional Latent Diffusion Transformerscited by 84
- 2025Scenethesis: A Language and Vision Agentic Framework for 3D Scene Generationcited by 67
- 2024Gen3DSR: Generalizable 3D Scene Reconstruction via Divide and Conquer from a Single Viewcited by 61
- 2024ComboVerse: Compositional 3D Assets Creation Using Spatially-Aware Diffusion Guidancecited by 59
- 2025SceneWeaver: All-in-One 3D Scene Synthesis with an Extensible and Self-Reflective Agentcited by 56
50 most cited of 74 All 74 (JSON)
Built on by
Not cited yet.
Similar, not cited
Close in wording, no citation either way
- 2026SceneAE: Scene Generation and Reconstruction in Queryable 3D-Anchored Latent Space
- 2023SceneWiz3D: Towards Text-guided 3D Scene Composition
- 2025G4Splat: Geometry-Guided Gaussian Splatting with Generative Prior
- 2026φ-Scene: Physically Grounded Image-to-3D Scene Reconstruction
- 2026PixWorld: Unifying 3D Scene Generation and Reconstruction in Pixel Space
- 2025SPAR3D: Stable Point-Aware Reconstruction of 3D Objects from Single Images
- 2024Gaussian Scenes: Pose-Free Sparse-View Scene Reconstruction using Depth-Enhanced Diffusion Priors
- 2025TRELLISWorld: Training-Free World Generation from Object Generators