Data to 7 Oct 2026

Total3DUnderstanding: Joint Layout, Object Pose and Mesh Reconstruction for Indoor Scenes from a Single Image

arXiv 2002.12212 ↗First posted 27 Feb 2020cs.CVcited by 170

Not on the map. Why?

Abstract (arXiv)

Semantic reconstruction of indoor scenes refers to both scene understanding and object reconstruction. Existing works either address one part of this problem or focus on independent objects. In this paper, we bridge the gap between understanding and reconstruction, and propose an end-to-end solution to jointly reconstruct room layout, object bounding boxes and meshes from a single image. Instead of separately resolving scene understanding and object reconstruction, our method builds upon a holistic scene context and proposes a coarse-to-fine hierarchy with three components: 1. room layout with camera pose; 2. 3D object bounding boxes; 3. object meshes. We argue that understanding the context of each component can assist the task of parsing the others, which enables joint understanding and reconstruction. The experiments on the SUN RGB-D and Pix3D datasets demonstrate that our method consistently outperforms existing methods in indoor layout estimation, 3D object detection and mesh reconstruction.

Key facts. Cited by 170 papers in the map (data through 7 Oct 2026). First posted on arXiv 27 Feb 2020.

Builds on

No reference list yet.

Built on by

Cited by year (2026 to 7 Oct)

Citing papers per year: 2021: 29; 2022: 30; 2023: 32; 2024: 30; 2025: 21; 2026: 28.

170 papers.

Sort:

By area:

2021MonoScene: Monocular 3D Semantic Scene Completioncited by 357
2021Neural RGB-D Surface Reconstructioncited by 312
2022Panoptic Neural Fields: A Semantic Object-Aware Neural Scene Representationcited by 243
2023Aria Digital Twin: A New Benchmark Dataset for Egocentric 3D Machine Perceptioncited by 166
2022Omni3D: A Large Benchmark and Model for 3D Object Detection in the Wildcited by 159
2021ImVoxelNet: Image to Voxels Projection for Monocular and Multi-View General-Purpose 3D Object Detectioncited by 157
2021Kimera: from SLAM to Spatial Perception with 3D Dynamic Scene Graphscited by 144
2024MIDI: Multi-Instance Diffusion for Single Image to 3D Scene Generationcited by 113
2021Instance Segmentation in 3D Scenes using Semantic Superpoint Tree Networkscited by 98
2021Holistic 3D Scene Understanding from a Single Image with Implicit Representationcited by 94
2022GPV-Pose: Category-level Object Pose Estimation via Geometry-guided Point-wise Votingcited by 94
2023NDC-Scene: Boost Monocular 3D Semantic Scene Completion in Normalized Device Coordinates Spacecited by 88

38 more

2025Visual Spatial Tuningcited by 85
2021Graph-to-3D: End-to-End Generation and Manipulation of 3D Scenes Using Scene Graphscited by 83
20213D Semantic Scene Completion: a Surveycited by 74
2022Object-Compositional Neural Implicit Surfacescited by 74
2021Panoptic 3D Scene Reconstruction From a Single RGB Imagecited by 70
2022ShAPO: Implicit Representations for Multi-Object Shape, Appearance, and Pose Optimizationcited by 70
2022CenterSnap: Single-Shot Multi-Object 3D Shape Reconstruction and Categorical 6D Pose and Size Estimationcited by 69
2021ROCA: Robust CAD Model Retrieval and Alignment from a Single Imagecited by 66
2024Gen3DSR: Generalizable 3D Scene Reconstruction via Divide and Conquer from a Single Viewcited by 59
2022Human-Aware Object Placement for Visual Environment Reconstructioncited by 56
2024AffordanceLLM: Grounding Affordance from Vision Language Modelscited by 55
2023CommonScenes: Generating Commonsense 3D Indoor Scenes with Scene Graph Diffusioncited by 54
2022SceneRF: Self-Supervised Monocular 3D Scene Reconstruction with Radiance Fieldscited by 49
2023DiffCAD: Weakly-Supervised Probabilistic CAD Model Retrieval and Alignment from an RGB Imagecited by 48
2024PhyRecon: Physically Plausible Neural Scene Reconstructioncited by 44
2022Towards High-Fidelity Single-view Holistic Reconstruction of Indoor Scenescited by 43
2022RBP-Pose: Residual Bounding Box Projection for Category-Level Pose Estimationcited by 43
2021Planar Surface Reconstruction from Sparse Viewscited by 40
2023IST-Net: Prior-free Category-level Pose Estimation with Implicit Space Transformationcited by 40
2021D3D-HOI: Dynamic 3D Human-Object Interactions from Videoscited by 39
2021Patch2CAD: Patchwise Embedding Learning for In-the-Wild Shape Retrieval from a Single Imagecited by 39
2023Incremental 3D Semantic Scene Graph Prediction from RGB Sequencescited by 39
2023Single-view 3D Scene Reconstruction with High-fidelity Shape and Texturecited by 37
2022Understanding 3D Object Articulation in Internet Videoscited by 36
2024Zero-Shot Scene Reconstruction from Single Images with Deep Prior Assemblycited by 34
2021DeepPanoContext: Panoramic 3D Scene Understanding with Holistic Scene Context Graph and Relation-based Optimizationcited by 33
2023Understanding 3D Object Interaction from a Single Imagecited by 33
2025Detect Anything 3D in the Wildcited by 32
2025Decompositional Neural Scene Reconstruction with Generative Diffusion Priorcited by 30
2022CATRE: Iterative Point Clouds Alignment for Category-level Object Pose Refinementcited by 28
2021Indoor Scene Generation from a Collection of Semantic-Segmented Depth Imagescited by 27
2021PQ-Transformer: Jointly Parsing 3D Objects and Layouts from Point Cloudscited by 26
20233DiffTection: 3D Object Detection with Geometry-Aware Diffusion Featurescited by 26
2022Learning 3D Scene Priors with 2D Supervisioncited by 24
2022OPA-3D: Occlusion-Aware Pixel-Wise Aggregation for Monocular 3D Object Detectioncited by 23
2023PSDR-Room: Single Photo to Scene using Differentiable Renderingcited by 23
2025DepR: Depth Guided Single-view Scene Reconstruction with Instance-level Diffusioncited by 23
2021Cerberus Transformer: Joint Semantic, Affordance and Attribute Parsingcited by 22

50 most cited of 170 All 170 (JSON)