mlsanityData to 7 Oct 2026

IM2CAD

arXiv 1608.05137 ↗First posted 18 Aug 2016cs.CVcited by 78

Not on the map. Why?

Abstract (arXiv)

Given a single photo of a room and a large database of furniture CAD models, our goal is to reconstruct a scene that is as similar as possible to the scene depicted in the photograph, and composed of objects drawn from the database. We present a completely automatic system to address this IM2CAD problem that produces high quality results on challenging imagery from interior home design and remodeling websites. Our approach iteratively optimizes the placement and scale of objects in the room to best match scene renderings to the input photo, using image comparison metrics trained via deep convolutional neural nets. By operating jointly on the full scene at once, we account for inter-object occlusions. We also show the applicability of our method in standard scene understanding benchmarks where we obtain significant improvement.

Key facts. Cited by 78 papers in the map (data through 7 Oct 2026). First posted on arXiv 18 Aug 2016.

Builds on

No reference list yet.

Built on by

Cited by year (2026 to 7 Oct)

Citing papers per year: 2021: 15; 2022: 18; 2023: 19; 2024: 12; 2025: 10; 2026: 4.

78 papers.

Sort:

By area:

  1. 2021MonoScene: Monocular 3D Semantic Scene Completioncited by 357
  2. 2024MIDI: Multi-Instance Diffusion for Single Image to 3D Scene Generationcited by 113
  3. 2021Holistic 3D Scene Understanding from a Single Image with Implicit Representationcited by 94
  4. 2023NDC-Scene: Boost Monocular 3D Semantic Scene Completion in Normalized Device Coordinates Spacecited by 88
  5. 2025PartCrafter: Structured 3D Mesh Generation via Compositional Latent Diffusion Transformerscited by 78
  6. 20213D Semantic Scene Completion: a Surveycited by 74
  7. 2021ROCA: Robust CAD Model Retrieval and Alignment from a Single Imagecited by 66
  8. 2024Gen3DSR: Generalizable 3D Scene Reconstruction via Divide and Conquer from a Single Viewcited by 59
  9. 2022Human-Aware Object Placement for Visual Environment Reconstructioncited by 56
  10. 2022SceneRF: Self-Supervised Monocular 3D Scene Reconstruction with Radiance Fieldscited by 49
  11. 2023DiffCAD: Weakly-Supervised Probabilistic CAD Model Retrieval and Alignment from an RGB Imagecited by 48
  12. 2022Towards High-Fidelity Single-view Holistic Reconstruction of Indoor Scenescited by 43
38 more
  1. 2021Patch2CAD: Patchwise Embedding Learning for In-the-Wild Shape Retrieval from a Single Imagecited by 39
  2. 2021SAIL-VOS 3D: A Synthetic Dataset and Baselines for Object Detection and 3D Mesh Reconstruction from Video Datacited by 38
  3. 2023Single-view 3D Scene Reconstruction with High-fidelity Shape and Texturecited by 37
  4. 2021Single Image Depth Estimation: An Overviewcited by 35
  5. 2021DeepPanoContext: Panoramic 3D Scene Understanding with Holistic Scene Context Graph and Relation-based Optimizationcited by 33
  6. 2021RetrievalFuse: Neural 3D Scene Reconstruction with a Databasecited by 28
  7. 2022Compositional Scene Representation Learning via Reconstruction: A Surveycited by 27
  8. 2022Learning 3D Scene Priors with 2D Supervisioncited by 24
  9. 2023PSDR-Room: Single Photo to Scene using Differentiable Renderingcited by 23
  10. 2025DepR: Depth Guided Single-view Scene Reconstruction with Instance-level Diffusioncited by 23
  11. 2022PhotoScene: Photorealistic Material and Lighting Transfer for Indoor Scenescited by 22
  12. 2025CADDreamer: CAD Object Generation from Single-view Imagescited by 22
  13. 2025LiteReality: Graphics-Ready 3D Scene Reconstruction from RGB-D Scanscited by 21
  14. 2021Monte Carlo Scene Search for 3D Scene Understandingcited by 19
  15. 2022SPARC: Sparse Render-and-Compare for CAD model alignment in a single RGB imagecited by 19
  16. 2023PanoContext-Former: Panoramic Total Scene Understanding with a Transformercited by 19
  17. 2023SHARP Challenge 2023: Solving CAD History and pArameters Recovery from Point clouds and 3D scans. Overview, Datasets, Metrics, and Baselinescited by 19
  18. 2021Plan2Scene: Converting Floorplans to 3D Scenescited by 17
  19. 2022RayTran: 3D pose estimation and shape reconstruction of multiple objects from videos with ray-traced transformerscited by 17
  20. 2022Depth Map Decomposition for Monocular Depth Estimationcited by 16
  21. 2023ImGeoNet: Image-induced Geometry-aware Voxel Representation for Multi-view 3D Object Detectioncited by 14
  22. 2024Blox-Net: Generative Design-for-Robot-Assembly Using VLM Supervision, Physics Simulation, and a Robot with Resetcited by 14
  23. 20223D Room Layout Estimation from a Cubemap of Panorama Image via Deep Manhattan Hough Transformcited by 11
  24. 2022MonteBoxFinder: Detecting and Filtering Primitives to Fit a Noisy Point Cloudcited by 11
  25. 2024Diorama: Unleashing Zero-shot Single-view 3D Indoor Scene Modelingcited by 10
  26. 20263D-Fixer: Coarse-to-Fine In-place Completion for 3D Scenes from a Single Imagecited by 9
  27. 2023Generalizing Single-View 3D Shape Retrieval to Occlusions and Unseen Objectscited by 8
  28. 2024Coherent 3D Scene Diffusion From a Single RGB Imagecited by 8
  29. 2025FreeScene: Mixed Graph Diffusion for 3D Scene Synthesis from Free Promptscited by 8
  30. 2021What's Behind the Couch? Directed Ray Distance Functions (DRDF) for 3D Scene Reconstructioncited by 7
  31. 2022Neural Rendering in a Room: Amodal 3D Understanding and Free-Viewpoint Rendering for the Closed Scene Composed of Pre-Captured Objectscited by 7
  32. 2022A Deep Perceptual Measure for Lens and Camera Calibrationcited by 7
  33. 2023FS-Depth: Focal-and-Scale Depth Estimation from a Single Image in Unseen Indoor Scenecited by 7
  34. 2024Reconstructing Animals and the Wildcited by 7
  35. 2025Digital Twin Generation from Visual Data: A Surveycited by 7
  36. 2021MVLayoutNet:3D layout reconstruction with multi-view panoramascited by 6
  37. 20243DFIRES: Few Image 3D REconstruction for Scenes with Hidden Surfacecited by 6
  38. 2023Virtual Home Staging: Inverse Rendering and Editing an Indoor Panorama under Natural Illuminationcited by 5

50 most cited of 78 All 78 (JSON)