mlsanityData to 7 Oct 2026

A Real World Dataset for Multi-view 3D Reconstruction

arXiv 2203.11397 ↗First posted 22 Mar 2022cs.CV cs.AIcited by 9

Not on the map. Why?

Abstract (arXiv)

We present a dataset of 998 3D models of everyday tabletop objects along with their 847,000 real world RGB and depth images. Accurate annotations of camera poses and object poses for each image are performed in a semi-automated fashion to facilitate the use of the dataset for myriad 3D applications like shape reconstruction, object pose estimation, shape retrieval etc. We primarily focus on learned multi-view 3D reconstruction due to the lack of appropriate real world benchmark for the task and demonstrate that our dataset can fill that gap. The entire annotated dataset along with the source code for the annotation tools and evaluation baselines is available at http://www.ocrtoc.org/3d-reconstruction.html.

Key facts. Cited by 9 papers in the map (data through 7 Oct 2026). Builds on 30 of its 58 references that are in the map. First posted on arXiv 22 Mar 2022.

Builds on

30 of 58 references.

References · 30

  1. 2019PyTorch: An Imperative Style, High-Performance Deep Learning Librarycited by 20,160
  2. 2014Microsoft COCO: Common Objects in Contextcited by 17,498
  3. 2017Mask R-CNNcited by 7,259
  4. 2017ScanNet: Richly-annotated 3D Reconstructions of Indoor Scenescited by 3,088
  5. 2015ShapeNet: An Information-Rich 3D Model Repositorycited by 2,880
  6. 2021NeuS: Learning Neural Implicit Surfaces by Volume Rendering for Multi-view Reconstructioncited by 1,701
  7. 2019SuperGlue: Learning Feature Matching with Graph Neural Networkscited by 1,437
  8. 2015ORB-SLAM: a Versatile and Accurate Monocular SLAM Systemcited by 983
  9. 2020Accelerating 3D Deep Learning with PyTorch3Dcited by 781
  10. 2019Differentiable Volumetric Rendering: Learning Implicit 3D Representations without 3D Supervisioncited by 699
  11. 2018Pixel2Mesh: Generating 3D Mesh Models from Single RGB Imagescited by 649
  12. 2021Common Objects in 3D: Large-Scale Learning and Evaluation of Real-life 3D Category Reconstructioncited by 646
18 more
  1. 20163D-R2N2: A Unified Approach for Single and Multi-view 3D Object Reconstructioncited by 587
  2. 2018The Open Images Dataset V4: Unified image classification, object detection, and visual relationship detection at scalecited by 542
  3. 2018AtlasNet: A Papier-Mach'e Approach to Learning 3D Surface Generationcited by 539
  4. 2019BlendedMVS: A Large-scale Dataset for Generalized Multi-view Stereo Networkscited by 487
  5. 2016Past, Present, and Future of Simultaneous Localization And Mapping: Towards the Robust-Perception Agecited by 405
  6. 2018Pix3D: Dataset and Methods for Single-Image 3D Shape Modelingcited by 218
  7. 2017T-LESS: An RGB-D Dataset for 6D Pose Estimation of Texture-less Objectscited by 210
  8. 2017Learning a Multi-View Stereo Machinecited by 194
  9. 2020Objectron: A Large Scale Dataset of Object-Centric Videos in the Wild with Pose Annotationscited by 155
  10. 2019Deep Mesh Reconstruction from Single RGB Images via Topology Modification Networkscited by 106
  11. 2019Pixel2Mesh++: Multi-View 3D Mesh Generation via Deformationcited by 103
  12. 2016A Large Dataset of Object Scanscited by 64
  13. 2020FroDO: From Detections to 3D Objectscited by 51
  14. 2019A Skeleton-bridged Deep Learning Approach for Generating Meshes of Complex Topologies from Single RGB Imagescited by 37
  15. 2020Pix2Surf: Learning Parametric 3D Surface Models of Objects from Imagescited by 22
  16. 2019Front2Back: Single View 3D Shape Reconstruction via Front to Back Predictioncited by 17
  17. 2017Weakly supervised 3D Reconstruction with Adversarial Constraintcited by 13
  18. 2020MeshMVS: Multi-View Stereo Guided Mesh Reconstructioncited by 8

Built on by

Cited by year (2026 to 7 Oct)

Citing papers per year: 2023: 5; 2024: 1; 2025: 1; 2026: 2.

9 papers.

  1. 2023SweetDreamer: Aligning Geometric Priors in 2D Diffusion for Consistent Text-to-3Dcited by 134
  2. 2024Advances in 3D Generation: A Surveycited by 62
  3. 2023NAVI: Category-Agnostic Image Collections with High-Quality 3D Shape and Pose Annotationscited by 53
  4. 2023Dense RGB SLAM with Neural Implicit Mapscited by 42
  5. 2023ZeroShape: Regression-based Zero-shot Shape Reconstructioncited by 30
  6. 2023MobileBrick: Building LEGO for 3D Reconstruction on Mobile Devicescited by 15
  7. 2025OmniShape: Zero-Shot Multi-Hypothesis Shape and Pose Estimation in the Real Worldcited by 1
  8. 2026Advancing Digital Twin Generation Through a Novel Simulation Framework and Quantitative Benchmarkingcited by 0
  9. 20263DMPE: 3D Multi-Perspective Embeddingcited by 0