Multi-sensor large-scale dataset for multi-view 3D reconstruction
Not on the map. Why?
Abstract (arXiv)
We present a new multi-sensor dataset for multi-view 3D surface reconstruction. It includes registered RGB and depth data from sensors of different resolutions and modalities: smartphones, Intel RealSense, Microsoft Kinect, industrial cameras, and structured-light scanner. The scenes are selected to emphasize a diverse set of material properties challenging for existing algorithms. We provide around 1.4 million images of 107 different scenes acquired from 100 viewing directions under 14 lighting conditions. We expect our dataset will be useful for evaluation and training of 3D reconstruction algorithms and for related tasks. The dataset is available at skoltech3d.appliedai.tech.
Key facts. Cited by 14 papers in the map (data through 7 Oct 2026). Builds on 51 of its 106 references that are in the map. First posted on arXiv 11 Mar 2022.
Builds on
51 of 106 references.
References · 51
- 2014Adam: A Method for Stochastic Optimizationcited by 36,960
- 2017ScanNet: Richly-annotated 3D Reconstructions of Indoor Scenescited by 3,088
- 2015ShapeNet: An Information-Rich 3D Model Repositorycited by 2,880
- 2021NeuS: Learning Neural Implicit Surfaces by Volume Rendering for Multi-view Reconstructioncited by 1,701
- 2017Matterport3D: Learning from RGB-D Data in Indoor Environmentscited by 1,354
- 2018MVSNet: Depth Inference for Unstructured Multi-view Stereocited by 780
- 2018Open3D: A Modern Library for 3D Data Processingcited by 717
- 2019Differentiable Volumetric Rendering: Learning Implicit 3D Representations without 3D Supervisioncited by 699
- 2021IBRNet: Learning Multi-View Image-Based Renderingcited by 698
- 2021UNISURF: Unifying Neural Implicit Surfaces and Radiance Fields for Multi-View Reconstructioncited by 643
- 2019BlendedMVS: A Large-scale Dataset for Generalized Multi-view Stereo Networkscited by 487
- 2016Semantic Scene Completion from a Single Depth Imagecited by 468
38 more
- 2021ARKitScenes: A Diverse Real-World Dataset For 3D Indoor Scene Understanding Using Mobile RGB-D Datacited by 442
- 2019Cascade Cost Volume for High-Resolution Multi-View Stereo and Stereo Matchingcited by 414
- 2019Neural Point-Based Graphicscited by 326
- 2021Neural RGB-D Surface Reconstructioncited by 312
- 2019DeepView: View Synthesis with Learned Gradient Descentcited by 253
- 2021NeuralRecon: Real-Time Coherent 3D Reconstruction from Monocular Videocited by 241
- 2020Free View Synthesiscited by 231
- 2020Atlas: End-to-End 3D Scene Reconstruction from Posed Imagescited by 206
- 2020PatchmatchNet: Learned Multi-View Patchmatch Stereocited by 204
- 2021Pixel-Perfect Structure-from-Motion with Featuremetric Refinementcited by 199
- 2020Real-Time High-Resolution Background Mattingcited by 172
- 2020Stable View Synthesiscited by 165
- 2016BundleFusion: Real-time Globally Consistent 3D Reconstruction using On-the-fly Surface Re-integrationcited by 116
- 2018Deep Depth Completion of a Single RGB-D Imagecited by 110
- 2019Multi-Scale Geometric Consistency Guided Multi-View Stereocited by 105
- 2017ScanComplete: Large-Scale Scene Completion and Semantic Segmentation for 3D Scanscited by 103
- 2020Visibility-aware Multi-view Stereo Networkcited by 97
- 2018Extreme View Synthesiscited by 94
- 2022Rethinking Depth Estimation for Multi-View Stereo: A Unified Representationcited by 82
- 2019SG-NN: Sparse Generative Neural Networks for Self-Supervised Scene Completion of RGB-D Scanscited by 77
- 2021AA-RMVSNet: Adaptive Aggregation Recurrent Multi-view Stereo Networkcited by 71
- 2020DI-Fusion: Online Implicit 3D Reconstruction with Deep Priorscited by 70
- 2021Towards Fast and Accurate Real-World Depth Super-Resolution: Benchmark Dataset and Baselinecited by 61
- 2019Planar Prior Assisted PatchMatch Multi-View Stereocited by 57
- 2020RoutedFusion: Learning Real-time Depth Map Fusioncited by 52
- 2020NeuralFusion: Online Depth Fusion in Latent Spacecited by 46
- 2021VolumeFusion: Deep Depth Fusion for 3D Scene Reconstructioncited by 44
- 2019Why Having 10,000 Parameters in Your Camera Model is Better Than Twelvecited by 43
- 2020Channel Attention based Iterative Residual Learning for Depth Map Super-Resolutioncited by 40
- 2020SPSG: Self-Supervised Photometric Scene Generation from RGB-D Scanscited by 34
- 2018SurfelMeshing: Online Surfel-Based Mesh Reconstructioncited by 29
- 2019'Zhores' -- Petaflops supercomputer for data-driven modeling, machine learning and artificial intelligence installed in Skolkovo Institute of Science and Technologycited by 23
- 2019DeepC-MVS: Deep Confidence Prediction for Multi-View Stereo Reconstructioncited by 23
- 2020S2DNet: Learning Accurate Correspondences for Sparse-to-Dense Feature Matchingcited by 22
- 2020DeepSurfels: Learning Online Appearance Fusioncited by 13
- 2019Camera Exposure Control for Robust Robot Vision with Noise-Aware Image Quality Assessmentcited by 10
- 2017Gradient-based Camera Exposure Control for Outdoor Mobile Platformscited by 9
- 2021Simultaneous Localization and Mapping Related Datasets: A Comprehensive Surveycited by 9
50 most cited of 51 All 51 (JSON)
Built on by
Citing papers per year: 2023: 3; 2024: 5; 2025: 4; 2026: 2.
14 papers.
Sort:
By area:
- 2023Factored-NeuS: Reconstructing Surfaces, Illumination, and Materials of Possibly Glossy Objectscited by 15
- 2024Exploring Multi-modal Neural Scene Representations With Applications on Thermal Imagingcited by 15
- 2024Blurred LiDAR for Sharper 3D: Robust Handheld 3D Scanning with Diffuse LiDAR and RGBcited by 10
- 2025Multi-view Surface Reconstruction Using Normal and Reflectance Cuescited by 5
- 2025Multi-Spectral Gaussian Splatting with Neural Color Representationcited by 4
- 2024Den-SOFT: Dense Space-Oriented Light Field DataseT for 6-DOF Immersive Experiencecited by 2
- 2023PRS: Sharp Feature Priors for Resolution-Free Surface Remeshingcited by 1
- 2024On Representation of 3D Rotation in the Context of Deep Learningcited by 1
- 2025Acquiring Submillimeter-Accurate Multi-Task Vision Datasets for Computer-Assisted Orthopedic Surgerycited by 1
- 2025Reconstruction Using the Invisible: Intuition from NIR and Metadata for Enhanced 3D Gaussian Splattingcited by 1
- 2023NeuSD: Surface Completion with Multi-View Text-to-Image Diffusioncited by 0
- 2024Success Probability in Multi-View Imagingcited by 0
2 more
- 2026EvalMVX: A Unified Benchmarking for Neural 3D Reconstruction under Diverse Multiview Setups27 Feb 2026
- 2026Multi-Sensor Matching with HyperNetworks18 Jan 2026
- 2025Reconstruction Using the Invisible: Intuition from NIR and Metadata for Enhanced 3D Gaussian Splatting20 Aug 2025
- 2025Multi-view Surface Reconstruction Using Normal and Reflectance Cues4 Jun 2025
- 2025Multi-Spectral Gaussian Splatting with Neural Color Representation3 Jun 2025
- 2025Acquiring Submillimeter-Accurate Multi-Task Vision Datasets for Computer-Assisted Orthopedic Surgery26 Jan 2025
- 2024Blurred LiDAR for Sharper 3D: Robust Handheld 3D Scanning with Diffuse LiDAR and RGB29 Nov 2024
- 2024On Representation of 3D Rotation in the Context of Deep Learning14 Oct 2024
- 2024Success Probability in Multi-View Imaging15 Jul 2024
- 2024Exploring Multi-modal Neural Scene Representations With Applications on Thermal Imaging18 Mar 2024
- 2024Den-SOFT: Dense Space-Oriented Light Field DataseT for 6-DOF Immersive Experience15 Mar 2024
- 2023NeuSD: Surface Completion with Multi-View Text-to-Image Diffusion7 Dec 2023
- 2023Factored-NeuS: Reconstructing Surfaces, Illumination, and Materials of Possibly Glossy Objectscited by 15
- 2024Exploring Multi-modal Neural Scene Representations With Applications on Thermal Imagingcited by 15
- 2024Blurred LiDAR for Sharper 3D: Robust Handheld 3D Scanning with Diffuse LiDAR and RGBcited by 10
- 2025Multi-view Surface Reconstruction Using Normal and Reflectance Cuescited by 5
- 2025Multi-Spectral Gaussian Splatting with Neural Color Representationcited by 4
- 2024Den-SOFT: Dense Space-Oriented Light Field DataseT for 6-DOF Immersive Experiencecited by 2
- 2023PRS: Sharp Feature Priors for Resolution-Free Surface Remeshingcited by 1
- 2024On Representation of 3D Rotation in the Context of Deep Learningcited by 1
- 2025Acquiring Submillimeter-Accurate Multi-Task Vision Datasets for Computer-Assisted Orthopedic Surgerycited by 1
- 2025Reconstruction Using the Invisible: Intuition from NIR and Metadata for Enhanced 3D Gaussian Splattingcited by 1
- 2024Success Probability in Multi-View Imagingcited by 0
- 2026Multi-Sensor Matching with HyperNetworkscited by 0
12 most cited of 13 All 13 (JSON)
- 2026EvalMVX: A Unified Benchmarking for Neural 3D Reconstruction under Diverse Multiview Setups27 Feb 2026
- 2026Multi-Sensor Matching with HyperNetworks18 Jan 2026
- 2025Reconstruction Using the Invisible: Intuition from NIR and Metadata for Enhanced 3D Gaussian Splatting20 Aug 2025
- 2025Multi-view Surface Reconstruction Using Normal and Reflectance Cues4 Jun 2025
- 2025Multi-Spectral Gaussian Splatting with Neural Color Representation3 Jun 2025
- 2025Acquiring Submillimeter-Accurate Multi-Task Vision Datasets for Computer-Assisted Orthopedic Surgery26 Jan 2025
- 2024Blurred LiDAR for Sharper 3D: Robust Handheld 3D Scanning with Diffuse LiDAR and RGB29 Nov 2024
- 2024On Representation of 3D Rotation in the Context of Deep Learning14 Oct 2024
- 2024Success Probability in Multi-View Imaging15 Jul 2024
- 2024Exploring Multi-modal Neural Scene Representations With Applications on Thermal Imaging18 Mar 2024
- 2024Den-SOFT: Dense Space-Oriented Light Field DataseT for 6-DOF Immersive Experience15 Mar 2024
- 2023PRS: Sharp Feature Priors for Resolution-Free Surface Remeshing30 Nov 2023
12 newest of 13 All 13 (JSON)