SurfaceNet: An End-to-end 3D Neural Network for Multiview Stereopsis
Not on the map. Why?
Abstract (arXiv)
This paper proposes an end-to-end learning framework for multiview stereopsis. We term the network SurfaceNet. It takes a set of images and their corresponding camera parameters as input and directly infers the 3D model. The key advantage of the framework is that both photo-consistency as well geometric relations of the surface structure can be directly learned for the purpose of multiview stereopsis in an end-to-end fashion. SurfaceNet is a fully 3D convolutional network which is achieved by encoding the camera parameters together with the images in a 3D voxel representation. We evaluate SurfaceNet on the large-scale DTU benchmark.
Key facts. Cited by 128 papers in the map (data through 7 Oct 2026). First posted on arXiv 5 Aug 2017.
Builds on
No reference list yet.
Built on by
Citing papers per year: 2021: 37; 2022: 35; 2023: 26; 2024: 13; 2025: 15; 2026: 2.
128 papers.
Sort:
By area:
- 2022TensoRF: Tensorial Radiance Fieldscited by 1,275
- 2022Point-NeRF: Point-based Neural Radiance Fieldscited by 503
- 2023SurroundOcc: Multi-Camera 3D Occupancy Prediction for Autonomous Drivingcited by 310
- 2021NeuralRecon: Real-Time Coherent 3D Reconstruction from Monocular Videocited by 241
- 2021The Temporal Opportunist: Self-Supervised Multi-Frame Monocular Depthcited by 190
- 2022Time Will Tell: New Outlooks and A Baseline for Temporal Multi-View 3D Object Detectioncited by 177
- 2022SparseNeuS: Fast Generalizable Neural Surface Reconstruction from Sparse Viewscited by 175
- 2021Improving neural implicit surfaces geometry with patch warpingcited by 136
- 2021TransformerFusion: Monocular RGB Scene Reconstruction using Transformerscited by 107
- 2022NeRFusion: Fusing Radiance Fields for Large-Scale Scene Reconstructioncited by 99
- 2021NeuTex: Neural Texture Mapping for Volumetric Neural Renderingcited by 98
- 2021Bidirectional Projection Network for Cross Dimension Scene Understandingcited by 95
38 more
- 2022SimpleRecon: 3D Reconstruction Without 3D Convolutionscited by 83
- 2022Rethinking Depth Estimation for Multi-View Stereo: A Unified Representationcited by 82
- 2023StyleRF: Zero-shot 3D Style Transfer of Neural Radiance Fieldscited by 79
- 2021AA-RMVSNet: Adaptive Aggregation Recurrent Multi-view Stereo Networkcited by 71
- 2023Ref-NeuS: Ambiguity-Reduced Neural Implicit Surface Learning for Multi-View Reconstruction with Reflectioncited by 68
- 2022NeuralUDF: Learning Unsigned Distance Fields for Multi-view Reconstruction of Surfaces with Arbitrary Topologiescited by 62
- 2021IterMVS: Iterative Probability Estimation for Efficient Multi-View Stereocited by 56
- 2022Multiview Stereo with Cascaded Epipolar RAFTcited by 51
- 2022MVSFormer: Multi-View Stereo by Learning Robust Image Features and Temperature-based Depthcited by 50
- 2022GIFS: Neural Implicit Function for General Shape Representationcited by 45
- 2021VolumeFusion: Deep Depth Fusion for 3D Scene Reconstructioncited by 44
- 2021MVS2D: Efficient Multi-view Stereo via Attention-Driven 2D Convolutionscited by 43
- 2023NeuralEditor: Editing Neural Radiance Fields via Manipulating Point Cloudscited by 41
- 2021TANDEM: Tracking and Dense Mapping in Real-time using Deep Multi-view Stereocited by 39
- 2021VoRTX: Volumetric 3D Reconstruction With Transformers for Voxelwise View Selection and Fusioncited by 38
- 2023Differentiable Blocks World: Qualitative 3D Decomposition by Rendering Primitivescited by 37
- 2023NeuSurf: On-Surface Priors for Neural Surface Reconstruction from Sparse Input Viewscited by 36
- 2021Generalized Binary Search Network for Highly-Efficient Multi-View Stereocited by 32
- 2021Self-supervised Multi-view Stereo via Effective Co-Segmentation and Data-Augmentationcited by 31
- 2021Digging into Uncertainty in Self-supervised Multi-view Stereocited by 31
- 2021Input-level Inductive Biases for 3D Reconstructioncited by 31
- 2021Continual Neural Mapping: Learning An Implicit Scene Representation from Sequential Observationscited by 30
- 2022Uncertainty-Aware Deep Multi-View Photometric Stereocited by 30
- 2022RC-MVSNet: Unsupervised Multi-View Stereo with Neural Renderingcited by 30
- 2025FatesGS: Fast and Accurate Sparse-View Surface Reconstruction using Gaussian Splatting with Depth-Feature Consistencycited by 30
- 2022PlaneMVS: 3D Plane Reconstruction from Multi-View Stereocited by 29
- 2021Neural Radiance Fields Approach to Deep Multi-View Photometric Stereocited by 25
- 2024UFORecon: Generalizable Sparse-View Surface Reconstruction from Arbitrary and UnFavOrable Setscited by 22
- 2021Outdoor inverse rendering from a single image using multiview self-supervisioncited by 18
- 2023MVPSNet: Fast Generalizable Multi-view Photometric Stereocited by 18
- 2024PixelGaussian: Generalizable 3D Gaussian Reconstruction from Arbitrary Viewscited by 18
- 2021PatchMatch-RL: Deep MVS with Pixelwise Depth, Normal, and Visibilitycited by 17
- 2021Curvature-guided dynamic scale networks for Multi-view Stereocited by 17
- 2022MonoNeuralFusion: Online Monocular Neural 3D Reconstruction with Geometric Priorscited by 17
- 20213DRIMR: 3D Reconstruction and Imaging via mmWave Radar based on Deep Learningcited by 16
- 2021NeeDrop: Self-supervised Shape Representation from Sparse Point Clouds using Needle Droppingcited by 16
- 2023Neural Vector Fields: Implicit Representation by Explicit Learningcited by 16
- 2023RayMVSNet++: Learning Ray-based 1D Implicit Fields for Accurate Multi-View Stereocited by 15
50 most cited of 128 All 128 (JSON)
- 2026ZipMVS: Multi-View Stereo with Compressed Cost Volumes28 Aug 2026
- 2026HeSS: Head Sensitivity Score for Sparsity Redistribution in VGGT26 Mar 2026
- 2025Diffusion Knows Transparency: Repurposing Video Diffusion for Transparent Object Depth and Normal Estimation29 Dec 2025
- 2025LASER: Layer-wise Scale Alignment for Training-Free Streaming 4D Reconstruction15 Dec 2025
- 2025Depth-Consistent 3D Gaussian Splatting via Physical Defocus Modeling and Multi-View Geometric Supervision13 Nov 2025
- 2025Image-Plane Geometric Decoding for View-Invariant Indoor Scene Reconstruction30 Sep 2025
- 2025Lightweight and Accurate Multi-View Stereo with Confidence-Aware Diffusion Model18 Sep 2025
- 20253D Plant Root Skeleton Detection and Extraction11 Aug 2025
- 2025Towards Depth Foundation Model: Recent Trends in Vision-Based Depth Estimation15 Jul 2025
- 2025Generalizable Neural Reconstruction of High-Fidelity Surfaces via Sparse Volumetric Representations8 Jul 2025
- 2025Multi-view dense image matching with similarity learning and geometry priors16 May 2025
- 2025Blending 3D Geometry and Machine Learning for Multi-View Stereopsis6 May 2025
38 more
- 2025Detail-aware multi-view stereo network for depth estimation31 Mar 2025
- 2025CL-MVSNet: Unsupervised Multi-view Stereo with Dual-level Contrastive Learning11 Mar 2025
- 2025Sub-Image Recapture for Multi-View 3D Reconstruction10 Mar 2025
- 2025Cutting-edge 3D reconstruction solutions for underwater coral reef images: A review and comparison27 Feb 2025
- 2025FatesGS: Fast and Accurate Sparse-View Surface Reconstruction using Gaussian Splatting with Depth-Feature Consistency8 Jan 2025
- 2024ProEdit: Simple Progression is All You Need for High-Quality 3D Scene Editing7 Nov 2024
- 2024PixelGaussian: Generalizable 3D Gaussian Reconstruction from Arbitrary Views24 Oct 2024
- 2024Underground Mapping and Localization Based on Ground-Penetrating Radar24 Sep 2024
- 2024Multi-view Hand Reconstruction with a Point-Embedded Transformer20 Aug 2024
- 2024HIVE: HIerarchical Volume Encoding for Neural Implicit Surface Reconstruction3 Aug 2024
- 2024Computer vision tasks for intelligent aerospace missions: An overview9 Jul 2024
- 2024Normal-guided Detail-Preserving Neural Implicit Function for High-Fidelity 3D Surface Reconstruction7 Jun 2024
- 2024Neural Surface Reconstruction from Sparse Views Using Epipolar Geometry6 Jun 2024
- 2024Adaptive Learning for Multi-view Stereo Reconstruction8 Apr 2024
- 2024CHOSEN: Contrastive Hypothesis Selection for Multi-View Depth Refinement2 Apr 2024
- 2024XScale-NVS: Cross-Scale Novel View Synthesis with Hash Featurized Manifold28 Mar 2024
- 2024UFORecon: Generalizable Sparse-View Surface Reconstruction from Arbitrary and UnFavOrable Sets8 Mar 2024
- 2024A Geometric Algorithm for Blood Vessel Reconstruction from Skeletal Representation20 Feb 2024
- 2023NeuSurf: On-Surface Priors for Neural Surface Reconstruction from Sparse Input Views21 Dec 2023
- 2023Learning Naturally Aggregated Appearance for Efficient 3D Editing11 Dec 2023
- 20233D Face Style Transfer with a Hybrid Solution of NeRF and Mesh Rasterization22 Nov 2023
- 2023GC-MVSNet: Multi-View, Multi-Scale, Geometrically-Consistent Multi-View Stereo30 Oct 2023
- 2023When Epipolar Constraint Meets Non-local Operators in Multi-View Stereo29 Sep 2023
- 2023Neural Vector Fields: Generalizing Distance Vector Fields by Codebooks and Zero-Curl Regularization4 Sep 2023
- 2023Deep Learning for Visual Localization and Mapping: A Survey27 Aug 2023
- 2023ES-MVSNet: Efficient Framework for End-to-end Self-supervised Multi-View Stereo4 Aug 2023
- 2023Constraining Depth Map Geometry for Multi-View Stereo: A Dual-Depth Approach with Saddle-shaped Depth Cells18 Jul 2023
- 2023RayMVSNet++: Learning Ray-based 1D Implicit Fields for Accurate Multi-View Stereo16 Jul 2023
- 2023Differentiable Blocks World: Qualitative 3D Decomposition by Rendering Primitives11 Jul 2023
- 2023Revisiting Stereo Triangulation in UAV Distance Estimation15 Jun 2023
- 2023Incremental Dense Reconstruction from Monocular Video with Guided Sparse Feature Volume Fusion24 May 2023
- 2023MVPSNet: Fast Generalizable Multi-view Photometric Stereo18 May 2023
- 2023CostFormer:Cost Transformer for Cost Aggregation in Multi-view Stereo17 May 2023
- 2023NeuralEditor: Editing Neural Radiance Fields via Manipulating Point Clouds4 May 2023
- 2023Multi-View Stereo Representation Revisit: Region-Aware MVSNet26 Apr 2023
- 2023VisFusion: Visibility-aware Online 3D Scene Reconstruction from Videos21 Apr 2023
- 2023POEM: Reconstructing Hand in a Point Embedded Multi-view Stereo8 Apr 2023
- 2023DPF: Learning Dense Prediction Fields with Weak Supervision29 Mar 2023
50 newest of 128 All 128 (JSON)
- 2024ProEdit: Simple Progression is All You Need for High-Quality 3D Scene Editingcited by 12
- 2025Diffusion Knows Transparency: Repurposing Video Diffusion for Transparent Object Depth and Normal Estimationcited by 9
- 2025Lightweight and Accurate Multi-View Stereo with Confidence-Aware Diffusion Modelcited by 4
- 2025Diffusion Knows Transparency: Repurposing Video Diffusion for Transparent Object Depth and Normal Estimation29 Dec 2025
- 2025Lightweight and Accurate Multi-View Stereo with Confidence-Aware Diffusion Model18 Sep 2025
- 2024ProEdit: Simple Progression is All You Need for High-Quality 3D Scene Editing7 Nov 2024
- 2022TensoRF: Tensorial Radiance Fieldscited by 1,275
- 2022Point-NeRF: Point-based Neural Radiance Fieldscited by 503
- 2023SurroundOcc: Multi-Camera 3D Occupancy Prediction for Autonomous Drivingcited by 310
- 2021NeuralRecon: Real-Time Coherent 3D Reconstruction from Monocular Videocited by 241
- 2021The Temporal Opportunist: Self-Supervised Multi-Frame Monocular Depthcited by 190
- 2022Time Will Tell: New Outlooks and A Baseline for Temporal Multi-View 3D Object Detectioncited by 177
- 2022SparseNeuS: Fast Generalizable Neural Surface Reconstruction from Sparse Viewscited by 175
- 2021Improving neural implicit surfaces geometry with patch warpingcited by 136
- 2021TransformerFusion: Monocular RGB Scene Reconstruction using Transformerscited by 107
- 2022NeRFusion: Fusing Radiance Fields for Large-Scale Scene Reconstructioncited by 99
- 2021NeuTex: Neural Texture Mapping for Volumetric Neural Renderingcited by 98
- 2021Bidirectional Projection Network for Cross Dimension Scene Understandingcited by 95
12 most cited of 125 All 125 (JSON)
- 2026ZipMVS: Multi-View Stereo with Compressed Cost Volumes28 Aug 2026
- 2026HeSS: Head Sensitivity Score for Sparsity Redistribution in VGGT26 Mar 2026
- 2025LASER: Layer-wise Scale Alignment for Training-Free Streaming 4D Reconstruction15 Dec 2025
- 2025Depth-Consistent 3D Gaussian Splatting via Physical Defocus Modeling and Multi-View Geometric Supervision13 Nov 2025
- 2025Image-Plane Geometric Decoding for View-Invariant Indoor Scene Reconstruction30 Sep 2025
- 20253D Plant Root Skeleton Detection and Extraction11 Aug 2025
- 2025Towards Depth Foundation Model: Recent Trends in Vision-Based Depth Estimation15 Jul 2025
- 2025Generalizable Neural Reconstruction of High-Fidelity Surfaces via Sparse Volumetric Representations8 Jul 2025
- 2025Multi-view dense image matching with similarity learning and geometry priors16 May 2025
- 2025Blending 3D Geometry and Machine Learning for Multi-View Stereopsis6 May 2025
- 2025Detail-aware multi-view stereo network for depth estimation31 Mar 2025
- 2025CL-MVSNet: Unsupervised Multi-view Stereo with Dual-level Contrastive Learning11 Mar 2025
12 newest of 125 All 125 (JSON)