VolRecon: Volume Rendering of Signed Ray Distance Functions for Generalizable Multi-View Reconstruction
Not on the map. Why?
Abstract (arXiv)
The success of the Neural Radiance Fields (NeRF) in novel view synthesis has inspired researchers to propose neural implicit scene reconstruction. However, most existing neural implicit reconstruction methods optimize per-scene parameters and therefore lack generalizability to new scenes. We introduce VolRecon, a novel generalizable implicit reconstruction method with Signed Ray Distance Function (SRDF). To reconstruct the scene with fine details and little noise, VolRecon combines projection features aggregated from multi-view features, and volume features interpolated from a coarse global feature volume. Using a ray transformer, we compute SRDF values of sampled points on a ray and then render color and depth. On DTU dataset, VolRecon outperforms SparseNeuS by about 30% in sparse view reconstruction and achieves comparable accuracy as MVSNet in full view reconstruction. Furthermore, our approach exhibits good generalization performance on the large-scale ETH3D benchmark.
Key facts. Cited by 61 papers in the map (data through 7 Oct 2026). Builds on 41 of its 68 references that are in the map. First posted on arXiv 15 Dec 2022.
Builds on
41 of 68 references.
References · 41
- 2017Attention Is All You Needcited by 59,932
- 2014Adam: A Method for Stochastic Optimizationcited by 36,960
- 2020An Image is Worth 16x16 Words: Transformers for Image Recognition at Scalecited by 29,915
- 2015U-Net: Convolutional Networks for Biomedical Image Segmentationcited by 19,604
- 2016Feature Pyramid Networks for Object Detectioncited by 5,021
- 2022Instant Neural Graphics Primitives with a Multiresolution Hash Encodingcited by 3,698
- 2019DeepSDF: Learning Continuous Signed Distance Functions for Shape Representationcited by 2,682
- 2018Occupancy Networks: Learning 3D Reconstruction in Function Spacecited by 2,037
- 2020Transformers are RNNs: Fast Autoregressive Transformers with Linear Attentioncited by 1,979
- 2021Mip-NeRF: A Multiscale Representation for Anti-Aliasing Neural Radiance Fieldscited by 1,957
- 2021NeuS: Learning Neural Implicit Surfaces by Volume Rendering for Multi-view Reconstructioncited by 1,701
- 2021Plenoxels: Radiance Fields without Neural Networkscited by 1,607
29 more
- 2020pixelNeRF: Neural Radiance Fields from One or Few Imagescited by 1,574
- 2021Volume Rendering of Neural Implicit Surfacescited by 990
- 2020NeRF++: Analyzing and Improving Neural Radiance Fieldscited by 857
- 2016Unsupervised Monocular Depth Estimation with Left-Right Consistencycited by 819
- 2018MVSNet: Depth Inference for Unstructured Multi-view Stereocited by 780
- 2020Convolutional Occupancy Networkscited by 760
- 2021MVSNeRF: Fast Generalizable Radiance Field Reconstruction from Multi-View Stereocited by 735
- 2022Block-NeRF: Scalable Large Scene Neural View Synthesiscited by 720
- 2020pi-GAN: Periodic Implicit Generative Adversarial Networks for 3D-Aware Image Synthesiscited by 708
- 2021IBRNet: Learning Multi-View Image-Based Renderingcited by 698
- 2021UNISURF: Unifying Neural Implicit Surfaces and Radiance Fields for Multi-View Reconstructioncited by 643
- 2022MonoSDF: Exploring Monocular Geometric Cues for Neural Implicit Surface Reconstructioncited by 467
- 2019Cascade Cost Volume for High-Resolution Multi-View Stereo and Stereo Matchingcited by 414
- 2019Recurrent MVSNet for High-resolution Multi-view Stereo Depth Inferencecited by 252
- 2021NeuralRecon: Real-Time Coherent 3D Reconstruction from Monocular Videocited by 241
- 2022Geo-Neus: Geometry-Consistent Neural Implicit Surfaces Learning for Multi-view Reconstructioncited by 211
- 2020Atlas: End-to-End 3D Scene Reconstruction from Posed Imagescited by 206
- 2020PatchmatchNet: Learned Multi-View Patchmatch Stereocited by 204
- 2021NerfingMVS: Guided Optimization of Neural Radiance Fields for Indoor Multi-view Stereocited by 191
- 2022SparseNeuS: Fast Generalizable Neural Surface Reconstruction from Sparse Viewscited by 175
- 2021Improving neural implicit surfaces geometry with patch warpingcited by 136
- 2022NeuRIS: Neural Reconstruction of Indoor Scenes Using Normal Priorscited by 125
- 2019Multi-Scale Geometric Consistency Guided Multi-View Stereocited by 105
- 2020Visibility-aware Multi-view Stereo Networkcited by 97
- 2020DeepVideoMVS: Multi-View Stereo on Video with Recurrent Spatio-Temporal Fusioncited by 68
- 2021IterMVS: Iterative Probability Estimation for Efficient Multi-View Stereocited by 56
- 2022Critical Regularizations for Neural Surface Reconstruction in the Wildcited by 51
- 2022Generalizable Neural Radiance Fields for Novel View Synthesis with Transformercited by 21
- 2022Multi-View Reconstruction using Signed Ray Distance Functions (SRDF)cited by 9
Built on by
Citing papers per year: 2023: 14; 2024: 27; 2025: 13; 2026: 7.
61 papers.
Sort:
By area:
- 2023One-2-3-45: Any Single Image to 3D Mesh in 45 Seconds without Per-Shape Optimizationcited by 555
- 2023One-2-3-45++: Fast Single Image to 3D Objects with Consistent Multi-View Generation and 3D Diffusioncited by 283
- 2023PF-LRM: Pose-Free Large Reconstruction Model for Joint Pose and Shape Predictioncited by 165
- 2023ConsistNet: Enforcing 3D Consistency for Multi-view Images Diffusioncited by 65
- 2024MeshFormer: High-Quality Mesh Generation with 3D-Guided Reconstruction Modelcited by 55
- 2024SplatFields: Neural Gaussian Splats for Sparse 3D and 4D Reconstructioncited by 52
- 2023NeuSurf: On-Surface Priors for Neural Surface Reconstruction from Sparse Input Viewscited by 36
- 2024SpaRP: Fast 3D Object Reconstruction and Pose Estimation from Sparse Viewscited by 35
- 2023ReTR: Modeling Rendering Via Transformer for Generalizable Neural Surface Reconstructioncited by 30
- 2025FatesGS: Fast and Accurate Sparse-View Surface Reconstruction using Gaussian Splatting with Depth-Feature Consistencycited by 30
- 2023UniSDF: Unifying Neural Representations for High-Fidelity 3D Reconstruction of Complex Scenes with Reflectionscited by 29
- 2024G3R: Gradient Guided Generalizable Reconstructioncited by 29
38 more
- 2025Sparse2DGS: Geometry-Prioritized Gaussian Splatting for Surface Reconstruction from Sparse Viewscited by 25
- 2025Advances in Feed-Forward 3D Reconstruction and View Synthesis: A Surveycited by 23
- 2023Fast View Synthesis of Casual Videos with Soup-of-Planescited by 22
- 2024UFORecon: Generalizable Sparse-View Surface Reconstruction from Arbitrary and UnFavOrable Setscited by 22
- 2024MAtCha Gaussians: Atlas of Charts for High-Quality Geometry and Photorealism From Sparse Viewscited by 21
- 2024SparseCraft: Few-Shot Neural Reconstruction through Stereopsis Guided Geometric Linearizationcited by 19
- 2023C2F2NeUS: Cascade Cost Frustum Fusion for High Fidelity and Generalizable Neural Surface Reconstructioncited by 18
- 2024Learning-based Multi-View Stereo: A Surveycited by 18
- 2024GenS: Generalizable Neural Surface Reconstruction from Multi-View Imagescited by 15
- 2025MonoInstance: Enhancing Monocular Priors via Multi-view Instance Alignment for Neural Rendering and Reconstructioncited by 15
- 2024SolidGS: Consolidating Gaussian Surfel Splatting for Sparse-View Surface Reconstructioncited by 10
- 2025SparseRecon: Neural Implicit Surface Reconstruction from Sparse Views with Feature and Depth Consistenciescited by 9
- 2023O2-Recon: Completing 3D Reconstruction of Occluded Objects in the Scene with a Pre-trained 2D Diffusion Modelcited by 8
- 2024Normal-guided Detail-Preserving Neural Implicit Function for High-Fidelity 3D Surface Reconstructioncited by 8
- 2024Spurfies: Sparse Surface Reconstruction using Local Geometry Priorscited by 8
- 2024PVP-Recon: Progressive View Planning via Warping Consistency for Sparse-View Surface Reconstructioncited by 8
- 2024CN-RMA: Combined Network with Ray Marching Aggregation for 3D Indoors Object Detection from Multi-view Imagescited by 7
- 2025SparSplat: Fast Multi-View Reconstruction with Generalizable 2D Gaussian Splattingcited by 7
- 2025Sparfels: Fast Reconstruction from Sparse Unposed Imagerycited by 7
- 2024UWStereo: A Large Synthetic Dataset for Underwater Stereo Matchingcited by 6
- 2025MeshSplat: Generalizable Sparse-View Surface Reconstruction via Gaussian Splattingcited by 6
- 2024Sparse Views, Near Light: A Practical Paradigm for Uncalibrated Point-light Photometric Stereocited by 5
- 2024DPA-Net: Structured 3D Abstraction from Sparse Views via Differentiable Primitive Assemblycited by 5
- 20246Img-to-3D: Few-Image Large-Scale Outdoor Driving Scene Reconstructioncited by 5
- 2024GeoTransfer : Generalizable Few-Shot Multi-View Reconstruction via Transfer Learningcited by 5
- 2025SurfaceSplat: Connecting Surface Reconstruction and Gaussian Splattingcited by 5
- 2023A Simple Framework for 3D Occupancy Estimation in Autonomous Drivingcited by 4
- 2024Neural Surface Reconstruction from Sparse Views Using Epipolar Geometrycited by 4
- 2024Ray-Distance Volume Rendering for Neural Scene Reconstructioncited by 4
- 2024Surface-Centric Modeling for High-Fidelity Generalizable Neural Surface Reconstructioncited by 4
- 2024Generalizable Neural Human Renderercited by 3
- 2024EG-HumanNeRF: Efficient Generalizable Human NeRF Utilizing Human Prior for Sparse Viewcited by 3
- 2025NeuGrasp: Generalizable Neural Surface Reconstruction with Background Priors for Material-Agnostic Object Grasp Detectioncited by 3
- 2023OD-NeRF: Efficient Training of On-the-Fly Dynamic Neural Radiance Fieldscited by 2
- 2023PR-NeuS: A Prior-based Residual Learning Paradigm for Fast Multi-view Neural Surface Reconstructioncited by 2
- 2026SurfelSplat: Learning Efficient and Generalizable Gaussian Surfel Representations for Sparse-View Surface Reconstructioncited by 2
- 2023DeepShaRM: Multi-View Shape and Reflectance Map Recovery Under Unknown Lightingcited by 1
- 2024LucidFusion: Reconstructing 3D Gaussians with Arbitrary Unposed Imagescited by 1
50 most cited of 61 All 61 (JSON)
- 2026TV-SGS: Gaussian Splatting with Geometric Information Propagation via Tensor Voting under sparse views7 Sep 2026
- 2026M2Depth: Unifying Monocular Depth Foundation Priors with Multi-View Stereo21 Aug 2026
- 2026Sparse-View Surface Reconstruction using Gaussian Splatting through High-Confidence Depth Propagation with Normal Priors4 Jul 2026
- 2026MU-GeNeRF: Multi-view Uncertainty-guided Generalizable Neural Radiance Fields for Distractor-aware Scene20 Apr 2026
- 2026SurfelSplat: Learning Efficient and Generalizable Gaussian Surfel Representations for Sparse-View Surface Reconstruction9 Apr 2026
- 2026Detailed Geometry and Appearance from Opportunistic Motion27 Mar 2026
- 2026Fus3D: Decoding Consolidated 3D Geometry from Feed-forward Geometry Transformer Latents26 Mar 2026
- 2025MeshSplat: Generalizable Sparse-View Surface Reconstruction via Gaussian Splatting25 Aug 2025
- 2025SERES: Semantic-aware neural reconstruction from sparse views23 Aug 2025
- 2025SparseRecon: Neural Implicit Surface Reconstruction from Sparse Views with Feature and Depth Consistencies1 Aug 2025
- 2025SurfaceSplat: Connecting Surface Reconstruction and Gaussian Splatting21 Jul 2025
- 2025Advances in Feed-Forward 3D Reconstruction and View Synthesis: A Survey19 Jul 2025
38 more
- 2025Generalizable Neural Reconstruction of High-Fidelity Surfaces via Sparse Volumetric Representations8 Jul 2025
- 2025Sparfels: Fast Reconstruction from Sparse Unposed Imagery4 May 2025
- 2025SparSplat: Fast Multi-View Reconstruction with Generalizable 2D Gaussian Splatting4 May 2025
- 2025Sparse2DGS: Geometry-Prioritized Gaussian Splatting for Surface Reconstruction from Sparse Views29 Apr 2025
- 2025Learning Scene-Level Signed Directional Distance Function with Ellipsoidal Priors and Neural Residuals25 Mar 2025
- 2025MonoInstance: Enhancing Monocular Priors via Multi-view Instance Alignment for Neural Rendering and Reconstruction24 Mar 2025
- 2025NeuGrasp: Generalizable Neural Surface Reconstruction with Background Priors for Material-Agnostic Object Grasp Detection5 Mar 2025
- 2025FatesGS: Fast and Accurate Sparse-View Surface Reconstruction using Gaussian Splatting with Depth-Feature Consistency8 Jan 2025
- 2024SolidGS: Consolidating Gaussian Surfel Splatting for Sparse-View Surface Reconstruction19 Dec 2024
- 2024MAtCha Gaussians: Atlas of Charts for High-Quality Geometry and Photorealism From Sparse Views9 Dec 2024
- 2024LucidFusion: Reconstructing 3D Gaussians with Arbitrary Unposed Images21 Oct 2024
- 2024EG-HumanNeRF: Efficient Generalizable Human NeRF Utilizing Human Prior for Sparse View16 Oct 2024
- 2024G3R: Gradient Guided Generalizable Reconstruction28 Sep 2024
- 2024SplatFields: Neural Gaussian Splats for Sparse 3D and 4D Reconstruction17 Sep 2024
- 2024PVP-Recon: Progressive View Planning via Warping Consistency for Sparse-View Surface Reconstruction9 Sep 2024
- 2024Surface-Centric Modeling for High-Fidelity Generalizable Neural Surface Reconstruction5 Sep 2024
- 2024UWStereo: A Large Synthetic Dataset for Underwater Stereo Matching3 Sep 2024
- 2024Spurfies: Sparse Surface Reconstruction using Local Geometry Priors29 Aug 2024
- 2024Ray-Distance Volume Rendering for Neural Scene Reconstruction28 Aug 2024
- 2024Learning-based Multi-View Stereo: A Survey27 Aug 2024
- 2024GeoTransfer : Generalizable Few-Shot Multi-View Reconstruction via Transfer Learning27 Aug 2024
- 2024MeshFormer: High-Quality Mesh Generation with 3D-Guided Reconstruction Model19 Aug 2024
- 2024SpaRP: Fast 3D Object Reconstruction and Pose Estimation from Sparse Views19 Aug 2024
- 2024SparseCraft: Few-Shot Neural Reconstruction through Stereopsis Guided Geometric Linearization19 Jul 2024
- 2024Normal-guided Detail-Preserving Neural Implicit Function for High-Fidelity 3D Surface Reconstruction7 Jun 2024
- 2024Neural Surface Reconstruction from Sparse Views Using Epipolar Geometry6 Jun 2024
- 2024GenS: Generalizable Neural Surface Reconstruction from Multi-View Images4 Jun 2024
- 2024S3-SLAM: Sparse Tri-plane Encoding for Neural Implicit SLAM28 Apr 2024
- 2024Generalizable Neural Human Renderer22 Apr 2024
- 20246Img-to-3D: Few-Image Large-Scale Outdoor Driving Scene Reconstruction18 Apr 2024
- 2024DPA-Net: Structured 3D Abstraction from Sparse Views via Differentiable Primitive Assembly1 Apr 2024
- 2024Sparse Views, Near Light: A Practical Paradigm for Uncalibrated Point-light Photometric Stereo29 Mar 2024
- 2024Omni-Recon: Harnessing Image-based Rendering for General-Purpose Neural Radiance Fields17 Mar 2024
- 2024UFORecon: Generalizable Sparse-View Surface Reconstruction from Arbitrary and UnFavOrable Sets8 Mar 2024
- 2024CN-RMA: Combined Network with Ray Marching Aggregation for 3D Indoors Object Detection from Multi-view Images7 Mar 2024
- 2023NeuSurf: On-Surface Priors for Neural Surface Reconstruction from Sparse Input Views21 Dec 2023
- 2023UniSDF: Unifying Neural Representations for High-Fidelity 3D Reconstruction of Complex Scenes with Reflections20 Dec 2023
- 2023PR-NeuS: A Prior-based Residual Learning Paradigm for Fast Multi-view Neural Surface Reconstruction18 Dec 2023
50 newest of 61 All 61 (JSON)
- 2023One-2-3-45: Any Single Image to 3D Mesh in 45 Seconds without Per-Shape Optimizationcited by 555
- 2023One-2-3-45++: Fast Single Image to 3D Objects with Consistent Multi-View Generation and 3D Diffusioncited by 283
- 2024MeshFormer: High-Quality Mesh Generation with 3D-Guided Reconstruction Modelcited by 55
- 2024SpaRP: Fast 3D Object Reconstruction and Pose Estimation from Sparse Viewscited by 35
- 2023O2-Recon: Completing 3D Reconstruction of Occluded Objects in the Scene with a Pre-trained 2D Diffusion Modelcited by 8
- 2024MeshFormer: High-Quality Mesh Generation with 3D-Guided Reconstruction Model19 Aug 2024
- 2024SpaRP: Fast 3D Object Reconstruction and Pose Estimation from Sparse Views19 Aug 2024
- 2023One-2-3-45++: Fast Single Image to 3D Objects with Consistent Multi-View Generation and 3D Diffusion14 Nov 2023
- 2023O2-Recon: Completing 3D Reconstruction of Occluded Objects in the Scene with a Pre-trained 2D Diffusion Model18 Aug 2023
- 2023One-2-3-45: Any Single Image to 3D Mesh in 45 Seconds without Per-Shape Optimization29 Jun 2023
- 2023PF-LRM: Pose-Free Large Reconstruction Model for Joint Pose and Shape Predictioncited by 165
- 2023ConsistNet: Enforcing 3D Consistency for Multi-view Images Diffusioncited by 65
- 2024SplatFields: Neural Gaussian Splats for Sparse 3D and 4D Reconstructioncited by 52
- 2023NeuSurf: On-Surface Priors for Neural Surface Reconstruction from Sparse Input Viewscited by 36
- 2023ReTR: Modeling Rendering Via Transformer for Generalizable Neural Surface Reconstructioncited by 30
- 2025FatesGS: Fast and Accurate Sparse-View Surface Reconstruction using Gaussian Splatting with Depth-Feature Consistencycited by 30
- 2023UniSDF: Unifying Neural Representations for High-Fidelity 3D Reconstruction of Complex Scenes with Reflectionscited by 29
- 2024G3R: Gradient Guided Generalizable Reconstructioncited by 29
- 2025Sparse2DGS: Geometry-Prioritized Gaussian Splatting for Surface Reconstruction from Sparse Viewscited by 25
- 2025Advances in Feed-Forward 3D Reconstruction and View Synthesis: A Surveycited by 23
- 2023Fast View Synthesis of Casual Videos with Soup-of-Planescited by 22
- 2024UFORecon: Generalizable Sparse-View Surface Reconstruction from Arbitrary and UnFavOrable Setscited by 22
12 most cited of 56 All 56 (JSON)
- 2026TV-SGS: Gaussian Splatting with Geometric Information Propagation via Tensor Voting under sparse views7 Sep 2026
- 2026M2Depth: Unifying Monocular Depth Foundation Priors with Multi-View Stereo21 Aug 2026
- 2026Sparse-View Surface Reconstruction using Gaussian Splatting through High-Confidence Depth Propagation with Normal Priors4 Jul 2026
- 2026MU-GeNeRF: Multi-view Uncertainty-guided Generalizable Neural Radiance Fields for Distractor-aware Scene20 Apr 2026
- 2026SurfelSplat: Learning Efficient and Generalizable Gaussian Surfel Representations for Sparse-View Surface Reconstruction9 Apr 2026
- 2026Detailed Geometry and Appearance from Opportunistic Motion27 Mar 2026
- 2026Fus3D: Decoding Consolidated 3D Geometry from Feed-forward Geometry Transformer Latents26 Mar 2026
- 2025MeshSplat: Generalizable Sparse-View Surface Reconstruction via Gaussian Splatting25 Aug 2025
- 2025SERES: Semantic-aware neural reconstruction from sparse views23 Aug 2025
- 2025SparseRecon: Neural Implicit Surface Reconstruction from Sparse Views with Feature and Depth Consistencies1 Aug 2025
- 2025SurfaceSplat: Connecting Surface Reconstruction and Gaussian Splatting21 Jul 2025
- 2025Advances in Feed-Forward 3D Reconstruction and View Synthesis: A Survey19 Jul 2025
12 newest of 56 All 56 (JSON)