Sparse-View 3D Reconstruction: Recent Advances and Open Challenges
Not on the map. Why?
Abstract (arXiv)
Sparse-view 3D reconstruction is essential for applications in which dense image acquisition is impractical, such as robotics, augmented/virtual reality (AR/VR), and autonomous systems. In these settings, minimal image overlap prevents reliable correspondence matching, causing traditional methods, such as structure-from-motion (SfM) and multiview stereo (MVS), to fail. This survey reviews the latest advances in neural implicit models (e.g., NeRF and its regularized versions), explicit point-cloud-based approaches (e.g., 3D Gaussian Splatting), and hybrid frameworks that leverage priors from diffusion and vision foundation models (VFMs).We analyze how geometric regularization, explicit shape modeling, and generative inference are used to mitigate artifacts such as floaters and pose ambiguities in sparse-view settings. Comparative results on standard benchmarks reveal key trade-offs between the reconstruction accuracy, efficiency, and generalization. Unlike previous reviews, our survey provides a unified perspective on geometry-based, neural implicit, and generative (diffusion-based) methods. We highlight the persistent challenges in domain generalization and pose-free reconstruction and outline future directions for developing 3D-native generative priors and achieving real-time, unconstrained sparse-view reconstruction.
Key facts. Cited by 4 papers in the map (data through 14 Oct 2026). Builds on 164 of its 200 references that are in the map. First posted on arXiv 22 Jul 2025.
Builds on
164 of 200 references.
References · 164
- 2021Learning Transferable Visual Models From Natural Language Supervisioncited by 33,744
- 2020Denoising Diffusion Probabilistic Modelscited by 21,076
- 2021High-Resolution Image Synthesis with Latent Diffusion Modelscited by 18,863
- 2014Very Deep Convolutional Networks for Large-Scale Image Recognitioncited by 15,364
- 2018The Unreasonable Effectiveness of Deep Features as a Perceptual Metriccited by 11,177
- 2023Segment Anythingcited by 8,234
- 2020End-to-End Object Detection with Transformerscited by 7,414
- 2021Emerging Properties in Self-Supervised Vision Transformerscited by 6,968
- 20233D Gaussian Splatting for Real-Time Radiance Field Renderingcited by 6,226
- 2023Adding Conditional Control to Text-to-Image Diffusion Modelscited by 5,503
- 2022Instant Neural Graphics Primitives with a Multiresolution Hash Encodingcited by 3,723
- 2017ScanNet: Richly-annotated 3D Reconstructions of Indoor Scenescited by 3,117
38 more
- 2022DreamFusion: Text-to-3D using 2D Diffusioncited by 3,025
- 2015ShapeNet: An Information-Rich 3D Model Repositorycited by 2,897
- 2023Stable Video Diffusion: Scaling Latent Video Diffusion Models to Large Datasetscited by 2,581
- 2022Video Diffusion Modelscited by 2,305
- 2016Density estimation using Real NVPcited by 2,042
- 2018Occupancy Networks: Learning 3D Reconstruction in Function Spacecited by 2,041
- 2021Vision Transformers for Dense Predictioncited by 1,803
- 2020pixelNeRF: Neural Radiance Fields from One or Few Imagescited by 1,584
- 2023DUSt3R: Geometric 3D Vision Made Easycited by 1,567
- 2025VGGT: Visual Geometry Grounded Transformercited by 1,539
- 2017Matterport3D: Learning from RGB-D Data in Indoor Environmentscited by 1,376
- 2022TensoRF: Tensorial Radiance Fieldscited by 1,280
- 2016A Point Set Generation Network for 3D Object Reconstruction from a Single Imagecited by 979
- 2020Image Quality Assessment: Unifying Structure and Texture Similaritycited by 811
- 2021Depth-supervised NeRF: Fewer Views and Faster Training for Freecited by 735
- 2021IBRNet: Learning Multi-View Image-Based Renderingcited by 703
- 2023pixelSplat: 3D Gaussian Splats from Image Pairs for Scalable Generalizable 3D Reconstructioncited by 684
- 2019Local Light Field Fusion: Practical View Synthesis with Prescriptive Sampling Guidelinescited by 672
- 2021Common Objects in 3D: Large-Scale Learning and Evaluation of Real-life 3D Category Reconstructioncited by 652
- 2021BARF: Bundle-Adjusting Neural Radiance Fieldscited by 642
- 2021RegNeRF: Regularizing Neural Radiance Fields for View Synthesis from Sparse Inputscited by 615
- 2023DL3DV-10K: A Large-Scale Scene Dataset for Deep Learning-based 3D Visioncited by 537
- 2021Putting NeRF on a Diet: Semantically Consistent Few-Shot View Synthesiscited by 464
- 2024CAT3D: Create Anything in 3D with Multi-View Diffusion Modelscited by 432
- 2024ViewCrafter: Taming Video Diffusion Models for High-fidelity Novel View Synthesiscited by 403
- 2023Repurposing Diffusion-Based Image Generators for Monocular Depth Estimationcited by 327
- 2023OmniObject3D: Large-Vocabulary 3D Object Dataset for Realistic Perception, Reconstruction and Generationcited by 326
- 2023ReconFusion: 3D Reconstruction with Diffusion Priorscited by 318
- 2023FreeNeRF: Improving Few-shot Neural Rendering with Free Frequency Regularizationcited by 311
- 2021Dense Depth Priors for Neural Radiance Fields from Sparse Input Viewscited by 302
- 2023FSGS: Real-Time Few-shot View Synthesis using Gaussian Splattingcited by 279
- 2024DNGaussian: Optimizing Sparse-View 3D Gaussian Radiance Fields with Global-Local Depth Normalizationcited by 256
- 2023MVImgNet: A Large-scale Dataset of Multi-view Imagescited by 220
- 2022SparseFusion: Distilling View-conditioned Diffusion for 3D Reconstructioncited by 216
- 2023COLMAP-Free 3D Gaussian Splattingcited by 193
- 2021Stereo Radiance Fields (SRF): Learning View Synthesis for Sparse Views of Novel Scenescited by 190
- 2021InfoNeRF: Ray Entropy Minimization for Few-Shot Neural Volume Renderingcited by 182
- 2023Depth-Regularized Optimization for 3D Gaussian Splatting in Few-Shot Imagescited by 173
50 most cited of 164 All 164 (JSON)
Built on by
Citing papers per year: 2025: 1; 2026: 3.
4 papers.
- 2026MAC-Splat: Multi-Attribute Consistency for High-Fidelity Sparse-View Reconstructioncited by 1
- 2025NVSim: Novel View Synthesis Simulator for Large Scale Indoor Navigationcited by 0
- 2026Sparse-View Interpretable 3D Animal Behavior Representations for Neural Encoding and Decodingcited by 0
- 2026HierGF: Hierarchical Gaussian Fields via Geometry-perception Message Passing for Sparse-view 3D Reconstructioncited by 0
- 2026HierGF: Hierarchical Gaussian Fields via Geometry-perception Message Passing for Sparse-view 3D Reconstruction1 Oct 2026
- 2026Sparse-View Interpretable 3D Animal Behavior Representations for Neural Encoding and Decoding28 Sep 2026
- 2026MAC-Splat: Multi-Attribute Consistency for High-Fidelity Sparse-View Reconstruction12 Jul 2026
- 2025NVSim: Novel View Synthesis Simulator for Large Scale Indoor Navigation28 Oct 2025