mlsanityData to 14 Oct 2026

Sparse-View 3D Reconstruction: Recent Advances and Open Challenges

arXiv 2507.16406 ↗First posted 22 Jul 2025cs.CVcited by 4

Not on the map. Why?

Abstract (arXiv)

Sparse-view 3D reconstruction is essential for applications in which dense image acquisition is impractical, such as robotics, augmented/virtual reality (AR/VR), and autonomous systems. In these settings, minimal image overlap prevents reliable correspondence matching, causing traditional methods, such as structure-from-motion (SfM) and multiview stereo (MVS), to fail. This survey reviews the latest advances in neural implicit models (e.g., NeRF and its regularized versions), explicit point-cloud-based approaches (e.g., 3D Gaussian Splatting), and hybrid frameworks that leverage priors from diffusion and vision foundation models (VFMs).We analyze how geometric regularization, explicit shape modeling, and generative inference are used to mitigate artifacts such as floaters and pose ambiguities in sparse-view settings. Comparative results on standard benchmarks reveal key trade-offs between the reconstruction accuracy, efficiency, and generalization. Unlike previous reviews, our survey provides a unified perspective on geometry-based, neural implicit, and generative (diffusion-based) methods. We highlight the persistent challenges in domain generalization and pose-free reconstruction and outline future directions for developing 3D-native generative priors and achieving real-time, unconstrained sparse-view reconstruction.

Key facts. Cited by 4 papers in the map (data through 14 Oct 2026). Builds on 164 of its 200 references that are in the map. First posted on arXiv 22 Jul 2025.

Builds on

164 of 200 references.

References · 164

  1. 2021Learning Transferable Visual Models From Natural Language Supervisioncited by 33,744
  2. 2020Denoising Diffusion Probabilistic Modelscited by 21,076
  3. 2021High-Resolution Image Synthesis with Latent Diffusion Modelscited by 18,863
  4. 2014Very Deep Convolutional Networks for Large-Scale Image Recognitioncited by 15,364
  5. 2018The Unreasonable Effectiveness of Deep Features as a Perceptual Metriccited by 11,177
  6. 2023Segment Anythingcited by 8,234
  7. 2020End-to-End Object Detection with Transformerscited by 7,414
  8. 2021Emerging Properties in Self-Supervised Vision Transformerscited by 6,968
  9. 20233D Gaussian Splatting for Real-Time Radiance Field Renderingcited by 6,226
  10. 2023Adding Conditional Control to Text-to-Image Diffusion Modelscited by 5,503
  11. 2022Instant Neural Graphics Primitives with a Multiresolution Hash Encodingcited by 3,723
  12. 2017ScanNet: Richly-annotated 3D Reconstructions of Indoor Scenescited by 3,117
38 more
  1. 2022DreamFusion: Text-to-3D using 2D Diffusioncited by 3,025
  2. 2015ShapeNet: An Information-Rich 3D Model Repositorycited by 2,897
  3. 2023Stable Video Diffusion: Scaling Latent Video Diffusion Models to Large Datasetscited by 2,581
  4. 2022Video Diffusion Modelscited by 2,305
  5. 2016Density estimation using Real NVPcited by 2,042
  6. 2018Occupancy Networks: Learning 3D Reconstruction in Function Spacecited by 2,041
  7. 2021Vision Transformers for Dense Predictioncited by 1,803
  8. 2020pixelNeRF: Neural Radiance Fields from One or Few Imagescited by 1,584
  9. 2023DUSt3R: Geometric 3D Vision Made Easycited by 1,567
  10. 2025VGGT: Visual Geometry Grounded Transformercited by 1,539
  11. 2017Matterport3D: Learning from RGB-D Data in Indoor Environmentscited by 1,376
  12. 2022TensoRF: Tensorial Radiance Fieldscited by 1,280
  13. 2016A Point Set Generation Network for 3D Object Reconstruction from a Single Imagecited by 979
  14. 2020Image Quality Assessment: Unifying Structure and Texture Similaritycited by 811
  15. 2021Depth-supervised NeRF: Fewer Views and Faster Training for Freecited by 735
  16. 2021IBRNet: Learning Multi-View Image-Based Renderingcited by 703
  17. 2023pixelSplat: 3D Gaussian Splats from Image Pairs for Scalable Generalizable 3D Reconstructioncited by 684
  18. 2019Local Light Field Fusion: Practical View Synthesis with Prescriptive Sampling Guidelinescited by 672
  19. 2021Common Objects in 3D: Large-Scale Learning and Evaluation of Real-life 3D Category Reconstructioncited by 652
  20. 2021BARF: Bundle-Adjusting Neural Radiance Fieldscited by 642
  21. 2021RegNeRF: Regularizing Neural Radiance Fields for View Synthesis from Sparse Inputscited by 615
  22. 2023DL3DV-10K: A Large-Scale Scene Dataset for Deep Learning-based 3D Visioncited by 537
  23. 2021Putting NeRF on a Diet: Semantically Consistent Few-Shot View Synthesiscited by 464
  24. 2024CAT3D: Create Anything in 3D with Multi-View Diffusion Modelscited by 432
  25. 2024ViewCrafter: Taming Video Diffusion Models for High-fidelity Novel View Synthesiscited by 403
  26. 2023Repurposing Diffusion-Based Image Generators for Monocular Depth Estimationcited by 327
  27. 2023OmniObject3D: Large-Vocabulary 3D Object Dataset for Realistic Perception, Reconstruction and Generationcited by 326
  28. 2023ReconFusion: 3D Reconstruction with Diffusion Priorscited by 318
  29. 2023FreeNeRF: Improving Few-shot Neural Rendering with Free Frequency Regularizationcited by 311
  30. 2021Dense Depth Priors for Neural Radiance Fields from Sparse Input Viewscited by 302
  31. 2023FSGS: Real-Time Few-shot View Synthesis using Gaussian Splattingcited by 279
  32. 2024DNGaussian: Optimizing Sparse-View 3D Gaussian Radiance Fields with Global-Local Depth Normalizationcited by 256
  33. 2023MVImgNet: A Large-scale Dataset of Multi-view Imagescited by 220
  34. 2022SparseFusion: Distilling View-conditioned Diffusion for 3D Reconstructioncited by 216
  35. 2023COLMAP-Free 3D Gaussian Splattingcited by 193
  36. 2021Stereo Radiance Fields (SRF): Learning View Synthesis for Sparse Views of Novel Scenescited by 190
  37. 2021InfoNeRF: Ray Entropy Minimization for Few-Shot Neural Volume Renderingcited by 182
  38. 2023Depth-Regularized Optimization for 3D Gaussian Splatting in Few-Shot Imagescited by 173

50 most cited of 164 All 164 (JSON)

Built on by

Cited by year (2026 to 14 Oct)

Citing papers per year: 2025: 1; 2026: 3.

4 papers.