mlsanityData to 7 Oct 2026

Binocular-Guided 3D Gaussian Splatting with View Consistency for Sparse View Synthesis

arXiv 2410.18822 ↗First posted 24 Oct 2024cs.CVcited by 41

Not on the map. Why?

Abstract (arXiv)

Novel view synthesis from sparse inputs is a vital yet challenging task in 3D computer vision. Previous methods explore 3D Gaussian Splatting with neural priors (e.g. depth priors) as an additional supervision, demonstrating promising quality and efficiency compared to the NeRF based methods. However, the neural priors from 2D pretrained models are often noisy and blurry, which struggle to precisely guide the learning of radiance fields. In this paper, We propose a novel method for synthesizing novel views from sparse views with Gaussian Splatting that does not require external prior as supervision. Our key idea lies in exploring the self-supervisions inherent in the binocular stereo consistency between each pair of binocular images constructed with disparity-guided image warping. To this end, we additionally introduce a Gaussian opacity constraint which regularizes the Gaussian locations and avoids Gaussian redundancy for improving the robustness and efficiency of inferring 3D Gaussians from sparse views. Extensive experiments on the LLFF, DTU, and Blender datasets demonstrate that our method significantly outperforms the state-of-the-art methods.

Key facts. Cited by 41 papers in the map (data through 7 Oct 2026). Builds on 62 of its 72 references that are in the map. First posted on arXiv 24 Oct 2024.

Builds on

62 of 72 references.

References · 62

  1. 2018The Unreasonable Effectiveness of Deep Features as a Perceptual Metriccited by 11,029
  2. 20233D Gaussian Splatting for Real-Time Radiance Field Renderingcited by 6,141
  3. 2022Instant Neural Graphics Primitives with a Multiresolution Hash Encodingcited by 3,698
  4. 2021Mip-NeRF 360: Unbounded Anti-Aliased Neural Radiance Fieldscited by 2,013
  5. 2021Mip-NeRF: A Multiscale Representation for Anti-Aliasing Neural Radiance Fieldscited by 1,957
  6. 2021Vision Transformers for Dense Predictioncited by 1,789
  7. 2021NeuS: Learning Neural Implicit Surfaces by Volume Rendering for Multi-view Reconstructioncited by 1,701
  8. 2021Plenoxels: Radiance Fields without Neural Networkscited by 1,607
  9. 2020pixelNeRF: Neural Radiance Fields from One or Few Imagescited by 1,574
  10. 2019Towards Robust Monocular Depth Estimation: Mixing Datasets for Zero-shot Cross-dataset Transfercited by 1,484
  11. 2024Depth Anything: Unleashing the Power of Large-Scale Unlabeled Datacited by 1,346
  12. 2022TensoRF: Tensorial Radiance Fieldscited by 1,275
38 more
  1. 2021Volume Rendering of Neural Implicit Surfacescited by 990
  2. 2021LoFTR: Detector-Free Local Feature Matching with Transformerscited by 974
  3. 2021Direct Voxel Grid Optimization: Super-fast Convergence for Radiance Fields Reconstructioncited by 961
  4. 2016Unsupervised Monocular Depth Estimation with Left-Right Consistencycited by 819
  5. 2023K-Planes: Explicit Radiance Fields in Space, Time, and Appearancecited by 742
  6. 2021MVSNeRF: Fast Generalizable Radiance Field Reconstruction from Multi-View Stereocited by 735
  7. 2021Depth-supervised NeRF: Fewer Views and Faster Training for Freecited by 732
  8. 2019Local Light Field Fusion: Practical View Synthesis with Prescriptive Sampling Guidelinescited by 672
  9. 2023Zip-NeRF: Anti-Aliased Grid-Based Neural Radiance Fieldscited by 667
  10. 2021RegNeRF: Regularizing Neural Radiance Fields for View Synthesis from Sparse Inputscited by 614
  11. 2023SuGaR: Surface-Aligned Gaussian Splatting for Efficient 3D Mesh Reconstruction and High-Quality Mesh Renderingcited by 611
  12. 2021Putting NeRF on a Diet: Semantically Consistent Few-Shot View Synthesiscited by 464
  13. 2023ReconFusion: 3D Reconstruction with Diffusion Priorscited by 317
  14. 2023FreeNeRF: Improving Few-shot Neural Rendering with Free Frequency Regularizationcited by 310
  15. 2023FSGS: Real-Time Few-shot View Synthesis using Gaussian Splattingcited by 278
  16. 2024DNGaussian: Optimizing Sparse-View 3D Gaussian Radiance Fields with Global-Local Depth Normalizationcited by 256
  17. 2023SparseNeRF: Distilling Depth Ranking for Few-shot Novel View Synthesiscited by 247
  18. 2023Uni3D: Exploring Unified 3D Representation at Scalecited by 231
  19. 2022SPARF: Neural Radiance Fields from Sparse and Noisy Posescited by 195
  20. 2021InfoNeRF: Ray Entropy Minimization for Few-Shot Neural Volume Renderingcited by 180
  21. 2023Tri-MipRF: Tri-Mip Representation for Efficient Anti-Aliasing Neural Radiance Fieldscited by 142
  22. 2023SparseGS: Sparse View Synthesis using 3D Gaussian Splattingcited by 134
  23. 2022Diffusion-SDF: Conditional Generative Modeling of Signed Distance Functionscited by 133
  24. 2023DiffusioNeRF: Regularizing Neural Radiance Fields with Denoising Diffusion Modelscited by 127
  25. 2022Lite-Mono: A Lightweight CNN and Transformer Architecture for Self-Supervised Monocular Depth Estimationcited by 100
  26. 2021PDC-Net+: Enhanced Probabilistic Dense Correspondence Networkcited by 80
  27. 2023MuRF: Multi-Baseline Radiance Fieldscited by 70
  28. 2024GS2Mesh: Surface Reconstruction from Gaussian Splatting via Novel Stereo Viewscited by 65
  29. 2024CoherentGS: Sparse Novel View Synthesis with Coherent 3D Gaussianscited by 62
  30. 2023GeCoNeRF: Few-shot Neural Radiance Fields via Geometric Consistencycited by 54
  31. 2024Neural Signed Distance Function Inference through Splatting 3D Gaussians Pulled on Zero-Level Setcited by 47
  32. 2022Implicit Autoencoder for Point-Cloud Self-Supervised Representation Learningcited by 46
  33. 2022CAP-UDF: Learning Unsigned Distance Functions Progressively from Raw Point Clouds with Consistency-Aware Field Optimizationcited by 46
  34. 20223D Shape Reconstruction from 2D Images with Disentangled Attribute Flowcited by 45
  35. 2023ViP-NeRF: Visibility Prior for Sparse Input Neural Radiance Fieldscited by 43
  36. 2023Towards Better Gradient Consistency for Neural Signed Distance Functions via Level Set Alignmentcited by 39
  37. 2022NeAF: Learning Neural Angle Fields for Point Normal Estimationcited by 38
  38. 2023Learning a More Continuous Zero Level Set in Unsigned Distance Fields through Level Set Projectioncited by 36

50 most cited of 62 All 62 (JSON)

Built on by

Cited by year (2026 to 7 Oct)

Citing papers per year: 2024: 4; 2025: 20; 2026: 17.

41 papers.

Sort:

By area:

  1. 2024You See it, You Got it: Learning 3D Creation on Pose-Free Videos at Scalecited by 65
  2. 2024DiffGS: Functional Gaussian Splatting Diffusioncited by 50
  3. 2025FatesGS: Fast and Accurate Sparse-View Surface Reconstruction using Gaussian Splatting with Depth-Feature Consistencycited by 30
  4. 2025Taming Video Diffusion Prior with Scene-Grounding Guidance for 3D Gaussian Splatting from Sparse Inputscited by 29
  5. 2025MaterialRefGS: Reflective Gaussian Splatting with Multi-view Consistent Material Inferencecited by 22
  6. 2025MonoInstance: Enhancing Monocular Priors via Multi-view Instance Alignment for Neural Rendering and Reconstructioncited by 15
  7. 2024Self-Ensembling Gaussian Splatting for Few-Shot Novel View Synthesiscited by 14
  8. 2025GaussianUDF: Inferring Unsigned Distance Functions through 3D Gaussian Splattingcited by 14
  9. 2025NeRFPrior: Learning Neural Radiance Field as a Prior for Indoor Scene Reconstructioncited by 12
  10. 2025Quantifying and Alleviating Co-Adaptation in Sparse-View 3D Gaussian Splattingcited by 12
  11. 2024MultiPull: Detailing Signed Distance Functions by Pulling Multi-Level Queries at Multi-Stepcited by 11
  12. 2025SparseRecon: Neural Implicit Surface Reconstruction from Sparse Views with Feature and Depth Consistenciescited by 9
29 more
  1. 2025Learning Bijective Surface Parameterization for Inferring Signed Distance Functions from Sparse Point Clouds with Grid Deformationcited by 7
  2. 2025GAP: Gaussianize Any Point Clouds with Text Guidancecited by 7
  3. 2025TinySplat: Feedforward Approach for Generating Compact 3D Scene Representationcited by 5
  4. 2026Dropping Anchor and Spherical Harmonics for Sparse-view Gaussian Splattingcited by 5
  5. 2025Peering into the Unknown: Active View Selection with Neural Uncertainty Maps for 3D Reconstructioncited by 4
  6. 20264C4D: 4 Camera 4D Gaussian Splattingcited by 4
  7. 2025U-CAN: Unsupervised Point Cloud Denoising with Consistency-Aware Noise2Noise Matchingcited by 3
  8. 2025G3Splat: Geometrically Consistent Generalizable Gaussian Splattingcited by 3
  9. 2026Speeding Up the Learning of 3D Gaussians with Much Shorter Gaussian Listscited by 3
  10. 2026OceanSplat: Object-aware Gaussian Splatting with Trinocular View Consistency for Underwater Scene Reconstructioncited by 2
  11. 2026Intrinsic Geometry-Appearance Consistency Optimization for Sparse-View Gaussian Splattingcited by 2
  12. 2026DOC-GS: Dual-Domain Observation and Calibration for Reliable Sparse-View Gaussian Splattingcited by 2
  13. 2025Learning Fine-Grained Geometry for Sparse-View Splatting via Cascade Depth Losscited by 1
  14. 2025HBSplat: Robust Sparse-View Gaussian Reconstruction with Hybrid-Loss Guided Depth and Bidirectional Warpingcited by 1
  15. 2025FrontierGS: Progressive View-Space Frontier Expansion for Sparse 3D Gaussian Splattingcited by 1
  16. 2026Pseudo-View Enhancement via Confidence Fusion for Unposed Sparse-View Reconstructioncited by 1
  17. 2026SGAD-SLAM: Splatting Gaussians at Adjusted Depth for Better Radiance Fields in RGBD SLAMcited by 1
  18. 2026SGS-Intrinsic: Semantic-Invariant Gaussian Splatting for Sparse-View Indoor Inverse Renderingcited by 1
  19. 2026VidSplat: Gaussian Splatting Reconstruction with Geometry-Guided Video Diffusion Priorscited by 1
  20. 2026City-Level 3D Surface Reconstruction with Viewpoint Orientation Partitioning and Scene Completioncited by 1
  21. 2026MAC-Splat: Multi-Attribute Consistency for High-Fidelity Sparse-View Reconstructioncited by 1
  22. 2025Zero-P-to-3: Zero-Shot Partial-View Images to 3D Objectcited by 0
  23. 2025MatchAttention: Embedding Explicit Matching Constraints into Attention for Efficient Stereo Matchingcited by 0
  24. 2025Do Flat Minima Improve Sparse Novel View Synthesis?cited by 0
  25. 2026GeoRect4D: Geometry-Compatible Generative Rectification for Dynamic Sparse-View 3D Reconstructioncited by 0
  26. 2026TWINGS: Thin Plate Splines Warp-aligned Initialization for Sparse-View Gaussian Splattingcited by 0
  27. 2026Sparse-View Surface Reconstruction using Gaussian Splatting through High-Confidence Depth Propagation with Normal Priorscited by 0
  28. 2026TV-SGS: Gaussian Splatting with Geometric Information Propagation via Tensor Voting under sparse viewscited by 0
  29. 2026D3GS: Depth, DINO, and RGB Diffusion Co-Guided 3D Gaussian Splatting for Sparse-View Reconstructioncited by 0