GeCoNeRF: Few-shot Neural Radiance Fields via Geometric Consistency
Not on the map. Why?
Abstract (arXiv)
We present a novel framework to regularize Neural Radiance Field (NeRF) in a few-shot setting with a geometry-aware consistency regularization. The proposed approach leverages a rendered depth map at unobserved viewpoint to warp sparse input images to the unobserved viewpoint and impose them as pseudo ground truths to facilitate learning of NeRF. By encouraging such geometry-aware consistency at a feature-level instead of using pixel-level reconstruction loss, we regularize the NeRF at semantic and structural levels while allowing for modeling view dependent radiance to account for color variations across viewpoints. We also propose an effective method to filter out erroneous warped solutions, along with training strategies to stabilize training during optimization. We show that our model achieves competitive results compared to state-of-the-art few-shot NeRF models. Project page is available at https://ku-cvlab.github.io/GeCoNeRF/.
Key facts. Cited by 54 papers in the map (data through 7 Oct 2026). Builds on 41 of its 47 references that are in the map. First posted on arXiv 26 Jan 2023.
Builds on
41 of 47 references.
References · 41
- 2014Adam: A Method for Stochastic Optimizationcited by 36,960
- 2014Very Deep Convolutional Networks for Large-Scale Image Recognitioncited by 15,267
- 2018The Unreasonable Effectiveness of Deep Features as a Perceptual Metriccited by 11,029
- 2022Instant Neural Graphics Primitives with a Multiresolution Hash Encodingcited by 3,698
- 2016Perceptual Losses for Real-Time Style Transfer and Super-Resolutioncited by 2,678
- 2020Fourier Features Let Networks Learn High Frequency Functions in Low Dimensional Domainscited by 2,170
- 2021Mip-NeRF: A Multiscale Representation for Anti-Aliasing Neural Radiance Fieldscited by 1,957
- 2020pixelNeRF: Neural Radiance Fields from One or Few Imagescited by 1,574
- 2020D-NeRF: Neural Radiance Fields for Dynamic Scenescited by 1,459
- 2015Spatial Transformer Networkscited by 1,423
- 2020Nerfies: Deformable Neural Radiance Fieldscited by 1,194
- 2021PlenOctrees for Real-time Rendering of Neural Radiance Fieldscited by 904
29 more
- 2020NeRF++: Analyzing and Improving Neural Radiance Fieldscited by 857
- 2016Unsupervised Monocular Depth Estimation with Left-Right Consistencycited by 819
- 2020GIRAFFE: Representing Scenes as Compositional Generative Neural Feature Fieldscited by 784
- 2017Unsupervised Learning of Depth and Ego-Motion from Videocited by 778
- 2021MVSNeRF: Fast Generalizable Radiance Field Reconstruction from Multi-View Stereocited by 735
- 2021Depth-supervised NeRF: Fewer Views and Faster Training for Freecited by 732
- 2020GRAF: Generative Radiance Fields for 3D-Aware Image Synthesiscited by 688
- 2019Local Light Field Fusion: Practical View Synthesis with Prescriptive Sampling Guidelinescited by 672
- 2021KiloNeRF: Speeding up Neural Radiance Fields with Thousands of Tiny MLPscited by 672
- 2021RegNeRF: Regularizing Neural Radiance Fields for View Synthesis from Sparse Inputscited by 614
- 2020Non-Rigid Neural Radiance Fields: Reconstruction and Novel View Synthesis of a Dynamic Scene From Monocular Videocited by 470
- 2021Baking Neural Radiance Fields for Real-Time View Synthesiscited by 465
- 2021Putting NeRF on a Diet: Semantically Consistent Few-Shot View Synthesiscited by 464
- 2016Unsupervised CNN for Single View Depth Estimation: Geometry to the Rescuecited by 368
- 2021Dense Depth Priors for Neural Radiance Fields from Sparse Input Viewscited by 301
- 2021GRAM: Generative Radiance Manifolds for 3D-Aware Image Generationcited by 216
- 2022Geo-Neus: Geometry-Consistent Neural Implicit Surfaces Learning for Multi-view Reconstructioncited by 211
- 2021Self-Calibrating Neural Radiance Fieldscited by 204
- 2021Stereo Radiance Fields (SRF): Learning View Synthesis for Sparse Views of Novel Scenescited by 190
- 2021InfoNeRF: Ray Entropy Minimization for Few-Shot Neural Volume Renderingcited by 180
- 2018Unsupervised Learning of Monocular Depth Estimation and Visual Odometry with Deep Feature Reconstructioncited by 159
- 2021Improving neural implicit surfaces geometry with patch warpingcited by 136
- 2021T"oRF: Time-of-Flight Radiance Fields for Dynamic Scene View Synthesiscited by 88
- 2021Learning Signed Distance Field for Multi-view Surface Reconstructioncited by 76
- 2021Generative Occupancy Fields for 3D Surface-Aware Image Synthesiscited by 51
- 2019Learning Unsupervised Multi-View Stereopsis via Robust Photometric Consistencycited by 40
- 2020M^3VSNet: Unsupervised Multi-metric Multi-view Stereo Networkcited by 29
- 2022StructNeRF: Neural Radiance Fields for Indoor Scenes with Structural Hintscited by 28
- 2022Ray Priors through Reprojection: Improving Neural Radiance Fields for Novel View Extrapolationcited by 26
Built on by
Citing papers per year: 2023: 10; 2024: 25; 2025: 15; 2026: 4.
54 papers.
Sort:
By area:
- 2023ReconFusion: 3D Reconstruction with Diffusion Priorscited by 317
- 2024PF3plat: Pose-Free Feed-Forward 3D Gaussian Splattingcited by 60
- 2023SimpleNeRF: Regularizing Sparse Input Neural Radiance Fields with Simpler Solutionscited by 44
- 2024Binocular-Guided 3D Gaussian Splatting with View Consistency for Sparse View Synthesiscited by 41
- 2023Deceptive-NeRF/3DGS: Diffusion-Generated Pseudo-Observations for High-Quality Sparse-View Reconstructioncited by 39
- 2024SGD: Street View Synthesis with Gaussian Splatting and Diffusion Priorcited by 36
- 2024Relaxing Accurate Initialization Constraint for 3D Gaussian Splattingcited by 33
- 2025Decompositional Neural Scene Reconstruction with Generative Diffusion Priorcited by 30
- 2023FlipNeRF: Flipped Reflection Rays for Few-shot Novel View Synthesiscited by 29
- 2024MVPGS: Excavating Multi-view Priors for Gaussian Splatting from Sparse Input Viewscited by 29
- 2025DropoutGS: Dropping Out Gaussians for Better Sparse-view Renderingcited by 29
- 20244D Gaussian Splatting in the Wild with Uncertainty-Aware Regularizationcited by 28
38 more
- 2023DaRF: Boosting Radiance Fields from Sparse Inputs with Monocular Depth Adaptationcited by 25
- 2024FrugalNeRF: Fast Convergence for Extreme Few-shot Novel View Synthesis without Learned Priorscited by 18
- 2023MapNeRF: Incorporating Map Priors into Neural Radiance Fields for Driving View Simulationcited by 15
- 2024Is Vanilla MLP in Neural Radiance Field Enough for Few-shot View Synthesis?cited by 15
- 2025HoloScene: Simulation-Ready Interactive 3D Worlds from a Single Videocited by 13
- 2023CaesarNeRF: Calibrated Semantic Representation for Few-shot Generalizable Neural Renderingcited by 10
- 2025CoMapGS: Covisibility Map-based Gaussian Splatting for Sparse Novel View Synthesiscited by 10
- 2024Semantically-aware Neural Radiance Fields for Visual Scene Understanding: A Comprehensive Reviewcited by 9
- 2024Generic Objects as Pose Probes for Few-shot View Synthesiscited by 9
- 2024How to Use Diffusion Priors under Sparse Views?cited by 8
- 2024ResGS: Residual Densification of 3D Gaussian for Efficient Detail Recoverycited by 7
- 2024Learning with Unreliability: Fast Few-shot Voxel Radiance Fields with Relative Geometric Consistencycited by 6
- 2024Geometry-Aware Score Distillation via 3D Consistent Noising and Gradient Consistency Modelingcited by 6
- 2024Transientangelo: Few-Viewpoint Surface Reconstruction Using Single-Photon Lidarcited by 6
- 2024AIM 2024 Sparse Neural Rendering Challenge: Dataset and Benchmarkcited by 6
- 2024MCGS: Multiview Consistency Enhancement for Sparse-View 3D Gaussian Radiance Fieldscited by 6
- 2024Few-shot NeRF by Adaptive Rendering Loss Regularizationcited by 6
- 2025DWTNeRF: Boosting Few-shot Neural Radiance Fields via Discrete Wavelet Transformcited by 6
- 2025Empowering Sparse-Input Neural Radiance Fields with Dual-Level Semantic Guidance from Dense Novel Viewscited by 6
- 2025Aligned Novel View Image and Geometry Synthesis via Cross-modal Attention Instillationcited by 5
- 2023Self-Evolving Neural Radiance Fieldscited by 4
- 2024CMC: Few-shot Novel View Synthesis via Cross-view Multiplane Consistencycited by 4
- 2025Novel View Synthesis from A Few Glimpses via Test-Time Natural Video Completioncited by 4
- 2024FrameNeRF: A Simple and Efficient Framework for Few-shot Novel View Synthesiscited by 3
- 2024Multiplane Prior Guided Few-Shot Aerial Scene Renderingcited by 3
- 2025Sparse-View 3D Reconstruction: Recent Advances and Open Challengescited by 3
- 2025UFV-Splatter: Pose-Free Feed-Forward 3D Gaussian Splatting Adapted to Unfavorable Viewscited by 3
- 2023Depth-NeuS: Neural Implicit Surfaces Learning for Multi-view Reconstruction Based on Depth Information Optimizationcited by 2
- 2024Spatial Annealing for Efficient Few-shot Neural Renderingcited by 2
- 2025GoLF-NRT: Integrating Global Context and Local Geometry for Few-Shot View Synthesiscited by 2
- 2025PCR-GS: COLMAP-Free 3D Gaussian Splatting via Pose Co-Regularizationscited by 2
- 2026Learning Global Motion with Compact Gaussians for Feed-Forward 4D Reconstructioncited by 2
- 2024ARC-NeRF: Area Ray Casting for Broader Unseen View Coverage in Few-shot Object Renderingcited by 1
- 2024SGCNeRF: Few-Shot Neural Rendering via Sparse Geometric Consistency Guidancecited by 1
- 2024Simple-RF: Regularizing Sparse Input Radiance Fields with Simpler Solutionscited by 1
- 2025TriDF: Triplane-Accelerated Density Fields for Few-Shot Remote Sensing Novel View Synthesiscited by 1
- 2023VoxNeRF: Bridging Voxel Representation and Neural Radiance Fields for Enhanced Indoor View Synthesiscited by 0
- 2025DivCon-NeRF: Diverse and Consistent Ray Augmentation for Few-Shot NeRFcited by 0
50 most cited of 54 All 54 (JSON)
- 2026From Uncertainty to Stability and Fidelity: Guiding Sparse-View 3D Gaussian Splatting with Fisher Information18 Jun 2026
- 2026Learning Global Motion with Compact Gaussians for Feed-Forward 4D Reconstruction29 May 2026
- 2026GRVS: a Generalizable and Recurrent Approach to Monocular Dynamic View Synthesis31 Mar 2026
- 2026HeroGS: Hierarchical Guidance for Robust 3D Gaussian Splatting under Sparse Views1 Mar 2026
- 2025Novel View Synthesis from A Few Glimpses via Test-Time Natural Video Completion22 Nov 2025
- 2025HoloScene: Simulation-Ready Interactive 3D Worlds from a Single Video7 Oct 2025
- 2025UFV-Splatter: Pose-Free Feed-Forward 3D Gaussian Splatting Adapted to Unfavorable Views30 Jul 2025
- 2025Sparse-View 3D Reconstruction: Recent Advances and Open Challenges22 Jul 2025
- 2025PCR-GS: COLMAP-Free 3D Gaussian Splatting via Pose Co-Regularizations18 Jul 2025
- 2025RePaintGS: Reference-Guided Gaussian Splatting for Realistic and View-Consistent 3D Scene Inpainting11 Jul 2025
- 2025Aligned Novel View Image and Geometry Synthesis via Cross-modal Attention Instillation13 Jun 2025
- 2025GoLF-NRT: Integrating Global Context and Local Geometry for Few-Shot View Synthesis26 May 2025
38 more
- 2025DropoutGS: Dropping Out Gaussians for Better Sparse-view Rendering13 Apr 2025
- 2025CoMapGS: Covisibility Map-based Gaussian Splatting for Sparse Novel View Synthesis25 Mar 2025
- 2025Decompositional Neural Scene Reconstruction with Generative Diffusion Prior19 Mar 2025
- 2025TriDF: Triplane-Accelerated Density Fields for Few-Shot Remote Sensing Novel View Synthesis17 Mar 2025
- 2025DivCon-NeRF: Diverse and Consistent Ray Augmentation for Few-Shot NeRF17 Mar 2025
- 2025Empowering Sparse-Input Neural Radiance Fields with Dual-Level Semantic Guidance from Dense Novel Views4 Mar 2025
- 2025DWTNeRF: Boosting Few-shot Neural Radiance Fields via Discrete Wavelet Transform22 Jan 2025
- 2024ResGS: Residual Densification of 3D Gaussian for Efficient Detail Recovery10 Dec 2024
- 2024How to Use Diffusion Priors under Sparse Views?3 Dec 2024
- 20244D Gaussian Splatting in the Wild with Uncertainty-Aware Regularization13 Nov 2024
- 2024PF3plat: Pose-Free Feed-Forward 3D Gaussian Splatting29 Oct 2024
- 2024Binocular-Guided 3D Gaussian Splatting with View Consistency for Sparse View Synthesis24 Oct 2024
- 2024Few-shot NeRF by Adaptive Rendering Loss Regularization23 Oct 2024
- 2024FrugalNeRF: Fast Convergence for Extreme Few-shot Novel View Synthesis without Learned Priors21 Oct 2024
- 2024MCGS: Multiview Consistency Enhancement for Sparse-View 3D Gaussian Radiance Fields15 Oct 2024
- 2024AIM 2024 Sparse Neural Rendering Challenge: Dataset and Benchmark23 Sep 2024
- 2024MVPGS: Excavating Multi-view Priors for Gaussian Splatting from Sparse Input Views22 Sep 2024
- 2024Generic Objects as Pose Probes for Few-shot View Synthesis29 Aug 2024
- 2024Transientangelo: Few-Viewpoint Surface Reconstruction Using Single-Photon Lidar22 Aug 2024
- 2024Geometry-Aware Score Distillation via 3D Consistent Noising and Gradient Consistency Modeling24 Jun 2024
- 2024Spatial Annealing for Efficient Few-shot Neural Rendering12 Jun 2024
- 2024Multiplane Prior Guided Few-Shot Aerial Scene Rendering7 Jun 2024
- 2024Simple-RF: Regularizing Sparse Input Radiance Fields with Simpler Solutions29 Apr 2024
- 2024SGCNeRF: Few-Shot Neural Rendering via Sparse Geometric Consistency Guidance1 Apr 2024
- 2024SGD: Street View Synthesis with Gaussian Splatting and Diffusion Prior29 Mar 2024
- 2024Learning with Unreliability: Fast Few-shot Voxel Radiance Fields with Relative Geometric Consistency26 Mar 2024
- 2024ARC-NeRF: Area Ray Casting for Broader Unseen View Coverage in Few-shot Object Rendering16 Mar 2024
- 2024Relaxing Accurate Initialization Constraint for 3D Gaussian Splatting14 Mar 2024
- 2024Is Vanilla MLP in Neural Radiance Field Enough for Few-shot View Synthesis?10 Mar 2024
- 2024CMC: Few-shot Novel View Synthesis via Cross-view Multiplane Consistency26 Feb 2024
- 2024FrameNeRF: A Simple and Efficient Framework for Few-shot Novel View Synthesis22 Feb 2024
- 2024Semantically-aware Neural Radiance Fields for Visual Scene Understanding: A Comprehensive Review17 Feb 2024
- 2023ReconFusion: 3D Reconstruction with Diffusion Priors5 Dec 2023
- 2023Self-Evolving Neural Radiance Fields2 Dec 2023
- 2023CaesarNeRF: Calibrated Semantic Representation for Few-shot Generalizable Neural Rendering27 Nov 2023
- 2023VoxNeRF: Bridging Voxel Representation and Neural Radiance Fields for Enhanced Indoor View Synthesis9 Nov 2023
- 2023SimpleNeRF: Regularizing Sparse Input Neural Radiance Fields with Simpler Solutions7 Sep 2023
- 2023MapNeRF: Incorporating Map Priors into Neural Radiance Fields for Driving View Simulation27 Jul 2023
50 newest of 54 All 54 (JSON)
- 2023ReconFusion: 3D Reconstruction with Diffusion Priorscited by 317
- 2023Deceptive-NeRF/3DGS: Diffusion-Generated Pseudo-Observations for High-Quality Sparse-View Reconstructioncited by 39
- 2025Decompositional Neural Scene Reconstruction with Generative Diffusion Priorcited by 30
- 2024How to Use Diffusion Priors under Sparse Views?cited by 8
- 2024Geometry-Aware Score Distillation via 3D Consistent Noising and Gradient Consistency Modelingcited by 6
- 2025Decompositional Neural Scene Reconstruction with Generative Diffusion Prior19 Mar 2025
- 2024How to Use Diffusion Priors under Sparse Views?3 Dec 2024
- 2024Geometry-Aware Score Distillation via 3D Consistent Noising and Gradient Consistency Modeling24 Jun 2024
- 2023ReconFusion: 3D Reconstruction with Diffusion Priors5 Dec 2023
- 2023Deceptive-NeRF/3DGS: Diffusion-Generated Pseudo-Observations for High-Quality Sparse-View Reconstruction24 May 2023
- 2024PF3plat: Pose-Free Feed-Forward 3D Gaussian Splattingcited by 60
- 2023SimpleNeRF: Regularizing Sparse Input Neural Radiance Fields with Simpler Solutionscited by 44
- 2024Binocular-Guided 3D Gaussian Splatting with View Consistency for Sparse View Synthesiscited by 41
- 2024Relaxing Accurate Initialization Constraint for 3D Gaussian Splattingcited by 33
- 2023FlipNeRF: Flipped Reflection Rays for Few-shot Novel View Synthesiscited by 29
- 2024MVPGS: Excavating Multi-view Priors for Gaussian Splatting from Sparse Input Viewscited by 29
- 2025DropoutGS: Dropping Out Gaussians for Better Sparse-view Renderingcited by 29
- 20244D Gaussian Splatting in the Wild with Uncertainty-Aware Regularizationcited by 28
- 2023DaRF: Boosting Radiance Fields from Sparse Inputs with Monocular Depth Adaptationcited by 25
- 2024FrugalNeRF: Fast Convergence for Extreme Few-shot Novel View Synthesis without Learned Priorscited by 18
- 2023MapNeRF: Incorporating Map Priors into Neural Radiance Fields for Driving View Simulationcited by 15
- 2024Is Vanilla MLP in Neural Radiance Field Enough for Few-shot View Synthesis?cited by 15
12 most cited of 48 All 48 (JSON)
- 2026From Uncertainty to Stability and Fidelity: Guiding Sparse-View 3D Gaussian Splatting with Fisher Information18 Jun 2026
- 2026Learning Global Motion with Compact Gaussians for Feed-Forward 4D Reconstruction29 May 2026
- 2026GRVS: a Generalizable and Recurrent Approach to Monocular Dynamic View Synthesis31 Mar 2026
- 2026HeroGS: Hierarchical Guidance for Robust 3D Gaussian Splatting under Sparse Views1 Mar 2026
- 2025Novel View Synthesis from A Few Glimpses via Test-Time Natural Video Completion22 Nov 2025
- 2025HoloScene: Simulation-Ready Interactive 3D Worlds from a Single Video7 Oct 2025
- 2025UFV-Splatter: Pose-Free Feed-Forward 3D Gaussian Splatting Adapted to Unfavorable Views30 Jul 2025
- 2025Sparse-View 3D Reconstruction: Recent Advances and Open Challenges22 Jul 2025
- 2025PCR-GS: COLMAP-Free 3D Gaussian Splatting via Pose Co-Regularizations18 Jul 2025
- 2025RePaintGS: Reference-Guided Gaussian Splatting for Realistic and View-Consistent 3D Scene Inpainting11 Jul 2025
- 2025Aligned Novel View Image and Geometry Synthesis via Cross-modal Attention Instillation13 Jun 2025
- 2025GoLF-NRT: Integrating Global Context and Local Geometry for Few-Shot View Synthesis26 May 2025
12 newest of 48 All 48 (JSON)