SPARF: Neural Radiance Fields from Sparse and Noisy Poses
Not on the map. Why?
Abstract (arXiv)
Neural Radiance Field (NeRF) has recently emerged as a powerful representation to synthesize photorealistic novel views. While showing impressive performance, it relies on the availability of dense input views with highly accurate camera poses, thus limiting its application in real-world scenarios. In this work, we introduce Sparse Pose Adjusting Radiance Field (SPARF), to address the challenge of novel-view synthesis given only few wide-baseline input images (as low as 3) with noisy camera poses. Our approach exploits multi-view geometry constraints in order to jointly learn the NeRF and refine the camera poses. By relying on pixel matches extracted between the input views, our multi-view correspondence objective enforces the optimized scene and camera poses to converge to a global and geometrically accurate solution. Our depth consistency loss further encourages the reconstructed scene to be consistent from any viewpoint. Our approach sets a new state of the art in the sparse-view regime on multiple challenging datasets.
Key facts. Cited by 195 papers in the map (data through 7 Oct 2026). Builds on 50 of its 74 references that are in the map. First posted on arXiv 21 Nov 2022.
Builds on
50 of 74 references.
References · 50
- 2021Learning Transferable Visual Models From Natural Language Supervisioncited by 33,456
- 2018The Unreasonable Effectiveness of Deep Features as a Perceptual Metriccited by 11,029
- 2022Instant Neural Graphics Primitives with a Multiresolution Hash Encodingcited by 3,698
- 2021Mip-NeRF 360: Unbounded Anti-Aliased Neural Radiance Fieldscited by 2,013
- 2021Mip-NeRF: A Multiscale Representation for Anti-Aliasing Neural Radiance Fieldscited by 1,957
- 2020pixelNeRF: Neural Radiance Fields from One or Few Imagescited by 1,574
- 2019SuperGlue: Learning Feature Matching with Graph Neural Networkscited by 1,437
- 2017SuperPoint: Self-Supervised Interest Point Detection and Descriptioncited by 1,313
- 2018On the Continuity of Rotation Representations in Neural Networkscited by 1,186
- 2019The Replica Dataset: A Digital Replica of Indoor Spacescited by 885
- 2021MVSNeRF: Fast Generalizable Radiance Field Reconstruction from Multi-View Stereocited by 735
- 2021Depth-supervised NeRF: Fewer Views and Faster Training for Freecited by 732
38 more
- 2021IBRNet: Learning Multi-View Image-Based Renderingcited by 698
- 2021BARF: Bundle-Adjusting Neural Radiance Fieldscited by 641
- 2021RegNeRF: Regularizing Neural Radiance Fields for View Synthesis from Sparse Inputscited by 614
- 2021NICE-SLAM: Neural Implicit Scalable Encoding for SLAMcited by 586
- 2021iMAP: Implicit Mapping and Positioning in Real-Timecited by 476
- 2022MonoSDF: Exploring Monocular Geometric Cues for Neural Implicit Surface Reconstructioncited by 467
- 2021Putting NeRF on a Diet: Semantically Consistent Few-Shot View Synthesiscited by 464
- 2020INeRF: Inverting Neural Radiance Fields for Pose Estimationcited by 381
- 2021Neural RGB-D Surface Reconstructioncited by 312
- 2021Dense Depth Priors for Neural Radiance Fields from Sparse Input Viewscited by 301
- 2021Self-Calibrating Neural Radiance Fieldscited by 204
- 2021Neural Rays for Occlusion-aware Image-based Renderingcited by 192
- 2021NerfingMVS: Guided Optimization of Neural Radiance Fields for Indoor Multi-view Stereocited by 191
- 2021Stereo Radiance Fields (SRF): Learning View Synthesis for Sparse Views of Novel Scenescited by 190
- 2020GRF: Learning a General Radiance Field for 3D Representation and Renderingcited by 183
- 2021InfoNeRF: Ray Entropy Minimization for Few-Shot Neural Volume Renderingcited by 180
- 2022SparseNeuS: Fast Generalizable Neural Surface Reconstruction from Sparse Viewscited by 175
- 2021NeRF--: Neural Radiance Fields Without Known Camera Parameterscited by 155
- 2021GNeRF: GAN-based Neural Radiance Field without Posed Cameracited by 153
- 2019GLU-Net: Global-Local Universal Network for Dense Flow and Correspondencescited by 139
- 2021NeRS: Neural Reflectance Surfaces for Sparse-view 3D Reconstruction in the Wildcited by 136
- 2021Improving neural implicit surfaces geometry with patch warpingcited by 136
- 2021Learning Accurate Dense Correspondences and When to Trust Themcited by 113
- 2022RelPose: Predicting Probabilistic Relative Rotation for Single Objects in the Wildcited by 102
- 2022SAMURAI: Shape And Material from Unconstrained Real-world Arbitrary Image collectionscited by 89
- 2022GARF: Gaussian Activated Radiance Fields for High Fidelity Reconstruction and Pose Estimationcited by 86
- 2021PDC-Net+: Enhanced Probabilistic Dense Correspondence Networkcited by 80
- 2022PS-NeRF: Neural Inverse Rendering for Multi-view Photometric Stereocited by 69
- 2021Wide-Baseline Relative Camera Pose Estimation with Directional Learningcited by 49
- 2022SiNeRF: Sinusoidal Neural Radiance Fields for Joint Pose Estimation and Scene Reconstructioncited by 49
- 2017Relative Camera Pose Estimation Using Convolutional Neural Networkscited by 47
- 2022NeROIC: Neural Rendering of Objects from Online Image Collectionscited by 36
- 2018RPNet: an End-to-End Network for Relative Camera Pose Estimationcited by 31
- 2019GLAMpoints: Greedily Learned Accurate Match pointscited by 30
- 2019Backpropagation-Friendly Eigendecompositioncited by 27
- 2021Fusing the Old with the New: Learning Relative Camera Pose with Geometry-Guided Uncertaintycited by 9
- 2021Learning Neural Transmittance for Efficient Rendering of Reflectance Fieldscited by 3
- 2021End-to-end learning of keypoint detection and matching for relative pose estimationcited by 1
Built on by
Citing papers per year: 2022: 1; 2023: 39; 2024: 75; 2025: 62; 2026: 18.
195 papers.
Sort:
By area:
- 2024MVSplat: Efficient 3D Gaussian Splatting from Sparse Multi-View Imagescited by 553
- 2023FSGS: Real-Time Few-shot View Synthesis using Gaussian Splattingcited by 278
- 2025FLARE: Feed-forward Geometry, Appearance and Camera Estimation from Uncalibrated Sparse Viewscited by 176
- 2024Splatt3R: Zero-shot Gaussian Splatting from Uncalibrated Image Pairscited by 171
- 2025Difix3D+: Improving 3D Reconstructions with Single-Step Diffusion Modelscited by 160
- 2024Cameras as Rays: Pose Estimation via Ray Diffusioncited by 129
- 2024MVSplat360: Feed-Forward 360 Scene Synthesis from Sparse Viewscited by 111
- 2025VMem: Consistent Interactive Video Scene Generation with Surfel-Indexed View Memorycited by 102
- 2025RayZer: A Self-supervised Large View Synthesis Modelcited by 74
- 2024TranSplat: Generalizable 3D Gaussian Splatting from Sparse Multi-View Images with Transformerscited by 71
- 2023MuRF: Multi-Baseline Radiance Fieldscited by 70
- 2024InstantSplat: Sparse-view Gaussian Splatting in Secondscited by 67
38 more
- 2023LEAP: Liberate Sparse-view 3D Modeling from Camera Posescited by 65
- 2024Advances in 3D Generation: A Surveycited by 62
- 2023HeadGaS: Real-Time Animatable Head Avatars via 3D Gaussian Splattingcited by 60
- 2024PF3plat: Pose-Free Feed-Forward 3D Gaussian Splattingcited by 60
- 2023CamP: Camera Preconditioning for Neural Radiance Fieldscited by 55
- 2024LaRa: Efficient Large-Baseline Radiance Fieldscited by 54
- 2023Explicit Correspondence Matching for Generalizable Neural Radiance Fieldscited by 46
- 2024Binocular-Guided 3D Gaussian Splatting with View Consistency for Sparse View Synthesiscited by 41
- 2023Deceptive-NeRF/3DGS: Diffusion-Generated Pseudo-Observations for High-Quality Sparse-View Reconstructioncited by 39
- 2025No Pose at All: Self-Supervised Pose-Free 3D Gaussian Splatting from Sparse Viewscited by 38
- 2023Preface: A Data-driven Volumetric Prior for Few-shot Ultra High-resolution Face Synthesiscited by 37
- 2023Unifying Correspondence, Pose and NeRF for Pose-Free Novel View Synthesis from Stereo Pairscited by 37
- 2025GSFixer: Improving 3D Gaussian Splatting with Reference-Guided Video Diffusion Priorscited by 36
- 2024SpaRP: Fast 3D Object Reconstruction and Pose Estimation from Sparse Viewscited by 35
- 2025Instant Gaussian Stream: Fast and Generalizable Streaming of Dynamic Scene Reconstruction via Gaussian Splattingcited by 35
- 2025Decompositional Neural Scene Reconstruction with Generative Diffusion Priorcited by 30
- 2023UniSDF: Unifying Neural Representations for High-Fidelity 3D Reconstruction of Complex Scenes with Reflectionscited by 29
- 2025DropoutGS: Dropping Out Gaussians for Better Sparse-view Renderingcited by 29
- 20244D Gaussian Splatting in the Wild with Uncertainty-Aware Regularizationcited by 28
- 2025FlowR: Flowing from Sparse to Dense 3D Reconstructionscited by 28
- 2024Feat2GS: Probing Visual Foundation Models with Gaussian Splattingcited by 26
- 2025Gaussian Graph Network: Learning Efficient and Generalizable Gaussian Representations from Multi-view Imagescited by 25
- 2023ZeroRF: Fast Sparse View 360deg Reconstruction with Zero Pretrainingcited by 24
- 2023UC-NeRF: Neural Radiance Field for Under-Calibrated Multi-view Cameras in Autonomous Drivingcited by 23
- 2024Splatter-360: Generalizable 360circ Gaussian Splatting for Wide-baseline Panoramic Imagescited by 23
- 2024PanSplat: 4K Panorama Synthesis with Feed-Forward Gaussian Splattingcited by 23
- 2023ARTIC3D: Learning Robust Articulated 3D Shapes from Noisy Web Image Collectionscited by 22
- 2024UFORecon: Generalizable Sparse-View Surface Reconstruction from Arbitrary and UnFavOrable Setscited by 22
- 2024Neural Fields in Robotics: A Surveycited by 21
- 2023Deep Learning for Camera Calibration and Beyond: A Surveycited by 20
- 2023PoRF: Pose Residual Field for Accurate Neural Surface Reconstructioncited by 19
- 2025AE-NeRF: Augmenting Event-Based Neural Radiance Fields for Non-ideal Conditions and Larger Scenecited by 19
- 2024SHINOBI: Shape and Illumination using Neural Object Decomposition via BRDF Optimization In-the-wildcited by 18
- 2024FewViewGS: Gaussian Splatting with Few View Matching and Multi-stage Trainingcited by 18
- 2024Structure Consistent Gaussian Splatting with Matching Prior for Few-shot Novel View Synthesiscited by 18
- 2023ConsistentNeRF: Enhancing Neural Radiance Fields with 3D Consistency for Sparse View Synthesiscited by 17
- 2024NeRFs in Robotics: A Surveycited by 16
- 2023CorresNeRF: Image Correspondence Priors for Neural Radiance Fieldscited by 15
50 most cited of 195 All 195 (JSON)
- 2026OC-GS: Gaussian Splatting for Irregular Turntable Capture25 Sep 2026
- 2026Triangulation-Free Bundle Adjustment with Graduated Non-Convexity for Camera Pose Refinement from Coarse Priors21 Aug 2026
- 2026SalientGS: Unified SfM-to-3DGS with Importance-Guided MCMC Gaussian Allocation13 Jul 2026
- 2026Sparse-View Surface Reconstruction using Gaussian Splatting through High-Confidence Depth Propagation with Normal Priors4 Jul 2026
- 2026Learning Efficient 4D Gaussian Representations from Monocular Videos with Flow Splatting29 Jun 2026
- 2026From Uncertainty to Stability and Fidelity: Guiding Sparse-View 3D Gaussian Splatting with Fisher Information18 Jun 2026
- 2026GeoRect4D: Geometry-Compatible Generative Rectification for Dynamic Sparse-View 3D Reconstruction22 Apr 2026
- 2026AnyRecon: Arbitrary-View 3D Reconstruction with Video Diffusion Model21 Apr 2026
- 2026PCM-NeRF: Probabilistic Camera Modeling for Neural Radiance Fields under Pose Uncertainty20 Apr 2026
- 2026Improving Local Feature Matching by Entropy-inspired Scale Adaptability and Flow-endowed Local Consistency8 Apr 2026
- 20264C4D: 4 Camera 4D Gaussian Splatting5 Apr 2026
- 2026PhaseFlow4D: Physically Constrained 4D Beam Reconstruction via Feedback-Guided Latent Diffusion4 Apr 2026
38 more
- 2026GRVS: a Generalizable and Recurrent Approach to Monocular Dynamic View Synthesis31 Mar 2026
- 2026From None to All: Self-Supervised 3D Reconstruction via Novel View Synthesis29 Mar 2026
- 2026GloSplat: Joint Pose-Appearance Optimization for Faster and More Accurate 3D Reconstruction5 Mar 2026
- 2026Marginalized Bundle Adjustment: Multi-View Camera Pose from Monocular Depth Estimates21 Feb 2026
- 2026LGDWT-GS: Local and Global Discrete Wavelet-Regularized 3D Gaussian Splatting for Sparse-View Scene Reconstruction23 Jan 2026
- 2026studentSplat: Your Student Model Learns Single-view 3D Gaussian Splatting16 Jan 2026
- 2025Prior-Enhanced Gaussian Splatting for Dynamic Scene Reconstruction from Casual Video12 Dec 2025
- 2025ReCamDriving: LiDAR-Free Camera-Controlled Video Synthesis for Novel Trajectories3 Dec 2025
- 2025GENA3D: Generative Amodal 3D Modeling by Bridging 2D Priors and 3D Coherence26 Nov 2025
- 2025Novel View Synthesis from A Few Glimpses via Test-Time Natural Video Completion22 Nov 2025
- 2025RePose-NeRF: Robust Radiance Fields for Mesh Reconstruction under Noisy Camera Poses11 Nov 2025
- 2025D2GS: Depth-and-Density Guided Gaussian Splatting for Stable and Accurate Sparse-View Reconstruction9 Oct 2025
- 2025VGGT-X: When VGGT Meets Dense Novel View Synthesis29 Sep 2025
- 2025SPFSplatV2: Efficient Self-Supervised Pose-Free 3D Gaussian Splatting from Sparse Views21 Sep 2025
- 2025Segmentation-Driven Initialization for Sparse-view 3D Gaussian Splatting15 Sep 2025
- 2025Weakly-Supervised Learning of Dense Functional Correspondences4 Sep 2025
- 2025MarkSplatter: Generalizable Watermarking for 3D Gaussian Splatting Model via Splatter Image Structure31 Aug 2025
- 2025Can we make NeRF-based visual localization privacy-preserving?26 Aug 2025
- 2025GSFixer: Improving 3D Gaussian Splatting with Reference-Guided Video Diffusion Priors13 Aug 2025
- 2025SkySplat: Generalizable 3D Gaussian Splatting from Multi-Temporal Sparse Satellite Images13 Aug 2025
- 2025ExploreGS: Explorable 3D Scene Reconstruction with Virtual Camera Samplings and Diffusion Priors8 Aug 2025
- 2025No Pose at All: Self-Supervised Pose-Free 3D Gaussian Splatting from Sparse Views2 Aug 2025
- 2025SparseRecon: Neural Implicit Surface Reconstruction from Sparse Views with Feature and Depth Consistencies1 Aug 2025
- 2025UFV-Splatter: Pose-Free Feed-Forward 3D Gaussian Splatting Adapted to Unfavorable Views30 Jul 2025
- 2025Reconstructing 4D Spatial Intelligence: A Survey28 Jul 2025
- 2025BRUM: Robust 3D Vehicle Reconstruction from 360 Sparse Images16 Jul 2025
- 2025RegGS: Unposed Sparse Views Gaussian Splatting with 3DGS Registration10 Jul 2025
- 20254DSloMo: 4D Reconstruction for High Speed Scene with Asynchronous Capture7 Jul 2025
- 2025A View-consistent Sampling Method for Regularized Training of Neural Radiance Fields6 Jul 2025
- 2025CL-Splats: Continual Learning of Gaussian Splatting with Local Optimization26 Jun 2025
- 2025VMem: Consistent Interactive Video Scene Generation with Surfel-Indexed View Memory23 Jun 2025
- 2025RA-NeRF: Robust Neural Radiance Field Reconstruction with Accurate Camera Pose Estimation under Complex Trajectories18 Jun 2025
- 2025Vid-CamEdit: Video Camera Trajectory Editing with Generative Rendering from Estimated Geometry16 Jun 2025
- 2025TinySplat: Feedforward Approach for Generating Compact 3D Scene Representation11 Jun 2025
- 2025Pose-free 3D Gaussian splatting via shape-ray estimation29 May 2025
- 2025Learning Fine-Grained Geometry for Sparse-View Splatting via Cascade Depth Loss28 May 2025
- 2025ProBA: Probabilistic Bundle Adjustment with the Bhattacharyya Coefficient27 May 2025
- 2025Intern-GS: Vision Model Guided Sparse-View 3D Gaussian Splatting27 May 2025
50 newest of 195 All 195 (JSON)
- 2025Difix3D+: Improving 3D Reconstructions with Single-Step Diffusion Modelscited by 160
- 2023Deceptive-NeRF/3DGS: Diffusion-Generated Pseudo-Observations for High-Quality Sparse-View Reconstructioncited by 39
- 2025GSFixer: Improving 3D Gaussian Splatting with Reference-Guided Video Diffusion Priorscited by 36
- 2024SpaRP: Fast 3D Object Reconstruction and Pose Estimation from Sparse Viewscited by 35
- 2025Decompositional Neural Scene Reconstruction with Generative Diffusion Priorcited by 30
- 2023ARTIC3D: Learning Robust Articulated 3D Shapes from Noisy Web Image Collectionscited by 22
- 2024ExtraNeRF: Visibility-Aware View Extrapolation of Neural Radiance Fields with Diffusion Modelscited by 12
- 2025Can Video Diffusion Model Reconstruct 4D Geometry?cited by 10
- 2023Viewpoint Textual Inversion: Discovering Scene Representations and 3D View Control in 2D Diffusion Modelscited by 7
- 2024CorrespondentDream: Enhancing 3D Fidelity of Text-to-3D using Cross-View Correspondencescited by 6
- 2025ExploreGS: Explorable 3D Scene Reconstruction with Virtual Camera Samplings and Diffusion Priorscited by 6
- 2026AnyRecon: Arbitrary-View 3D Reconstruction with Video Diffusion Modelcited by 4
12 most cited of 14 All 14 (JSON)
- 2026AnyRecon: Arbitrary-View 3D Reconstruction with Video Diffusion Model21 Apr 2026
- 2026PhaseFlow4D: Physically Constrained 4D Beam Reconstruction via Feedback-Guided Latent Diffusion4 Apr 2026
- 2025GSFixer: Improving 3D Gaussian Splatting with Reference-Guided Video Diffusion Priors13 Aug 2025
- 2025ExploreGS: Explorable 3D Scene Reconstruction with Virtual Camera Samplings and Diffusion Priors8 Aug 2025
- 2025GCRayDiffusion: Pose-Free Surface Reconstruction via Geometric Consistent Ray Diffusion28 Mar 2025
- 2025Can Video Diffusion Model Reconstruct 4D Geometry?27 Mar 2025
- 2025Decompositional Neural Scene Reconstruction with Generative Diffusion Prior19 Mar 2025
- 2025Difix3D+: Improving 3D Reconstructions with Single-Step Diffusion Models3 Mar 2025
- 2024SpaRP: Fast 3D Object Reconstruction and Pose Estimation from Sparse Views19 Aug 2024
- 2024ExtraNeRF: Visibility-Aware View Extrapolation of Neural Radiance Fields with Diffusion Models10 Jun 2024
- 2024CorrespondentDream: Enhancing 3D Fidelity of Text-to-3D using Cross-View Correspondences16 Apr 2024
- 2023Viewpoint Textual Inversion: Discovering Scene Representations and 3D View Control in 2D Diffusion Models14 Sep 2023
12 newest of 14 All 14 (JSON)
- 2024MVSplat: Efficient 3D Gaussian Splatting from Sparse Multi-View Imagescited by 553
- 2023FSGS: Real-Time Few-shot View Synthesis using Gaussian Splattingcited by 278
- 2025FLARE: Feed-forward Geometry, Appearance and Camera Estimation from Uncalibrated Sparse Viewscited by 176
- 2024Splatt3R: Zero-shot Gaussian Splatting from Uncalibrated Image Pairscited by 171
- 2024Cameras as Rays: Pose Estimation via Ray Diffusioncited by 129
- 2024MVSplat360: Feed-Forward 360 Scene Synthesis from Sparse Viewscited by 111
- 2025VMem: Consistent Interactive Video Scene Generation with Surfel-Indexed View Memorycited by 102
- 2025RayZer: A Self-supervised Large View Synthesis Modelcited by 74
- 2024TranSplat: Generalizable 3D Gaussian Splatting from Sparse Multi-View Images with Transformerscited by 71
- 2023MuRF: Multi-Baseline Radiance Fieldscited by 70
- 2024InstantSplat: Sparse-view Gaussian Splatting in Secondscited by 67
- 2023LEAP: Liberate Sparse-view 3D Modeling from Camera Posescited by 65
12 most cited of 178 All 178 (JSON)
- 2026OC-GS: Gaussian Splatting for Irregular Turntable Capture25 Sep 2026
- 2026Triangulation-Free Bundle Adjustment with Graduated Non-Convexity for Camera Pose Refinement from Coarse Priors21 Aug 2026
- 2026SalientGS: Unified SfM-to-3DGS with Importance-Guided MCMC Gaussian Allocation13 Jul 2026
- 2026Sparse-View Surface Reconstruction using Gaussian Splatting through High-Confidence Depth Propagation with Normal Priors4 Jul 2026
- 2026Learning Efficient 4D Gaussian Representations from Monocular Videos with Flow Splatting29 Jun 2026
- 2026From Uncertainty to Stability and Fidelity: Guiding Sparse-View 3D Gaussian Splatting with Fisher Information18 Jun 2026
- 2026GeoRect4D: Geometry-Compatible Generative Rectification for Dynamic Sparse-View 3D Reconstruction22 Apr 2026
- 2026PCM-NeRF: Probabilistic Camera Modeling for Neural Radiance Fields under Pose Uncertainty20 Apr 2026
- 2026Improving Local Feature Matching by Entropy-inspired Scale Adaptability and Flow-endowed Local Consistency8 Apr 2026
- 20264C4D: 4 Camera 4D Gaussian Splatting5 Apr 2026
- 2026GRVS: a Generalizable and Recurrent Approach to Monocular Dynamic View Synthesis31 Mar 2026
- 2026From None to All: Self-Supervised 3D Reconstruction via Novel View Synthesis29 Mar 2026
12 newest of 178 All 178 (JSON)