SiNeRF: Sinusoidal Neural Radiance Fields for Joint Pose Estimation and Scene Reconstruction
Not on the map. Why?
Abstract (arXiv)
NeRFmm is the Neural Radiance Fields (NeRF) that deal with Joint Optimization tasks, i.e., reconstructing real-world scenes and registering camera parameters simultaneously. Despite NeRFmm producing precise scene synthesis and pose estimations, it still struggles to outperform the full-annotated baseline on challenging scenes. In this work, we identify that there exists a systematic sub-optimality in joint optimization and further identify multiple potential sources for it. To diminish the impacts of potential sources, we propose Sinusoidal Neural Radiance Fields (SiNeRF) that leverage sinusoidal activations for radiance mapping and a novel Mixed Region Sampling (MRS) for selecting ray batch efficiently. Quantitative and qualitative results show that compared to NeRFmm, SiNeRF achieves comprehensive significant improvements in image synthesis quality and pose estimation accuracy. Codes are available at https://github.com/yitongx/sinerf.
Key facts. Cited by 49 papers in the map (data through 7 Oct 2026). Builds on 18 of its 28 references that are in the map. First posted on arXiv 10 Oct 2022.
Builds on
18 of 28 references.
References · 18
- 2014Adam: A Method for Stochastic Optimizationcited by 36,960
- 2018The Unreasonable Effectiveness of Deep Features as a Perceptual Metriccited by 11,029
- 2022Instant Neural Graphics Primitives with a Multiresolution Hash Encodingcited by 3,698
- 2020Implicit Neural Representations with Periodic Activation Functionscited by 2,214
- 2020Nerfies: Deformable Neural Radiance Fieldscited by 1,194
- 2020Neural Scene Flow Fields for Space-Time View Synthesis of Dynamic Scenescited by 750
- 2020pi-GAN: Periodic Implicit Generative Adversarial Networks for 3D-Aware Image Synthesiscited by 708
- 2021BARF: Bundle-Adjusting Neural Radiance Fieldscited by 641
- 2020NeRV: Neural Reflectance and Visibility Fields for Relighting and View Synthesiscited by 493
- 2021Baking Neural Radiance Fields for Real-Time View Synthesiscited by 465
- 2020INeRF: Inverting Neural Radiance Fields for Pose Estimationcited by 381
- 2020Single-View View Synthesis with Multiplane Imagescited by 263
6 more
- 2019DeepView: View Synthesis with Learned Gradient Descentcited by 253
- 20203D Photography using Context-aware Layered Depth Inpaintingcited by 206
- 2021Self-Calibrating Neural Radiance Fieldscited by 204
- 2019Pushing the Boundaries of View Extrapolation with Multiplane Imagescited by 191
- 2020Stable View Synthesiscited by 165
- 2021NeRF--: Neural Radiance Fields Without Known Camera Parameterscited by 155
Built on by
Citing papers per year: 2022: 5; 2023: 14; 2024: 19; 2025: 10; 2026: 1.
49 papers.
Sort:
By area:
- 2022NoPe-NeRF: Optimising Neural Radiance Field with No Pose Priorcited by 235
- 2022SPARF: Neural Radiance Fields from Sparse and Noisy Posescited by 195
- 2023COLMAP-Free 3D Gaussian Splattingcited by 193
- 2022ESLAM: Efficient Dense SLAM System Based on Hybrid Representation of Signed Distance Fieldscited by 158
- 2024Scene Coordinate Reconstruction: Posing of Image Collections via Incremental Learning of a Relocalizercited by 73
- 2023LEAP: Liberate Sparse-view 3D Modeling from Camera Posescited by 65
- 2024MotionGS: Exploring Explicit Motion Guidance for Deformable 3D Gaussian Splattingcited by 62
- 2024FlowMap: High-Quality Camera Poses, Intrinsics, and Depth via Gradient Descentcited by 61
- 2023DBARF: Deep Bundle-Adjusting Generalizable Neural Radiance Fieldscited by 60
- 2022Local-to-Global Registration for Bundle-Adjusting Neural Radiance Fieldscited by 58
- 2023CamP: Camera Preconditioning for Neural Radiance Fieldscited by 55
- 2024GFlow: Recovering 4D World from Monocular Videocited by 46
37 more
- 2024SpaRP: Fast 3D Object Reconstruction and Pose Estimation from Sparse Viewscited by 35
- 2023LU-NeRF: Scene and Pose Estimation by Synchronizing Local Unposed NeRFscited by 33
- 2024PreF3R: Pose-Free Feed-Forward 3D Gaussian Splatting from Variable-length Image Sequencecited by 26
- 2023UC-NeRF: Neural Radiance Field for Under-Calibrated Multi-view Cameras in Autonomous Drivingcited by 23
- 2025LongSplat: Robust Unposed 3D Gaussian Splatting for Casual Long Videoscited by 23
- 2023Robust Camera Pose Refinement for Multi-Resolution Hash Encodingcited by 21
- 2024Neural Fields in Robotics: A Surveycited by 21
- 2023Deep Learning for Camera Calibration and Beyond: A Surveycited by 20
- 2023PoRF: Pose Residual Field for Accurate Neural Surface Reconstructioncited by 19
- 2024NeRFs in Robotics: A Surveycited by 16
- 2023UP-NeRF: Unconstrained Pose-Prior-Free Neural Radiance Fieldscited by 12
- 2024TrackNeRF: Bundle Adjusting NeRF from Sparse and Noisy Views via Feature Trackscited by 12
- 2024SfM-Free 3D Gaussian Splatting via Hierarchical Trainingcited by 12
- 2025Neural Radiance Fields for the Real World: A Surveycited by 12
- 20253R-GS: Best Practice in Optimizing Camera Poses Along with 3DGScited by 10
- 2025M2SVid: End-to-End Inpainting and Refinement for Monocular-to-Stereo Video Conversioncited by 10
- 2024Generic Objects as Pose Probes for Few-shot View Synthesiscited by 9
- 2024ZeroGS: Training 3D Gaussian Splatting from Unposed Imagescited by 9
- 2025VGGT-X: When VGGT Meets Dense Novel View Synthesiscited by 8
- 2023NeRFtrinsic Four: An End-To-End Trainable NeRF Jointly Optimizing Diverse Intrinsic and Extrinsic Camera Parameterscited by 6
- 2023MC-NeRF: Multi-Camera Neural Radiance Fields for Multi-Camera Image Acquisition Systemscited by 5
- 2023BASED: Bundle-Adjusting Surgical Endoscopic Dynamic Video Reconstruction using Neural Radiance Fieldscited by 5
- 2024Preconditioners for the Stochastic Training of Neural Fieldscited by 5
- 2024Invertible Neural Warp for NeRFcited by 5
- 2023Continuous Pose for Monocular Cameras in Neural Implicit Representationcited by 4
- 2025Flow-NeRF: Joint Learning of Geometry, Poses, and Dense Flow within Unified Neural Representationscited by 3
- 2024Disentangled Generation and Aggregation for Robust Radiance Fieldscited by 2
- 2025NeRFs are Mirror Detectors: Using Structural Similarity for Multi-View Mirror Scene Reconstruction with 3D Surface Primitivescited by 2
- 2024ICON: Incremental CONfidence for Joint Pose and Radiance Field Optimizationcited by 1
- 2024FBINeRF: Feature-Based Integrated Recurrent Network for Pinhole and Fisheye Neural Radiance Fieldscited by 1
- 2024KRONC: Keypoint-based Robust Camera Optimization for 3D Car Reconstructioncited by 1
- 2025PFAvatar: Pose-Fusion 3D Personalized Avatar Reconstruction from Real-World Outfit-of-the-Day Photoscited by 1
- 2022Efficient 3D Reconstruction, Streaming and Visualization of Static and Dynamic Scene Parts for Multi-client Live-telepresence in Large-scale Environmentscited by 0
- 2024Robust SG-NeRF: Robust Scene Graph Aided Neural Surface Reconstructioncited by 0
- 2025UVRM: A Scalable 3D Reconstruction Model from Unposed Videoscited by 0
- 2025PreSem-Surf: RGB-D Surface Reconstruction with Progressive Semantic Modeling and SG-MLP Pre-Rendering Mechanismcited by 0
- 2026LVSPM: Long Sequence View Synthesis and Pose Estimation Modelcited by 0
- 2026LVSPM: Long Sequence View Synthesis and Pose Estimation Model7 Oct 2026
- 2025PFAvatar: Pose-Fusion 3D Personalized Avatar Reconstruction from Real-World Outfit-of-the-Day Photos17 Nov 2025
- 2025VGGT-X: When VGGT Meets Dense Novel View Synthesis29 Sep 2025
- 2025LongSplat: Robust Unposed 3D Gaussian Splatting for Casual Long Videos19 Aug 2025
- 2025PreSem-Surf: RGB-D Surface Reconstruction with Progressive Semantic Modeling and SG-MLP Pre-Rendering Mechanism17 Aug 2025
- 2025M2SVid: End-to-End Inpainting and Refinement for Monocular-to-Stereo Video Conversion22 May 2025
- 20253R-GS: Best Practice in Optimizing Camera Poses Along with 3DGS5 Apr 2025
- 2025Flow-NeRF: Joint Learning of Geometry, Poses, and Dense Flow within Unified Neural Representations13 Mar 2025
- 2025Neural Radiance Fields for the Real World: A Survey22 Jan 2025
- 2025UVRM: A Scalable 3D Reconstruction Model from Unposed Videos16 Jan 2025
- 2025NeRFs are Mirror Detectors: Using Structural Similarity for Multi-View Mirror Scene Reconstruction with 3D Surface Primitives7 Jan 2025
- 2024SfM-Free 3D Gaussian Splatting via Hierarchical Training2 Dec 2024
37 more
- 2024PreF3R: Pose-Free Feed-Forward 3D Gaussian Splatting from Variable-length Image Sequence25 Nov 2024
- 2024ZeroGS: Training 3D Gaussian Splatting from Unposed Images24 Nov 2024
- 2024Robust SG-NeRF: Robust Scene Graph Aided Neural Surface Reconstruction20 Nov 2024
- 2024Neural Fields in Robotics: A Survey26 Oct 2024
- 2024MotionGS: Exploring Explicit Motion Guidance for Deformable 3D Gaussian Splatting10 Oct 2024
- 2024Disentangled Generation and Aggregation for Robust Radiance Fields24 Sep 2024
- 2024KRONC: Keypoint-based Robust Camera Optimization for 3D Car Reconstruction9 Sep 2024
- 2024Generic Objects as Pose Probes for Few-shot View Synthesis29 Aug 2024
- 2024TrackNeRF: Bundle Adjusting NeRF from Sparse and Noisy Views via Feature Tracks20 Aug 2024
- 2024SpaRP: Fast 3D Object Reconstruction and Pose Estimation from Sparse Views19 Aug 2024
- 2024FBINeRF: Feature-Based Integrated Recurrent Network for Pinhole and Fisheye Neural Radiance Fields3 Aug 2024
- 2024Invertible Neural Warp for NeRF17 Jul 2024
- 2024GFlow: Recovering 4D World from Monocular Video28 May 2024
- 2024NeRFs in Robotics: A Survey2 May 2024
- 2024FlowMap: High-Quality Camera Poses, Intrinsics, and Depth via Gradient Descent23 Apr 2024
- 2024Scene Coordinate Reconstruction: Posing of Image Collections via Incremental Learning of a Relocalizer22 Apr 2024
- 2024Preconditioners for the Stochastic Training of Neural Fields13 Feb 2024
- 2024ICON: Incremental CONfidence for Joint Pose and Radiance Field Optimization17 Jan 2024
- 2023COLMAP-Free 3D Gaussian Splatting12 Dec 2023
- 2023Continuous Pose for Monocular Cameras in Neural Implicit Representation28 Nov 2023
- 2023UC-NeRF: Neural Radiance Field for Under-Calibrated Multi-view Cameras in Autonomous Driving28 Nov 2023
- 2023UP-NeRF: Unconstrained Pose-Prior-Free Neural Radiance Fields7 Nov 2023
- 2023PoRF: Pose Residual Field for Accurate Neural Surface Reconstruction11 Oct 2023
- 2023LEAP: Liberate Sparse-view 3D Modeling from Camera Poses2 Oct 2023
- 2023BASED: Bundle-Adjusting Surgical Endoscopic Dynamic Video Reconstruction using Neural Radiance Fields27 Sep 2023
- 2023MC-NeRF: Multi-Camera Neural Radiance Fields for Multi-Camera Image Acquisition Systems14 Sep 2023
- 2023CamP: Camera Preconditioning for Neural Radiance Fields21 Aug 2023
- 2023LU-NeRF: Scene and Pose Estimation by Synchronizing Local Unposed NeRFs8 Jun 2023
- 2023DBARF: Deep Bundle-Adjusting Generalizable Neural Radiance Fields25 Mar 2023
- 2023Deep Learning for Camera Calibration and Beyond: A Survey19 Mar 2023
- 2023NeRFtrinsic Four: An End-To-End Trainable NeRF Jointly Optimizing Diverse Intrinsic and Extrinsic Camera Parameters16 Mar 2023
- 2023Robust Camera Pose Refinement for Multi-Resolution Hash Encoding3 Feb 2023
- 2022NoPe-NeRF: Optimising Neural Radiance Field with No Pose Prior14 Dec 2022
- 2022Efficient 3D Reconstruction, Streaming and Visualization of Static and Dynamic Scene Parts for Multi-client Live-telepresence in Large-scale Environments25 Nov 2022
- 2022SPARF: Neural Radiance Fields from Sparse and Noisy Poses21 Nov 2022
- 2022ESLAM: Efficient Dense SLAM System Based on Hybrid Representation of Signed Distance Fields21 Nov 2022
- 2022Local-to-Global Registration for Bundle-Adjusting Neural Radiance Fields21 Nov 2022
- 2022NoPe-NeRF: Optimising Neural Radiance Field with No Pose Priorcited by 235
- 2022SPARF: Neural Radiance Fields from Sparse and Noisy Posescited by 195
- 2023COLMAP-Free 3D Gaussian Splattingcited by 193
- 2022ESLAM: Efficient Dense SLAM System Based on Hybrid Representation of Signed Distance Fieldscited by 158
- 2024Scene Coordinate Reconstruction: Posing of Image Collections via Incremental Learning of a Relocalizercited by 73
- 2023LEAP: Liberate Sparse-view 3D Modeling from Camera Posescited by 65
- 2024MotionGS: Exploring Explicit Motion Guidance for Deformable 3D Gaussian Splattingcited by 62
- 2024FlowMap: High-Quality Camera Poses, Intrinsics, and Depth via Gradient Descentcited by 61
- 2023DBARF: Deep Bundle-Adjusting Generalizable Neural Radiance Fieldscited by 60
- 2022Local-to-Global Registration for Bundle-Adjusting Neural Radiance Fieldscited by 58
- 2023CamP: Camera Preconditioning for Neural Radiance Fieldscited by 55
- 2024GFlow: Recovering 4D World from Monocular Videocited by 46
12 most cited of 48 All 48 (JSON)
- 2026LVSPM: Long Sequence View Synthesis and Pose Estimation Model7 Oct 2026
- 2025PFAvatar: Pose-Fusion 3D Personalized Avatar Reconstruction from Real-World Outfit-of-the-Day Photos17 Nov 2025
- 2025VGGT-X: When VGGT Meets Dense Novel View Synthesis29 Sep 2025
- 2025LongSplat: Robust Unposed 3D Gaussian Splatting for Casual Long Videos19 Aug 2025
- 2025PreSem-Surf: RGB-D Surface Reconstruction with Progressive Semantic Modeling and SG-MLP Pre-Rendering Mechanism17 Aug 2025
- 2025M2SVid: End-to-End Inpainting and Refinement for Monocular-to-Stereo Video Conversion22 May 2025
- 20253R-GS: Best Practice in Optimizing Camera Poses Along with 3DGS5 Apr 2025
- 2025Flow-NeRF: Joint Learning of Geometry, Poses, and Dense Flow within Unified Neural Representations13 Mar 2025
- 2025Neural Radiance Fields for the Real World: A Survey22 Jan 2025
- 2025UVRM: A Scalable 3D Reconstruction Model from Unposed Videos16 Jan 2025
- 2025NeRFs are Mirror Detectors: Using Structural Similarity for Multi-View Mirror Scene Reconstruction with 3D Surface Primitives7 Jan 2025
- 2024SfM-Free 3D Gaussian Splatting via Hierarchical Training2 Dec 2024
12 newest of 48 All 48 (JSON)