mlsanityData to 7 Oct 2026

RefiNeRF: Modelling dynamic neural radiance fields with inconsistent or missing camera parameters

arXiv 2303.08695 ↗First posted 15 Mar 2023cs.CVcited by 2

Not on the map. Why?

Abstract (arXiv)

Novel view synthesis (NVS) is a challenging task in computer vision that involves synthesizing new views of a scene from a limited set of input images. Neural Radiance Fields (NeRF) have emerged as a powerful approach to address this problem, but they require accurate knowledge of camera textitintrinsic and textitextrinsic parameters. Traditionally, structure-from-motion (SfM) and multi-view stereo (MVS) approaches have been used to extract camera parameters, but these methods can be unreliable and may fail in certain cases. In this paper, we propose a novel technique that leverages unposed images from dynamic datasets, such as the NVIDIA dynamic scenes dataset, to learn camera parameters directly from data. Our approach is highly extensible and can be integrated into existing NeRF architectures with minimal modifications. We demonstrate the effectiveness of our method on a variety of static and dynamic scenes and show that it outperforms traditional SfM and MVS approaches. The code for our method is publicly available at hrefhttps://github.com/redacted/refinerfhttps://github.com/redacted/refinerf. Our approach offers a promising new direction for improving the accuracy and robustness of NVS using NeRF, and we anticipate that it will be a valuable tool for a wide range of applications in computer vision and graphics.

Key facts. Cited by 2 papers in the map (data through 7 Oct 2026). Builds on 32 of its 47 references that are in the map. First posted on arXiv 15 Mar 2023.

Builds on

32 of 47 references.

References · 32

  1. 2018The Unreasonable Effectiveness of Deep Features as a Perceptual Metriccited by 11,029
  2. 2022Instant Neural Graphics Primitives with a Multiresolution Hash Encodingcited by 3,698
  3. 2015Delving Deep into Rectifiers: Surpassing Human-Level Performance on ImageNet Classificationcited by 3,590
  4. 2020RAFT: Recurrent All-Pairs Field Transforms for Optical Flowcited by 2,385
  5. 2019Towards Robust Monocular Depth Estimation: Mixing Datasets for Zero-shot Cross-dataset Transfercited by 1,484
  6. 2020D-NeRF: Neural Radiance Fields for Dynamic Scenescited by 1,459
  7. 2017VoxelNet: End-to-End Learning for Point Cloud Based 3D Object Detectioncited by 1,323
  8. 2020NeRF in the Wild: Neural Radiance Fields for Unconstrained Photo Collectionscited by 1,230
  9. 2020Nerfies: Deformable Neural Radiance Fieldscited by 1,194
  10. 2021PlenOctrees for Real-time Rendering of Neural Radiance Fieldscited by 904
  11. 2020Neural Scene Flow Fields for Space-Time View Synthesis of Dynamic Scenescited by 750
  12. 2021Depth-supervised NeRF: Fewer Views and Faster Training for Freecited by 732
20 more
  1. 2018PointConv: Deep Convolutional Networks on 3D Point Cloudscited by 656
  2. 2021BARF: Bundle-Adjusting Neural Radiance Fieldscited by 641
  3. 2019Deep Learning for 3D Point Clouds: A Surveycited by 557
  4. 2020Non-Rigid Neural Radiance Fields: Reconstruction and Novel View Synthesis of a Dynamic Scene From Monocular Videocited by 470
  5. 2021Dynamic View Synthesis from Dynamic Monocular Videocited by 420
  6. 2020INeRF: Inverting Neural Radiance Fields for Pose Estimationcited by 381
  7. 2016EndoNet: A Deep Architecture for Recognition Tasks on Laparoscopic Videoscited by 366
  8. 2021NeRF in the Dark: High Dynamic Range View Synthesis from Noisy Raw Imagescited by 336
  9. 2021Dense Depth Priors for Neural Radiance Fields from Sparse Input Viewscited by 301
  10. 2021GeoNeRF: Generalizing NeRF with Geometry Priorscited by 195
  11. 2021NerfingMVS: Guided Optimization of Neural Radiance Fields for Indoor Multi-view Stereocited by 191
  12. 2017SEGCloud: Semantic Segmentation of 3D Point Cloudscited by 178
  13. 2020Novel View Synthesis of Dynamic Scenes with Globally Coherent Depths from a Monocular Cameracited by 166
  14. 2021NeRF--: Neural Radiance Fields Without Known Camera Parameterscited by 155
  15. 2021T"oRF: Time-of-Flight Radiance Fields for Dynamic Scene View Synthesiscited by 88
  16. 2021FiG-NeRF: Figure-Ground Neural Radiance Fields for 3D Object Category Modellingcited by 47
  17. 2018Pixels, voxels, and views: A study of shape representations for single view 3D object shape predictioncited by 27
  18. 2021VaxNeRF: Revisiting the Classic for Voxel-Accelerated Neural Radiance Fieldcited by 14
  19. 2021Template NeRF: Towards Modeling Dense Shape Correspondences from Category-Specific Object Imagescited by 5
  20. 2022wildNeRF: Complete view synthesis of in-the-wild dynamic scenes captured using sparse monocular datacited by 3

Built on by

Cited by year

Citing papers per year: 2023: 2.

2 papers.