mlsanityData to 14 Oct 2026

InsertNeRF: Instilling Generalizability into NeRF with HyperNet Modules

arXiv 2308.13897 ↗First posted 26 Aug 2023cs.CVcited by 7

Not on the map. Why?

Abstract (arXiv)

Generalizing Neural Radiance Fields (NeRF) to new scenes is a significant challenge that existing approaches struggle to address without extensive modifications to vanilla NeRF framework. We introduce InsertNeRF, a method for INStilling gEneRalizabiliTy into NeRF. By utilizing multiple plug-and-play HyperNet modules, InsertNeRF dynamically tailors NeRF's weights to specific reference scenes, transforming multi-scale sampling-aware features into scene-specific representations. This novel design allows for more accurate and efficient representations of complex appearances and geometries. Experiments show that this method not only achieves superior generalization performance but also provides a flexible pathway for integration with other NeRF-like systems, even in sparse input settings. Code will be available https://github.com/bbbbby-99/InsertNeRF.

Key facts. Cited by 7 papers in the map (data through 14 Oct 2026). Builds on 50 of its 64 references that are in the map. First posted on arXiv 26 Aug 2023.

Builds on

50 of 64 references.

References · 50

  1. 2015Deep Residual Learning for Image Recognitioncited by 52,096
  2. 2015U-Net: Convolutional Networks for Biomedical Image Segmentationcited by 19,713
  3. 2018The Unreasonable Effectiveness of Deep Features as a Perceptual Metriccited by 11,177
  4. 2022DreamFusion: Text-to-3D using 2D Diffusioncited by 3,025
  5. 2017FiLM: Visual Reasoning with a General Conditioning Layercited by 2,333
  6. 2020Implicit Neural Representations with Periodic Activation Functionscited by 2,238
  7. 2018Occupancy Networks: Learning 3D Reconstruction in Function Spacecited by 2,041
  8. 2021Mip-NeRF 360: Unbounded Anti-Aliased Neural Radiance Fieldscited by 2,032
  9. 2021Mip-NeRF: A Multiscale Representation for Anti-Aliasing Neural Radiance Fieldscited by 1,964
  10. 2020pixelNeRF: Neural Radiance Fields from One or Few Imagescited by 1,584
  11. 2022TensoRF: Tensorial Radiance Fieldscited by 1,280
  12. 2016HyperNetworkscited by 1,027
38 more
  1. 2019Scene Representation Networks: Continuous 3D-Structure-Aware Neural Scene Representationscited by 864
  2. 2020NeRF++: Analyzing and Improving Neural Radiance Fieldscited by 861
  3. 2018MVSNet: Depth Inference for Unstructured Multi-view Stereocited by 788
  4. 2020Convolutional Occupancy Networkscited by 761
  5. 2021MVSNeRF: Fast Generalizable Radiance Field Reconstruction from Multi-View Stereocited by 740
  6. 2021IBRNet: Learning Multi-View Image-Based Renderingcited by 703
  7. 2021RegNeRF: Regularizing Neural Radiance Fields for View Synthesis from Sparse Inputscited by 615
  8. 20213D Shape Generation and Completion through Point-Voxel Diffusioncited by 516
  9. 2020Local Implicit Grid Representations for 3D Scenescited by 373
  10. 2023FreeNeRF: Improving Few-shot Neural Rendering with Free Frequency Regularizationcited by 311
  11. 2019Continual learning with hypernetworkscited by 273
  12. 2020Free View Synthesiscited by 231
  13. 2021HyperStyle: StyleGAN Inversion with HyperNetworks for Real Image Editingcited by 208
  14. 2023MeshDiffusion: Score-based Generative 3D Mesh Modelingcited by 199
  15. 2021GeoNeRF: Generalizing NeRF with Geometry Priorscited by 196
  16. 2021Neural Rays for Occlusion-aware Image-based Renderingcited by 192
  17. 2022Generalizable Patch-Based Neural Renderingcited by 122
  18. 2018Graph-Based Global Reasoning Networkscited by 120
  19. 2022Is Attention All That NeRF Needs?cited by 113
  20. 2019Learning to Infer Implicit Surfaces without 3D Supervisioncited by 103
  21. 2021Stylizing 3D Scene via Implicit Representation and HyperNetworkcited by 103
  22. 2023A Brief Review of Hypernetworks in Deep Learningcited by 102
  23. 2018Local Spectral Graph Convolution for Point Set Feature Learningcited by 84
  24. 2022ViewFormer: NeRF-free Neural Rendering from Few Images Using Transformerscited by 70
  25. 2020DHP: Differentiable Meta Pruning via HyperNetworkscited by 57
  26. 2023Representing Volumetric Videos as Dynamic MLP Mapscited by 51
  27. 2020Equivariant Neural Renderingcited by 48
  28. 2023WaveNeRF: Wavelet-based Generalizable Neural Radiance Fieldscited by 24
  29. 2020Hypernetwork approach to generating point cloudscited by 20
  30. 2023Local Implicit Ray Function for Generalizable Radiance Field Representationcited by 19
  31. 2022Dynamic MLP for Fine-Grained Image Classification by Leveraging Geographical and Temporal Informationcited by 15
  32. 2022Exact-NeRF: An Exploration of a Precise Volumetric Parameterization for Neural Radiance Fieldscited by 15
  33. 2023Transforming Radiance Field with Lipschitz Network for Photorealistic 3D Scene Stylizationcited by 14
  34. 2022Points2NeRF: Generating Neural Radiance Fields from 3D point cloudcited by 11
  35. 2023Where and How: Mitigating Confusion in Neural Radiance Fields from Sparse Inputscited by 11
  36. 2020HyperFlow: Representing 3D Objects as Surfacescited by 7
  37. 2023HyperNeRFGAN: Hypernetwork approach to 3D NeRF GANcited by 7
  38. 2023Enhanced Stable View Synthesiscited by 5

Built on by

Cited by year (2026 to 14 Oct)

Citing papers per year: 2023: 1; 2024: 5; 2025: 0; 2026: 1.

7 papers.

  1. 20243D Gaussian Splatting: Survey, Technologies, Challenges, and Opportunitiescited by 78
  2. 2023CaesarNeRF: Calibrated Semantic Representation for Few-shot Generalizable Neural Renderingcited by 10
  3. 2024SCARF: Scalable Continual Learning Framework for Memory-efficient Multiple Neural Radiance Fieldscited by 8
  4. 2024Distractor-free Generalizable 3D Gaussian Splattingcited by 8
  5. 2026Edit in 2D, Verify in 3D: Reinforcement Learning for Multi-view Consistent Scene Editingcited by 4
  6. 2024AdaContour: Adaptive Contour Descriptor with Hierarchical Representationcited by 0
  7. 2024Incremental Multi-Scene Modeling via Continual Neural Graphics Primitivescited by 0