mlsanityData to 7 Oct 2026

HyperPlanes: Hypernetwork Approach to Rapid NeRF Adaptation

arXiv 2402.01524 ↗First posted 2 Feb 2024cs.CV cs.LGcited by 1

Not on the map. Why?

Abstract (arXiv)

Neural radiance fields (NeRFs) are a widely accepted standard for synthesizing new 3D object views from a small number of base images. However, NeRFs have limited generalization properties, which means that we need to use significant computational resources to train individual architectures for each item we want to represent. To address this issue, we propose a few-shot learning approach based on the hypernetwork paradigm that does not require gradient optimization during inference. The hypernetwork gathers information from the training data and generates an update for universal weights. As a result, we have developed an efficient method for generating a high-quality 3D object representation from a small number of images in a single step. This has been confirmed by direct comparison with the state-of-the-art solutions and a comprehensive ablation study.

Key facts. Cited by 1 paper in the map (data through 7 Oct 2026). Builds on 44 of its 57 references that are in the map. First posted on arXiv 2 Feb 2024.

Builds on

44 of 57 references.

References · 44

  1. 2019PyTorch: An Imperative Style, High-Performance Deep Learning Librarycited by 20,160
  2. 2017Model-Agnostic Meta-Learning for Fast Adaptation of Deep Networkscited by 4,861
  3. 2022Instant Neural Graphics Primitives with a Multiresolution Hash Encodingcited by 3,698
  4. 2015ShapeNet: An Information-Rich 3D Model Repositorycited by 2,880
  5. 2021Mip-NeRF: A Multiscale Representation for Anti-Aliasing Neural Radiance Fieldscited by 1,957
  6. 2021Plenoxels: Radiance Fields without Neural Networkscited by 1,607
  7. 2020pixelNeRF: Neural Radiance Fields from One or Few Imagescited by 1,574
  8. 2022TensoRF: Tensorial Radiance Fieldscited by 1,275
  9. 2021Efficient Geometry-aware 3D Generative Adversarial Networkscited by 1,204
  10. 2016HyperNetworkscited by 1,003
  11. 2018On First-Order Meta-Learning Algorithmscited by 1,003
  12. 2021Direct Voxel Grid Optimization: Super-fast Convergence for Radiance Fields Reconstructioncited by 961
32 more
  1. 2020Neural Sparse Voxel Fieldscited by 959
  2. 2020Meta-Learning in Neural Networks: A Surveycited by 944
  3. 2020GIRAFFE: Representing Scenes as Compositional Generative Neural Feature Fieldscited by 784
  4. 2021MVSNeRF: Fast Generalizable Radiance Field Reconstruction from Multi-View Stereocited by 735
  5. 2021Depth-supervised NeRF: Fewer Views and Faster Training for Freecited by 732
  6. 2021IBRNet: Learning Multi-View Image-Based Renderingcited by 698
  7. 2020GRAF: Generative Radiance Fields for 3D-Aware Image Synthesiscited by 688
  8. 2021RegNeRF: Regularizing Neural Radiance Fields for View Synthesis from Sparse Inputscited by 614
  9. 20163D-R2N2: A Unified Approach for Single and Multi-view 3D Object Reconstructioncited by 587
  10. 2019Meta-Learning with Implicit Gradientscited by 523
  11. 2019Generalizing from a Few Examples: A Survey on Few-Shot Learningcited by 462
  12. 2019Rapid Learning or Feature Reuse? Towards Understanding the Effectiveness of MAMLcited by 359
  13. 2021Dense Depth Priors for Neural Radiance Fields from Sparse Input Viewscited by 301
  14. 2018Few-Shot Learning via Embedding Adaptation with Set-to-Set Functionscited by 293
  15. 2021StyleSDF: High-Resolution 3D-Consistent Image and Geometry Generationcited by 289
  16. 20223D Neural Field Generation using Triplane Diffusioncited by 274
  17. 2017Meta Networkscited by 268
  18. 2018Probabilistic Model-Agnostic Meta-Learningcited by 254
  19. 2020Learned Initializations for Optimizing Coordinate-Based Neural Representationscited by 240
  20. 2022DiffRF: Rendering-Guided 3D Radiance Field Diffusioncited by 204
  21. 2021NerfingMVS: Guided Optimization of Neural Radiance Fields for Indoor Multi-view Stereocited by 191
  22. 2023Single-Stage Diffusion NeRF: A Unified Approach to 3D Generation and Reconstructioncited by 180
  23. 2023NerfDiff: Single-image View Synthesis with NeRF-guided Distillation from 3D-aware Diffusioncited by 179
  24. 2020BlockGAN: Learning 3D Object-aware Scene Representations from Unlabelled Imagescited by 166
  25. 2017Hierarchical Surface Prediction for 3D Object Reconstructioncited by 89
  26. 2021FoV-NeRF: Foveated Neural Radiance Fields for Virtual Realitycited by 79
  27. 2021A Shading-Guided Generative Implicit Model for Shape-Accurate 3D-Aware Image Synthesiscited by 72
  28. 2021Generative Occupancy Fields for 3D Surface-Aware Image Synthesiscited by 51
  29. 2022HyperShot: Few-Shot Learning by Kernel HyperNetworkscited by 24
  30. 2021Continuous Conditional Random Field Convolution for Point Cloud Segmentationcited by 7
  31. 2023MultiPlaneNeRF: Neural Radiance Field with Non-Trainable Representationcited by 3
  32. 2021HyperColor: A HyperNetwork Approach for Synthesizing Auto-colored 3D Models for Game Scenes Populationcited by 1

Built on by

Cited by year

Citing papers per year: 2025: 1.

1 paper.