HyperPlanes: Hypernetwork Approach to Rapid NeRF Adaptation
Not on the map. Why?
Abstract (arXiv)
Neural radiance fields (NeRFs) are a widely accepted standard for synthesizing new 3D object views from a small number of base images. However, NeRFs have limited generalization properties, which means that we need to use significant computational resources to train individual architectures for each item we want to represent. To address this issue, we propose a few-shot learning approach based on the hypernetwork paradigm that does not require gradient optimization during inference. The hypernetwork gathers information from the training data and generates an update for universal weights. As a result, we have developed an efficient method for generating a high-quality 3D object representation from a small number of images in a single step. This has been confirmed by direct comparison with the state-of-the-art solutions and a comprehensive ablation study.
Key facts. Cited by 1 paper in the map (data through 7 Oct 2026). Builds on 44 of its 57 references that are in the map. First posted on arXiv 2 Feb 2024.
Builds on
44 of 57 references.
References · 44
- 2019PyTorch: An Imperative Style, High-Performance Deep Learning Librarycited by 20,160
- 2017Model-Agnostic Meta-Learning for Fast Adaptation of Deep Networkscited by 4,861
- 2022Instant Neural Graphics Primitives with a Multiresolution Hash Encodingcited by 3,698
- 2015ShapeNet: An Information-Rich 3D Model Repositorycited by 2,880
- 2021Mip-NeRF: A Multiscale Representation for Anti-Aliasing Neural Radiance Fieldscited by 1,957
- 2021Plenoxels: Radiance Fields without Neural Networkscited by 1,607
- 2020pixelNeRF: Neural Radiance Fields from One or Few Imagescited by 1,574
- 2022TensoRF: Tensorial Radiance Fieldscited by 1,275
- 2021Efficient Geometry-aware 3D Generative Adversarial Networkscited by 1,204
- 2016HyperNetworkscited by 1,003
- 2018On First-Order Meta-Learning Algorithmscited by 1,003
- 2021Direct Voxel Grid Optimization: Super-fast Convergence for Radiance Fields Reconstructioncited by 961
32 more
- 2020Neural Sparse Voxel Fieldscited by 959
- 2020Meta-Learning in Neural Networks: A Surveycited by 944
- 2020GIRAFFE: Representing Scenes as Compositional Generative Neural Feature Fieldscited by 784
- 2021MVSNeRF: Fast Generalizable Radiance Field Reconstruction from Multi-View Stereocited by 735
- 2021Depth-supervised NeRF: Fewer Views and Faster Training for Freecited by 732
- 2021IBRNet: Learning Multi-View Image-Based Renderingcited by 698
- 2020GRAF: Generative Radiance Fields for 3D-Aware Image Synthesiscited by 688
- 2021RegNeRF: Regularizing Neural Radiance Fields for View Synthesis from Sparse Inputscited by 614
- 20163D-R2N2: A Unified Approach for Single and Multi-view 3D Object Reconstructioncited by 587
- 2019Meta-Learning with Implicit Gradientscited by 523
- 2019Generalizing from a Few Examples: A Survey on Few-Shot Learningcited by 462
- 2019Rapid Learning or Feature Reuse? Towards Understanding the Effectiveness of MAMLcited by 359
- 2021Dense Depth Priors for Neural Radiance Fields from Sparse Input Viewscited by 301
- 2018Few-Shot Learning via Embedding Adaptation with Set-to-Set Functionscited by 293
- 2021StyleSDF: High-Resolution 3D-Consistent Image and Geometry Generationcited by 289
- 20223D Neural Field Generation using Triplane Diffusioncited by 274
- 2017Meta Networkscited by 268
- 2018Probabilistic Model-Agnostic Meta-Learningcited by 254
- 2020Learned Initializations for Optimizing Coordinate-Based Neural Representationscited by 240
- 2022DiffRF: Rendering-Guided 3D Radiance Field Diffusioncited by 204
- 2021NerfingMVS: Guided Optimization of Neural Radiance Fields for Indoor Multi-view Stereocited by 191
- 2023Single-Stage Diffusion NeRF: A Unified Approach to 3D Generation and Reconstructioncited by 180
- 2023NerfDiff: Single-image View Synthesis with NeRF-guided Distillation from 3D-aware Diffusioncited by 179
- 2020BlockGAN: Learning 3D Object-aware Scene Representations from Unlabelled Imagescited by 166
- 2017Hierarchical Surface Prediction for 3D Object Reconstructioncited by 89
- 2021FoV-NeRF: Foveated Neural Radiance Fields for Virtual Realitycited by 79
- 2021A Shading-Guided Generative Implicit Model for Shape-Accurate 3D-Aware Image Synthesiscited by 72
- 2021Generative Occupancy Fields for 3D Surface-Aware Image Synthesiscited by 51
- 2022HyperShot: Few-Shot Learning by Kernel HyperNetworkscited by 24
- 2021Continuous Conditional Random Field Convolution for Point Cloud Segmentationcited by 7
- 2023MultiPlaneNeRF: Neural Radiance Field with Non-Trainable Representationcited by 3
- 2021HyperColor: A HyperNetwork Approach for Synthesizing Auto-colored 3D Models for Game Scenes Populationcited by 1
Built on by
Citing papers per year: 2025: 1.
1 paper.