Geometric Neural Process Fields
Not on the map. Why?
Abstract (arXiv)
This paper addresses the challenge of Neural Field (NeF) generalization, where models must efficiently adapt to new signals given only a few observations. To tackle this, we propose Geometric Neural Process Fields (G-NPF), a probabilistic framework for neural radiance fields that explicitly captures uncertainty. We formulate NeF generalization as a probabilistic problem, enabling direct inference of NeF function distributions from limited context observations. To incorporate structural inductive biases, we introduce a set of geometric bases that encode spatial structure and facilitate the inference of NeF function distributions. Building on these bases, we design a hierarchical latent variable model, allowing G-NPF to integrate structural information across multiple spatial levels and effectively parameterize INR functions. This hierarchical approach improves generalization to novel scenes and unseen signals. Experiments on novel-view synthesis for 3D scenes, as well as 2D image and 1D signal regression, demonstrate the effectiveness of our method in capturing uncertainty and leveraging structural information for improved generalization.
Key facts. No citing papers in the map yet (data through 13 Oct 2026). Builds on 63 of its 72 references that are in the map. First posted on arXiv 4 Feb 2025.
Builds on
63 of 72 references.
References · 63
- 2017Attention Is All You Needcited by 60,106
- 20233D Gaussian Splatting for Real-Time Radiance Field Renderingcited by 6,170
- 2017Model-Agnostic Meta-Learning for Fast Adaptation of Deep Networkscited by 4,870
- 2022Instant Neural Graphics Primitives with a Multiresolution Hash Encodingcited by 3,712
- 2014Deep Learning Face Attributes in the Wildcited by 3,686
- 2019Analyzing and Improving the Image Quality of StyleGANcited by 3,585
- 2019DeepSDF: Learning Continuous Signed Distance Functions for Shape Representationcited by 2,686
- 2020Implicit Neural Representations with Periodic Activation Functionscited by 2,225
- 2020Fourier Features Let Networks Learn High Frequency Functions in Low Dimensional Domainscited by 2,183
- 2018Occupancy Networks: Learning 3D Reconstruction in Function Spacecited by 2,039
- 2021Mip-NeRF: A Multiscale Representation for Anti-Aliasing Neural Radiance Fieldscited by 1,958
- 2022Objaverse: A Universe of Annotated 3D Objectscited by 1,529
38 more
- 2023Zero-1-to-3: Zero-shot One Image to 3D Objectcited by 1,486
- 2022TensoRF: Tensorial Radiance Fieldscited by 1,277
- 2018Learning Implicit Fields for Generative Shape Modelingcited by 1,060
- 2016HyperNetworkscited by 1,010
- 2018On First-Order Meta-Learning Algorithmscited by 1,010
- 2023MVDream: Multi-view Diffusion for 3D Generationcited by 931
- 2023LRM: Large Reconstruction Model for Single Image to 3Dcited by 843
- 2020GIRAFFE: Representing Scenes as Compositional Generative Neural Feature Fieldscited by 785
- 2023pixelSplat: 3D Gaussian Splats from Image Pairs for Scalable Generalizable 3D Reconstructioncited by 673
- 2021Common Objects in 3D: Large-Scale Learning and Evaluation of Real-life 3D Category Reconstructioncited by 648
- 2024MVSplat: Efficient 3D Gaussian Splatting from Sparse Multi-View Imagescited by 557
- 2023Zero123++: a Single Image to Consistent Multi-view Diffusion Base Modelcited by 518
- 2022Point-NeRF: Point-based Neural Radiance Fieldscited by 503
- 20233DShape2VecSet: A 3D Shape Representation for Neural Fields and Generative Diffusion Modelscited by 452
- 2018Conditional Neural Processescited by 423
- 2023Splatter Image: Ultra-Fast Single-View 3D Reconstructioncited by 362
- 2018Neural Processescited by 309
- 2019Attentive Neural Processescited by 281
- 2020Learned Initializations for Optimizing Coordinate-Based Neural Representationscited by 241
- 2020MetaSDF: Meta-learning Signed Distance Functionscited by 214
- 2022DiffRF: Rendering-Guided 3D Radiance Field Diffusioncited by 204
- 2022From data to functa: Your data point is a function and you can treat it like onecited by 186
- 2019Learning Likelihoods with Conditional Normalizing Flowscited by 171
- 2023HyperDiffusion: Generating Implicit Neural Fields with Weight-Space Diffusioncited by 152
- 2019Convolutional Conditional Neural Processescited by 140
- 2021Modulated Periodic Activations for Generalizable Local Functional Representationscited by 140
- 2022Transformer Neural Processes: Uncertainty-Aware Meta Learning Via Sequence Modelingcited by 126
- 2022Generalizable Patch-Based Neural Renderingcited by 121
- 2022Is Attention All That NeRF Needs?cited by 113
- 2023Diffusion with Forward Models: Solving Stochastic Inverse Problems Without Direct Supervisioncited by 112
- 2021NeRF-VAE: A Geometry Aware 3D Scene Generative Modelcited by 111
- 2021Generative Models as Distributions of Functionscited by 89
- 2022COIN++: Neural Compression Across Modalitiescited by 82
- 2022Transformers as Meta-Learners for Implicit Neural Representationscited by 79
- 2022Conditional-Flow NeRF: Accurate 3D Modelling with Reliable Uncertainty Quantificationcited by 72
- 2022Continuous PDE Dynamics Forecasting with Implicit Neural Representationscited by 72
- 2023NeuRBF: A Neural Fields Representation with Adaptive Radial Basis Functionscited by 65
- 2021Meta-Learning Sparse Implicit Neural Representationscited by 48
50 most cited of 63 All 63 (JSON)
Built on by
Not cited yet.