PREF: Phasorial Embedding Fields for Compact Neural Representations
Not on the map. Why?
Abstract (arXiv)
We present an efficient frequency-based neural representation termed PREF: a shallow MLP augmented with a phasor volume that covers significant border spectra than previous Fourier feature mapping or Positional Encoding. At the core is our compact 3D phasor volume where frequencies distribute uniformly along a 2D plane and dilate along a 1D axis. To this end, we develop a tailored and efficient Fourier transform that combines both Fast Fourier transform and local interpolation to accelerate na"ive Fourier mapping. We also introduce a Parsvel regularizer that stables frequency-based learning. In these ways, Our PREF reduces the costly MLP in the frequency-based representation, thereby significantly closing the efficiency gap between it and other hybrid representations, and improving its interpretability. Comprehensive experiments demonstrate that our PREF is able to capture high-frequency details while remaining compact and robust, including 2D image generalization, 3D signed distance function regression and 5D neural radiance field reconstruction.
Key facts. Cited by 10 papers in the map (data through 14 Oct 2026). Builds on 47 of its 72 references that are in the map. First posted on arXiv 26 May 2022.
Builds on
47 of 72 references.
References · 47
- 2014Adam: A Method for Stochastic Optimizationcited by 37,240
- 2018A Style-Based Generator Architecture for Generative Adversarial Networkscited by 6,013
- 2022Instant Neural Graphics Primitives with a Multiresolution Hash Encodingcited by 3,723
- 2020Fourier Neural Operator for Parametric Partial Differential Equationscited by 2,908
- 2019DeepSDF: Learning Continuous Signed Distance Functions for Shape Representationcited by 2,689
- 2020Implicit Neural Representations with Periodic Activation Functionscited by 2,238
- 2020Fourier Features Let Networks Learn High Frequency Functions in Low Dimensional Domainscited by 2,200
- 2018Occupancy Networks: Learning 3D Reconstruction in Function Spacecited by 2,041
- 2021Mip-NeRF: A Multiscale Representation for Anti-Aliasing Neural Radiance Fieldscited by 1,964
- 2021NeuS: Learning Neural Implicit Surfaces by Volume Rendering for Multi-view Reconstructioncited by 1,712
- 2021Plenoxels: Radiance Fields without Neural Networkscited by 1,613
- 2022TensoRF: Tensorial Radiance Fieldscited by 1,280
35 more
- 2020NeRF in the Wild: Neural Radiance Fields for Unconstrained Photo Collectionscited by 1,232
- 2021Efficient Geometry-aware 3D Generative Adversarial Networkscited by 1,205
- 2020Nerfies: Deformable Neural Radiance Fieldscited by 1,198
- 2021Alias-Free Generative Adversarial Networkscited by 1,184
- 2021Volume Rendering of Neural Implicit Surfacescited by 996
- 2021Direct Voxel Grid Optimization: Super-fast Convergence for Radiance Fields Reconstructioncited by 964
- 2020Neural Sparse Voxel Fieldscited by 959
- 2021PlenOctrees for Real-time Rendering of Neural Radiance Fieldscited by 905
- 2019Scene Representation Networks: Continuous 3D-Structure-Aware Neural Scene Representationscited by 864
- 2020NeRF++: Analyzing and Improving Neural Radiance Fieldscited by 861
- 2020Convolutional Occupancy Networkscited by 761
- 2021MVSNeRF: Fast Generalizable Radiance Field Reconstruction from Multi-View Stereocited by 740
- 2020Implicit Geometric Regularization for Learning Shapescited by 710
- 2019Differentiable Volumetric Rendering: Learning Implicit 3D Representations without 3D Supervisioncited by 700
- 2021KiloNeRF: Speeding up Neural Radiance Fields with Thousands of Tiny MLPscited by 673
- 2019Local Light Field Fusion: Practical View Synthesis with Prescriptive Sampling Guidelinescited by 672
- 2021UNISURF: Unifying Neural Implicit Surfaces and Radiance Fields for Multi-View Reconstructioncited by 646
- 2021BARF: Bundle-Adjusting Neural Radiance Fieldscited by 642
- 2020Learning Continuous Image Representation with Local Implicit Image Functioncited by 552
- 2022Point-NeRF: Point-based Neural Radiance Fieldscited by 503
- 2018Meta-Learning with Latent Embedding Optimizationcited by 476
- 2021Baking Neural Radiance Fields for Real-Time View Synthesiscited by 468
- 2021Neural Geometric Level of Detail: Real-time Rendering with Implicit 3D Shapescited by 426
- 2019SAL: Sign Agnostic Learning of Shapes from Raw Datacited by 390
- 2021GAN Inversion: A Surveycited by 367
- 2021Extracting Triangular 3D Models, Materials, and Lighting From Imagescited by 366
- 2016Volumetric and Multi-View CNNs for Object Classification on 3D Datacited by 240
- 2021GNeRF: GAN-based Neural Radiance Field without Posed Cameracited by 153
- 2021BACON: Band-limited Coordinate Networks for Multiscale Scene Representationcited by 143
- 2017SurfaceNet: An End-to-end 3D Neural Network for Multiview Stereopsiscited by 128
- 2021A Structured Dictionary Perspective on Implicit Neural Representationscited by 100
- 2021SAPE: Spatially-Adaptive Progressive Encoding for Neural Optimizationcited by 59
- 2020Tensor Low-Rank Reconstruction for Semantic Segmentationcited by 29
- 2021Spline Positional Encoding for Learning 3D Implicit Signed Distance Fieldscited by 21
- 2019Fourier-CPPNs for Image Synthesiscited by 4
Built on by
Citing papers per year: 2022: 2; 2023: 5; 2024: 3.
10 papers.
- 2023CompGS: Smaller and Faster Gaussian Splatting with Vector Quantizationcited by 130
- 2023Factor Fields: A Unified Framework for Neural Fields and Beyondcited by 58
- 2022Masked Wavelet Representation for Compact Neural Radiance Fieldscited by 57
- 2023TeTriRF: Temporal Tri-Plane Radiance Fields for Efficient Free-Viewpoint Videocited by 22
- 2024Implicit Gaussian Splatting with Efficient Multi-Level Tri-Plane Representationcited by 21
- 2023OPE-SR: Orthogonal Position Encoding for Designing a Parameter-free Upsampling Module in Arbitrary-scale Image Super-Resolutioncited by 17
- 2024DaReNeRF: Direction-aware Representation for Dynamic Scenescited by 15
- 2022PREF: Predictability Regularized Neural Motion Fieldscited by 13
- 2023General Neural Gauge Fieldscited by 12
- 2024DaRePlane: Direction-aware Representations for Dynamic Scene Reconstructioncited by 0
- 2024DaRePlane: Direction-aware Representations for Dynamic Scene Reconstruction18 Oct 2024
- 2024Implicit Gaussian Splatting with Efficient Multi-Level Tri-Plane Representation19 Aug 2024
- 2024DaReNeRF: Direction-aware Representation for Dynamic Scenes4 Mar 2024
- 2023TeTriRF: Temporal Tri-Plane Radiance Fields for Efficient Free-Viewpoint Video10 Dec 2023
- 2023CompGS: Smaller and Faster Gaussian Splatting with Vector Quantization30 Nov 2023
- 2023General Neural Gauge Fields5 May 2023
- 2023OPE-SR: Orthogonal Position Encoding for Designing a Parameter-free Upsampling Module in Arbitrary-scale Image Super-Resolution2 Mar 2023
- 2023Factor Fields: A Unified Framework for Neural Fields and Beyond2 Feb 2023
- 2022Masked Wavelet Representation for Compact Neural Radiance Fields18 Dec 2022
- 2022PREF: Predictability Regularized Neural Motion Fields21 Sep 2022