Neural Fourier Filter Bank
Not on the map. Why?
Abstract (arXiv)
We present a novel method to provide efficient and highly detailed reconstructions. Inspired by wavelets, we learn a neural field that decompose the signal both spatially and frequency-wise. We follow the recent grid-based paradigm for spatial decomposition, but unlike existing work, encourage specific frequencies to be stored in each grid via Fourier features encodings. We then apply a multi-layer perceptron with sine activations, taking these Fourier encoded features in at appropriate layers so that higher-frequency components are accumulated on top of lower-frequency components sequentially, which we sum up to form the final output. We demonstrate that our method outperforms the state of the art regarding model compactness and convergence speed on multiple tasks: 2D image fitting, 3D shape reconstruction, and neural radiance fields. Our code is available at https://github.com/ubc-vision/NFFB.
Key facts. Cited by 29 papers in the map (data through 7 Oct 2026). Builds on 66 of its 92 references that are in the map. First posted on arXiv 4 Dec 2022.
Builds on
66 of 92 references.
References · 66
- 2017Attention Is All You Needcited by 59,932
- 2014Adam: A Method for Stochastic Optimizationcited by 36,960
- 2019PyTorch: An Imperative Style, High-Performance Deep Learning Librarycited by 20,160
- 2018The Unreasonable Effectiveness of Deep Features as a Perceptual Metriccited by 11,029
- 2022Instant Neural Graphics Primitives with a Multiresolution Hash Encodingcited by 3,698
- 2022DreamFusion: Text-to-3D using 2D Diffusioncited by 3,006
- 2019DeepSDF: Learning Continuous Signed Distance Functions for Shape Representationcited by 2,682
- 2020Implicit Neural Representations with Periodic Activation Functionscited by 2,214
- 2020Fourier Features Let Networks Learn High Frequency Functions in Low Dimensional Domainscited by 2,170
- 2018Occupancy Networks: Learning 3D Reconstruction in Function Spacecited by 2,037
- 2021Mip-NeRF 360: Unbounded Anti-Aliased Neural Radiance Fieldscited by 2,013
- 2021Mip-NeRF: A Multiscale Representation for Anti-Aliasing Neural Radiance Fieldscited by 1,957
38 more
- 2021Plenoxels: Radiance Fields without Neural Networkscited by 1,607
- 2020pixelNeRF: Neural Radiance Fields from One or Few Imagescited by 1,574
- 2020D-NeRF: Neural Radiance Fields for Dynamic Scenescited by 1,459
- 2022Magic3D: High-Resolution Text-to-3D Content Creationcited by 1,285
- 2022TensoRF: Tensorial Radiance Fieldscited by 1,275
- 2018Learning Implicit Fields for Generative Shape Modelingcited by 1,060
- 2021Direct Voxel Grid Optimization: Super-fast Convergence for Radiance Fields Reconstructioncited by 961
- 2021PlenOctrees for Real-time Rendering of Neural Radiance Fieldscited by 904
- 2019Scene Representation Networks: Continuous 3D-Structure-Aware Neural Scene Representationscited by 864
- 2020Convolutional Occupancy Networkscited by 760
- 2021MVSNeRF: Fast Generalizable Radiance Field Reconstruction from Multi-View Stereocited by 735
- 2022Block-NeRF: Scalable Large Scene Neural View Synthesiscited by 720
- 2021KiloNeRF: Speeding up Neural Radiance Fields with Thousands of Tiny MLPscited by 672
- 2021Ref-NeRF: Structured View-Dependent Appearance for Neural Radiance Fieldscited by 569
- 2020Learning Continuous Image Representation with Local Implicit Image Functioncited by 550
- 2021Neural Fields in Visual Computing and Beyondcited by 539
- 2021FastNeRF: High-Fidelity Neural Rendering at 200FPScited by 510
- 2022Point-NeRF: Point-based Neural Radiance Fieldscited by 503
- 2021Neural Geometric Level of Detail: Real-time Rendering with Implicit 3D Shapescited by 426
- 2020Local Implicit Grid Representations for 3D Scenescited by 372
- 2019Attention Augmented Convolutional Networkscited by 363
- 2022Fast Dynamic Radiance Fields with Time-Aware Neural Voxelscited by 344
- 2022MobileNeRF: Exploiting the Polygon Rasterization Pipeline for Efficient Neural Field Rendering on Mobile Architecturescited by 308
- 2018An Intriguing Failing of Convolutional Neural Networks and the CoordConv Solutioncited by 302
- 2019Learning Shape Templates with Structured Implicit Functionscited by 242
- 2016Volumetric and Multi-View CNNs for Object Classification on 3D Datacited by 240
- 2021COIN: COmpression with Implicit Neural representationscited by 232
- 2021Editing Conditional Radiance Fieldscited by 222
- 2019CvxNet: Learnable Convex Decompositioncited by 173
- 2019Photorealistic Style Transfer via Wavelet Transformscited by 166
- 2022SinNeRF: Training Neural Radiance Fields on Complex Scenes from a Single Imagecited by 165
- 2021BACON: Band-limited Coordinate Networks for Multiscale Scene Representationcited by 142
- 2021Modulated Periodic Activations for Generalizable Local Functional Representationscited by 140
- 2020Adversarial Generation of Continuous Imagescited by 135
- 2022Wavelet Diffusion Models are fast and scalable Image Generatorscited by 116
- 2021NeRF-VAE: A Geometry Aware 3D Scene Generative Modelcited by 111
- 2022EfficientNeRF: Efficient Neural Radiance Fieldscited by 110
- 2021A Structured Dictionary Perspective on Implicit Neural Representationscited by 100
50 most cited of 66 All 66 (JSON)
Built on by
Citing papers per year: 2022: 1; 2023: 10; 2024: 11; 2025: 4; 2026: 3.
29 papers.
Sort:
- 2023FINER: Flexible spectral-bias tuning in Implicit NEural Representation by Variable-periodic Activation Functionscited by 77
- 2023NeuRBF: A Neural Fields Representation with Adaptive Radial Basis Functionscited by 65
- 2022Masked Wavelet Representation for Compact Neural Radiance Fieldscited by 57
- 2024Tuning the Frequencies: Robust Training for Sinusoidal Neural Networkscited by 18
- 2024HIIF: Hierarchical Encoding based Implicit Image Function for Continuous Super-resolutioncited by 17
- 2024DaReNeRF: Direction-aware Representation for Dynamic Scenescited by 15
- 2023Accelerating Neural Field Training via Soft Miningcited by 13
- 2023FastSR-NeRF: Improving NeRF Efficiency on Consumer Devices with A Simple Super-Resolution Pipelinecited by 12
- 2023Generative Neural Fields by Mixtures of Neural Implicit Functionscited by 10
- 2023ImFace++: A Sophisticated Nonlinear 3D Morphable Face Model with Implicit Neural Representationscited by 10
- 2024BANF: Band-limited Neural Fields for Levels of Detail Reconstructioncited by 10
- 2024FINER++: Building a Family of Variable-periodic Functions for Activating Implicit Neural Representationcited by 10
17 more
- 2023ECRF: Entropy-Constrained Neural Radiance Fields Compression with Frequency Domain Optimizationcited by 8
- 2024Grounding and Enhancing Grid-based Models for Neural Fieldscited by 8
- 2023Thera: Aliasing-Free Arbitrary-Scale Super-Resolution with Neural Heat Fieldscited by 5
- 2023Coordinate-Aware Modulation for Neural Fieldscited by 4
- 2025A Unified Theory of Sinusoidal Activation Families for Implicit Neural Representationscited by 4
- 2023Pose Modulated Avatars from Videocited by 3
- 2024Deep Fourier-embedded Network for RGB and Thermal Salient Object Detectioncited by 2
- 2025MetricGrids: Arbitrary Nonlinear Approximation with Elementary Metric Grids based Implicit Neural Representationcited by 2
- 2024Representing Animatable Avatar via Factorized Neural Fieldscited by 1
- 2024Learning Two-factor Representation for Magnetic Resonance Image Super-resolutioncited by 1
- 2026Factorized Multi-Resolution HashGrid for Efficient Neural Radiance Fields: Execution on Edge-Devicescited by 1
- 2024MDNF: Multi-Diffusion-Nets for Neural Fields on Meshescited by 0
- 2024DaRePlane: Direction-aware Representations for Dynamic Scene Reconstructioncited by 0
- 2025FLAIR: Frequency- and Locality-Aware Implicit Neural Representationscited by 0
- 2025Adaptive Training of INRs via Pruning and Densificationcited by 0
- 2026Adaptive Local Frequency Filtering for Fourier-Encoded Implicit Neural Representationscited by 0
- 2026CARA: Collision-Aware Resolution Adaptation for Multiresolution Hash Encoding Based Image Fittingcited by 0
- 2026CARA: Collision-Aware Resolution Adaptation for Multiresolution Hash Encoding Based Image Fitting16 Sep 2026
- 2026Adaptive Local Frequency Filtering for Fourier-Encoded Implicit Neural Representations3 Apr 2026
- 2026Factorized Multi-Resolution HashGrid for Efficient Neural Radiance Fields: Execution on Edge-Devices3 Apr 2026
- 2025Adaptive Training of INRs via Pruning and Densification27 Oct 2025
- 2025FLAIR: Frequency- and Locality-Aware Implicit Neural Representations19 Aug 2025
- 2025MetricGrids: Arbitrary Nonlinear Approximation with Elementary Metric Grids based Implicit Neural Representation13 Mar 2025
- 2025A Unified Theory of Sinusoidal Activation Families for Implicit Neural Representations2 Feb 2025
- 2024HIIF: Hierarchical Encoding based Implicit Image Function for Continuous Super-resolution4 Dec 2024
- 2024Deep Fourier-embedded Network for RGB and Thermal Salient Object Detection27 Nov 2024
- 2024DaRePlane: Direction-aware Representations for Dynamic Scene Reconstruction18 Oct 2024
- 2024Learning Two-factor Representation for Magnetic Resonance Image Super-resolution15 Sep 2024
- 2024MDNF: Multi-Diffusion-Nets for Neural Fields on Meshes4 Sep 2024
17 more
- 2024Tuning the Frequencies: Robust Training for Sinusoidal Neural Networks30 Jul 2024
- 2024FINER++: Building a Family of Variable-periodic Functions for Activating Implicit Neural Representation28 Jul 2024
- 2024Representing Animatable Avatar via Factorized Neural Fields2 Jun 2024
- 2024BANF: Band-limited Neural Fields for Levels of Detail Reconstruction19 Apr 2024
- 2024Grounding and Enhancing Grid-based Models for Neural Fields29 Mar 2024
- 2024DaReNeRF: Direction-aware Representation for Dynamic Scenes4 Mar 2024
- 2023FastSR-NeRF: Improving NeRF Efficiency on Consumer Devices with A Simple Super-Resolution Pipeline15 Dec 2023
- 2023ImFace++: A Sophisticated Nonlinear 3D Morphable Face Model with Implicit Neural Representations7 Dec 2023
- 2023FINER: Flexible spectral-bias tuning in Implicit NEural Representation by Variable-periodic Activation Functions5 Dec 2023
- 2023Accelerating Neural Field Training via Soft Mining29 Nov 2023
- 2023Thera: Aliasing-Free Arbitrary-Scale Super-Resolution with Neural Heat Fields29 Nov 2023
- 2023Coordinate-Aware Modulation for Neural Fields25 Nov 2023
- 2023ECRF: Entropy-Constrained Neural Radiance Fields Compression with Frequency Domain Optimization23 Nov 2023
- 2023Generative Neural Fields by Mixtures of Neural Implicit Functions30 Oct 2023
- 2023NeuRBF: A Neural Fields Representation with Adaptive Radial Basis Functions27 Sep 2023
- 2023Pose Modulated Avatars from Video23 Aug 2023
- 2022Masked Wavelet Representation for Compact Neural Radiance Fields18 Dec 2022
- 2023FINER: Flexible spectral-bias tuning in Implicit NEural Representation by Variable-periodic Activation Functionscited by 77
- 2023NeuRBF: A Neural Fields Representation with Adaptive Radial Basis Functionscited by 65
- 2022Masked Wavelet Representation for Compact Neural Radiance Fieldscited by 57
- 2024Tuning the Frequencies: Robust Training for Sinusoidal Neural Networkscited by 18
- 2024HIIF: Hierarchical Encoding based Implicit Image Function for Continuous Super-resolutioncited by 17
- 2024DaReNeRF: Direction-aware Representation for Dynamic Scenescited by 15
- 2023Accelerating Neural Field Training via Soft Miningcited by 13
- 2023FastSR-NeRF: Improving NeRF Efficiency on Consumer Devices with A Simple Super-Resolution Pipelinecited by 12
- 2023Generative Neural Fields by Mixtures of Neural Implicit Functionscited by 10
- 2023ImFace++: A Sophisticated Nonlinear 3D Morphable Face Model with Implicit Neural Representationscited by 10
- 2024BANF: Band-limited Neural Fields for Levels of Detail Reconstructioncited by 10
- 2024FINER++: Building a Family of Variable-periodic Functions for Activating Implicit Neural Representationcited by 10
12 most cited of 29 All 29 (JSON)
- 2026CARA: Collision-Aware Resolution Adaptation for Multiresolution Hash Encoding Based Image Fitting16 Sep 2026
- 2026Adaptive Local Frequency Filtering for Fourier-Encoded Implicit Neural Representations3 Apr 2026
- 2026Factorized Multi-Resolution HashGrid for Efficient Neural Radiance Fields: Execution on Edge-Devices3 Apr 2026
- 2025Adaptive Training of INRs via Pruning and Densification27 Oct 2025
- 2025FLAIR: Frequency- and Locality-Aware Implicit Neural Representations19 Aug 2025
- 2025MetricGrids: Arbitrary Nonlinear Approximation with Elementary Metric Grids based Implicit Neural Representation13 Mar 2025
- 2025A Unified Theory of Sinusoidal Activation Families for Implicit Neural Representations2 Feb 2025
- 2024HIIF: Hierarchical Encoding based Implicit Image Function for Continuous Super-resolution4 Dec 2024
- 2024Deep Fourier-embedded Network for RGB and Thermal Salient Object Detection27 Nov 2024
- 2024DaRePlane: Direction-aware Representations for Dynamic Scene Reconstruction18 Oct 2024
- 2024Learning Two-factor Representation for Magnetic Resonance Image Super-resolution15 Sep 2024
- 2024MDNF: Multi-Diffusion-Nets for Neural Fields on Meshes4 Sep 2024
12 newest of 29 All 29 (JSON)