mlsanityData to 14 Oct 2026

WIRE: Wavelet Implicit Neural Representations

arXiv 2301.05187 ↗First posted 5 Jan 2023cs.CV cs.GR eess.IVcited by 220

Not on the map. Why?

Abstract (arXiv)

Implicit neural representations (INRs) have recently advanced numerous vision-related areas. INR performance depends strongly on the choice of the nonlinear activation function employed in its multilayer perceptron (MLP) network. A wide range of nonlinearities have been explored, but, unfortunately, current INRs designed to have high accuracy also suffer from poor robustness (to signal noise, parameter variation, etc.). Inspired by harmonic analysis, we develop a new, highly accurate and robust INR that does not exhibit this tradeoff. Wavelet Implicit neural REpresentation (WIRE) uses a continuous complex Gabor wavelet activation function that is well-known to be optimally concentrated in space-frequency and to have excellent biases for representing images. A wide range of experiments (image denoising, image inpainting, super-resolution, computed tomography reconstruction, image overfitting, and novel view synthesis with neural radiance fields) demonstrate that WIRE defines the new state of the art in INR accuracy, training time, and robustness.

Key facts. Cited by 220 papers in the map (data through 14 Oct 2026). Builds on 25 of its 58 references that are in the map. First posted on arXiv 5 Jan 2023.

Builds on

25 of 58 references.

References · 25

  1. 2014Adam: A Method for Stochastic Optimizationcited by 37,240
  2. 2019PyTorch: An Imperative Style, High-Performance Deep Learning Librarycited by 20,305
  3. 2015U-Net: Convolutional Networks for Biomedical Image Segmentationcited by 19,713
  4. 2022Instant Neural Graphics Primitives with a Multiresolution Hash Encodingcited by 3,723
  5. 2018Neural Tangent Kernel: Convergence and Generalization in Neural Networkscited by 2,621
  6. 2020Implicit Neural Representations with Periodic Activation Functionscited by 2,238
  7. 2020Fourier Features Let Networks Learn High Frequency Functions in Low Dimensional Domainscited by 2,200
  8. 2018Occupancy Networks: Learning 3D Reconstruction in Function Spacecited by 2,041
  9. 2017Deep Image Priorcited by 1,098
  10. 2019Wide Neural Networks of Any Depth Evolve as Linear Models Under Gradient Descentcited by 738
  11. 2021KiloNeRF: Speeding up Neural Radiance Fields with Thousands of Tiny MLPscited by 673
  12. 2020Learning Continuous Image Representation with Local Implicit Image Functioncited by 552
13 more
  1. 2016The Little Engine that Could: Regularization by Denoising (RED)cited by 307
  2. 2021Beyond Periodicity: Towards a Unifying Framework for Activations in Coordinate-MLPscited by 135
  3. 2022Neural Rendering for Stereo 3D Reconstruction of Deformable Tissues in Robotic Surgerycited by 123
  4. 2018Deep Decoder: Concise Image Representations from Untrained Non-convolutional Networkscited by 120
  5. 2021A Structured Dictionary Perspective on Implicit Neural Representationscited by 100
  6. 2021T"oRF: Time-of-Flight Radiance Fields for Dynamic Scene View Synthesiscited by 88
  7. 2021FoV-NeRF: Foveated Neural Radiance Fields for Virtual Realitycited by 79
  8. 2017One Network to Solve Them All --- Solving Linear Inverse Problems using Deep Projection Modelscited by 67
  9. 2021ACORN: Adaptive Coordinate Networks for Neural Scene Representationcited by 65
  10. 2021CoIL: Coordinate-based Internal Learning for Imaging Inverse Problemscited by 33
  11. 2022MINER: Multiscale Implicit Neural Representationscited by 20
  12. 2021NeuMIP: Multi-Resolution Neural Materialscited by 15
  13. 2022DeepTensor: Low-Rank Tensor Decomposition with Deep Network Priorscited by 15

Built on by

Cited by year (2026 to 14 Oct)

Citing papers per year: 2023: 22; 2024: 65; 2025: 79; 2026: 54.

220 papers.

Sort:

By area:

  1. 2024Wav-KAN: Wavelet Kolmogorov-Arnold Networkscited by 122
  2. 2024GaussianImage: 1000 FPS Image Representation and Compression by 2D Gaussian Splattingcited by 99
  3. 2023Implicit Neural Representation in Medical Imaging: A Comparative Surveycited by 90
  4. 2023FINER: Flexible spectral-bias tuning in Implicit NEural Representation by Variable-periodic Activation Functionscited by 78
  5. 2024Wavelet Convolutions for Large Receptive Fieldscited by 74
  6. 2023NeuRBF: A Neural Fields Representation with Adaptive Radial Basis Functionscited by 65
  7. 2023Multi-stage Neural Networks: Function Approximator of Machine Precisioncited by 48
  8. 2024Neural Redshift: Random Networks are not Random Functionscited by 43
  9. 2024Where Do We Stand with Implicit Neural Representations? A Technical and Performance Surveycited by 42
  10. 2023Continuous-Time Functional Diffusion Processescited by 39
  11. 2024Improved Implicit Neural Representation with Fourier Reparameterized Trainingcited by 36
  12. 2024Image-GS: Content-Adaptive Image Representation via 2D Gaussianscited by 35
38 more
  1. 2023Single-subject Multi-contrast MRI Super-resolution via Implicit Neural Representationscited by 32
  2. 2023INCODE: Implicit Neural Conditioning with Prior Knowledge Embeddingscited by 31
  3. 2024Boosting Neural Representations for Videos with a Conditional Decodercited by 29
  4. 2024A Sampling Theory Perspective on Activations for Implicit Neural Representationscited by 24
  5. 2023Random-Access Neural Compression of Material Texturescited by 23
  6. 2024Efficient Learning With Sine-Activated Low-rank Matricescited by 22
  7. 2024Tuning the Frequencies: Robust Training for Sinusoidal Neural Networkscited by 19
  8. 2025Instant GaussianImage: A Generalizable and Self-Adaptive Image Representation via 2D Gaussian Splattingcited by 18
  9. 2024DaReNeRF: Direction-aware Representation for Dynamic Scenescited by 15
  10. 2024CINA: Conditional Implicit Neural Atlas for Spatio-Temporal Representation of Fetal Brainscited by 14
  11. 2024Learning Transferable Features for Implicit Neural Representationscited by 14
  12. 2024FreSh: Frequency Shifting for Accelerated Neural Representation Learningcited by 14
  13. 2023Globally injective and bijective neural operatorscited by 13
  14. 2025Do We Always Need the Simplicity Bias? Looking for Optimal Inductive Biases in the Wildcited by 13
  15. 2023Lie Group Decompositions for Equivariant Neural Networkscited by 12
  16. 2024Geometry-Informed Neural Networkscited by 12
  17. 2024MiraGe: Editable 2D Images using Gaussian Splattingcited by 12
  18. 2024From Activation to Initialization: Scaling Insights for Optimizing Neural Fieldscited by 11
  19. 2024FINER++: Building a Family of Variable-periodic Functions for Activating Implicit Neural Representationcited by 11
  20. 2024Fast Training of Sinusoidal Neural Fields via Scaling Initializationcited by 11
  21. 2025Fit Pixels, Get Labels: Meta-learned Implicit Networks for Image Segmentationcited by 11
  22. 2023ImFace++: A Sophisticated Nonlinear 3D Morphable Face Model with Implicit Neural Representationscited by 10
  23. 2024Fourier-enhanced Implicit Neural Fusion Network for Multispectral and Hyperspectral Image Fusioncited by 10
  24. 2023RHINO: Regularizing the Hash-based Implicit Neural Representationcited by 9
  25. 2023Fr'echet Wavelet Distance: A Domain-Agnostic Metric for Image Generationcited by 9
  26. 2024DUDF: Differentiable Unsigned Distance Fields with Hyperbolic Scalingcited by 9
  27. 2024ASMR: Activation-sharing Multi-resolution Coordinate Networks For Efficient Inferencecited by 9
  28. 2024Latent-INR: A Flexible Framework for Implicit Representations of Videos with Discriminative Semanticscited by 9
  29. 2024Neural Experts: Mixture of Experts for Implicit Neural Representationscited by 9
  30. 2025SNeRV: Spectra-preserving Neural Representation for Videocited by 9
  31. 2023Unsupervised reconstruction of accelerated cardiac cine MRI using Neural Fieldscited by 8
  32. 2023Implicit Neural Representations and the Algebra of Complex Waveletscited by 8
  33. 2024TriNeRFLet: A Wavelet Based Triplane NeRF Representationcited by 8
  34. 2024Inductive Gradient Adjustment For Spectral Bias In Implicit Neural Representationscited by 8
  35. 2025Optimizing Rank for High-Fidelity Implicit Neural Representationscited by 8
  36. 2023In Search of a Data Transformation That Accelerates Neural Field Trainingcited by 7
  37. 2024Superpixel-informed Implicit Neural Representation for Multi-Dimensional Datacited by 7
  38. 2024EVOS: Efficient Implicit Neural Training via EVOlutionary Selectorcited by 7

50 most cited of 220 All 220 (JSON)