mlsanityData to 14 Oct 2026

High-Frequency First: A Two-Stage Approach for Improving Image INR

arXiv 2508.15582 ↗First posted 21 Aug 2025cs.CVcited by 1

Not on the map. Why?

Abstract (arXiv)

Implicit Neural Representations (INRs) have emerged as a powerful alternative to traditional pixel-based formats by modeling images as continuous functions over spatial coordinates. A key challenge, however, lies in the spectral bias of neural networks, which tend to favor low-frequency components while struggling to capture high-frequency (HF) details such as sharp edges and fine textures. While prior approaches have addressed this limitation through architectural modifications or specialized activation functions, the potential of complementary training strategies remains relatively underexplored. In this work, we propose an orthogonal direction by directly guiding the training process. Specifically, we introduce a two-stage training strategy where a neighbor-aware soft mask adaptively assigns higher weights to pixels with strong local variations, encouraging early focus on fine details. The model then transitions to full-image training. Experimental results show that our approach is complementary to existing INR methods and consistently improves reconstruction quality. By assigning frequency-aware importance to pixels in image INR, our work offers an effective avenue to mitigate the spectral bias problem.

Key facts. Cited by 1 paper in the map (data through 14 Oct 2026). Builds on 23 of its 34 references that are in the map. First posted on arXiv 21 Aug 2025.

Builds on

23 of 34 references.

References · 23

  1. 2019DeepSDF: Learning Continuous Signed Distance Functions for Shape Representationcited by 2,689
  2. 2017What Uncertainties Do We Need in Bayesian Deep Learning for Computer Vision?cited by 2,352
  3. 2020Implicit Neural Representations with Periodic Activation Functionscited by 2,238
  4. 2020Fourier Features Let Networks Learn High Frequency Functions in Low Dimensional Domainscited by 2,200
  5. 2018On the Spectral Bias of Neural Networkscited by 1,341
  6. 2018Learning Implicit Fields for Generative Shape Modelingcited by 1,060
  7. 2020GRAF: Generative Radiance Fields for 3D-Aware Image Synthesiscited by 689
  8. 2019Deep Learning for 3D Point Clouds: A Surveycited by 558
  9. 2020Learning Continuous Image Representation with Local Implicit Image Functioncited by 552
  10. 2021StyleNeRF: A Style-based 3D-Aware Generator for High-resolution Image Synthesiscited by 477
  11. 2019Learning Shape Templates with Structured Implicit Functionscited by 242
  12. 2023WIRE: Wavelet Implicit Neural Representationscited by 220
11 more
  1. 2019DIST: Rendering Deep Implicit Signed Distance Function with Differentiable Sphere Tracingcited by 180
  2. 2020Spectral Bias and Task-Model Alignment Explain Generalization in Kernel Regression and Infinitely Wide Neural Networkscited by 166
  3. 2021BACON: Band-limited Coordinate Networks for Multiscale Scene Representationcited by 143
  4. 2023Implicit Neural Representation in Medical Imaging: A Comparative Surveycited by 90
  5. 2023FINER: Flexible spectral-bias tuning in Implicit NEural Representation by Variable-periodic Activation Functionscited by 78
  6. 2023INCODE: Implicit Neural Conditioning with Prior Knowledge Embeddingscited by 31
  7. 2023Partition Speeds Up Learning Implicit Neural Representations Based on Exponential-Increase Hypothesiscited by 13
  8. 2023Learning Spatially Collaged Fourier Bases for Implicit Neural Representationcited by 11
  9. 2021Multi-Head ReLU Implicit Neural Representation Networkscited by 10
  10. 2019On the Effect of Low-Frequency Terms on Neural-IR Modelscited by 6
  11. 2025Exploring Kernel Transformations for Implicit Neural Representationscited by 2

Built on by

Cited by year

Citing papers per year: 2025: 1.

1 paper.