ScaLe-INR: Scale and Learn Implicit Neural Representations
Not on the map. Why?
Abstract (arXiv)
Implicit Neural Representations (INRs) parameterized by multilayer perceptrons excel at modeling continuous signals. However, a key challenge persists as INRs fundamentally suffer from spectral bias and information cross-talk. When a single network attempts to capture multi-scale phenomena, high-frequency weight updates destructively interfere with the underlying low-frequency structural approximation. We introduce Scale and Learn INR (ScaLe-INR), a novel multi-branch architecture that resolves these limitations by explicitly matching the signal's frequency spectrum with the optimal operating region of the INR. Drawing upon the Fourier inverse scaling theorem we demonstrate that applying directional coordinate scaling expands a network's representational bandwidth along specific spatial axes. To mathematically enforce functional disentanglement and minimize task-specific information leakage between branches, we propose a Directional Edge Guidance Loss, a spatially-conditioned sparsity prior derived from ground-truth gradients. By constraining the high-frequency branches to act as strict, localized edge-filters, ScaLe-INR eliminates spectral cross-talk, accelerates convergence, and achieves high-fidelity signal reconstruction on complex multi-scale topologies. We evaluate ScaLe-INR across diverse reconstruction and inverse tasks, demonstrating substantial performance gains over existing state-of-the-art (SOTA) methods. The proposed architecture improves upon the nearest baselines by +5.16 dB in image reconstruction and +0.65 dB in image denoising. Furthermore, it achieve an impressive figure of 50.02 dB on audio reconstruction and 0.999 IOU(Intersection Over Union) on 3D reconstruction which beats the all SOTA models.
Key facts. No citing papers in the map yet (data through 14 Oct 2026). Builds on 15 of its 18 references that are in the map. First posted on arXiv 26 Jun 2026.
Builds on
15 of 18 references.
References · 15
- 2022Instant Neural Graphics Primitives with a Multiresolution Hash Encodingcited by 3,723
- 2020Implicit Neural Representations with Periodic Activation Functionscited by 2,238
- 2020Fourier Features Let Networks Learn High Frequency Functions in Low Dimensional Domainscited by 2,200
- 2018On the Spectral Bias of Neural Networkscited by 1,341
- 2023WIRE: Wavelet Implicit Neural Representationscited by 220
- 2019Deep ReLU Networks Have Surprisingly Few Activation Patternscited by 161
- 2021BACON: Band-limited Coordinate Networks for Multiscale Scene Representationcited by 143
- 2021Beyond Periodicity: Towards a Unifying Framework for Activations in Coordinate-MLPscited by 135
- 2023FINER: Flexible spectral-bias tuning in Implicit NEural Representation by Variable-periodic Activation Functionscited by 78
- 2023INCODE: Implicit Neural Conditioning with Prior Knowledge Embeddingscited by 31
- 2022MINER: Multiscale Implicit Neural Representationscited by 20
- 2024HOSC: A Periodic Activation Function for Preserving Sharp Features in Implicit Neural Representationscited by 14
3 more
Built on by
Not cited yet.