mlsanityData to 14 Oct 2026

COSMO-INR: Complex Sinusoidal Modulation for Implicit Neural Representations

arXiv 2505.11640 ↗First posted 16 May 2025cs.CVcited by 1

Not on the map. Why?

Abstract (arXiv)

Implicit neural representations (INRs) are a powerful paradigm for modeling data, offering a continuous alternative to discrete signal representations. Their ability to compactly encode complex signals has led to strong performance in many vision tasks. Prior work shows INR performance is highly sensitive to the choice of activation function in the underlying multilayer perceptron, yet the theoretical reasons remain unclear. Key limitations also persist, including spectral bias (reduced sensitivity to high-frequency content), limited robustness to noise, and difficulty capturing local and global structure jointly. We analyze INR signal representation using harmonic analysis and Chebyshev polynomials. We prove that modulating activation functions with a complex sinusoidal term yields richer and more complete spectral support throughout the network. Building on this, we introduce a new activation function tailored to INRs and validate our theory using Chebyshev analysis and extensive experiments. We additionally use a regularized deep prior, extracted from a task-specific model, to adapt the activations, further improving convergence speed and stability. Across image reconstruction (average PSNR gain of +5.67 dB over the nearest counterpart on a diverse dataset), denoising (+0.46 dB PSNR), super-resolution (+0.64 dB over the nearest SOTA method for 6X upscaling), inpainting, and 3D shape reconstruction, our activation consistently outperforms existing state-of-the-art alternatives.

Key facts. Cited by 1 paper in the map (data through 14 Oct 2026). Builds on 19 of its 24 references that are in the map. First posted on arXiv 16 May 2025.

Builds on

19 of 24 references.

References · 19

  1. 2020Implicit Neural Representations with Periodic Activation Functionscited by 2,238
  2. 2018Occupancy Networks: Learning 3D Reconstruction in Function Spacecited by 2,041
  3. 2018On the Spectral Bias of Neural Networkscited by 1,341
  4. 2019Scene Representation Networks: Continuous 3D-Structure-Aware Neural Scene Representationscited by 864
  5. 2020Implicit Geometric Regularization for Learning Shapescited by 710
  6. 2019SAL: Sign Agnostic Learning of Shapes from Raw Datacited by 390
  7. 2019Learning Shape Templates with Structured Implicit Functionscited by 242
  8. 2023WIRE: Wavelet Implicit Neural Representationscited by 220
  9. 2019Deep ReLU Networks Have Surprisingly Few Activation Patternscited by 161
  10. 2021Beyond Periodicity: Towards a Unifying Framework for Activations in Coordinate-MLPscited by 135
  11. 2021A Structured Dictionary Perspective on Implicit Neural Representationscited by 100
  12. 2023Implicit Neural Representation in Medical Imaging: A Comparative Surveycited by 90
7 more
  1. 2021FoV-NeRF: Foveated Neural Radiance Fields for Virtual Realitycited by 79
  2. 2023FINER: Flexible spectral-bias tuning in Implicit NEural Representation by Variable-periodic Activation Functionscited by 78
  3. 2024Improved Implicit Neural Representation with Fourier Reparameterized Trainingcited by 36
  4. 2023INCODE: Implicit Neural Conditioning with Prior Knowledge Embeddingscited by 31
  5. 2024A Sampling Theory Perspective on Activations for Implicit Neural Representationscited by 24
  6. 2024Tuning the Frequencies: Robust Training for Sinusoidal Neural Networkscited by 19
  7. 2024HOSC: A Periodic Activation Function for Preserving Sharp Features in Implicit Neural Representationscited by 14

Built on by

Cited by year (2026 to 14 Oct)

Citing papers per year: 2026: 1.

1 paper.