mlsanityData to 14 Oct 2026

H-SIREN: Improving implicit neural representations with hyperbolic periodic functions

arXiv 2410.04716 ↗First posted 7 Oct 2024cs.CVcited by 5

Not on the map. Why?

Abstract (arXiv)

Implicit neural representations (INR) have been recently adopted in various applications ranging from computer vision tasks to physics simulations by solving partial differential equations. Among existing INR-based works, multi-layer perceptrons with sinusoidal activation functions find widespread applications and are also frequently treated as a baseline for the development of better activation functions for INR applications. Recent investigations claim that the use of sinusoidal activation functions could be sub-optimal due to their limited supported frequency set as well as their tendency to generate over-smoothed solutions. We provide a simple solution to mitigate such an issue by changing the activation function at the first layer from sin(x) to sin(sinh(2x)). We demonstrate H-SIREN in various computer vision and fluid flow problems, where it surpasses the performance of several state-of-the-art INRs.

Key facts. Cited by 5 papers in the map (data through 14 Oct 2026). Builds on 34 of its 44 references that are in the map. First posted on arXiv 7 Oct 2024.

Builds on

34 of 44 references.

References · 34

  1. 2019PyTorch: An Imperative Style, High-Performance Deep Learning Librarycited by 20,305
  2. 2022Instant Neural Graphics Primitives with a Multiresolution Hash Encodingcited by 3,723
  3. 2019DeepSDF: Learning Continuous Signed Distance Functions for Shape Representationcited by 2,689
  4. 2020Implicit Neural Representations with Periodic Activation Functionscited by 2,238
  5. 2020Fourier Features Let Networks Learn High Frequency Functions in Low Dimensional Domainscited by 2,200
  6. 2021Mip-NeRF: A Multiscale Representation for Anti-Aliasing Neural Radiance Fieldscited by 1,964
  7. 2020D-NeRF: Neural Radiance Fields for Dynamic Scenescited by 1,465
  8. 2018On the Spectral Bias of Neural Networkscited by 1,341
  9. 2020Nerfies: Deformable Neural Radiance Fieldscited by 1,198
  10. 2020Neural Sparse Voxel Fieldscited by 959
  11. 2021PlenOctrees for Real-time Rendering of Neural Radiance Fieldscited by 905
  12. 2020Learning Mesh-Based Simulation with Graph Networkscited by 868
22 more
  1. 2020NeRF++: Analyzing and Improving Neural Radiance Fieldscited by 861
  2. 2020pi-GAN: Periodic Implicit Generative Adversarial Networks for 3D-Aware Image Synthesiscited by 708
  3. 2021Neural Geometric Level of Detail: Real-time Rendering with Implicit 3D Shapescited by 426
  4. 2019SAL: Sign Agnostic Learning of Shapes from Raw Datacited by 390
  5. 2023WIRE: Wavelet Implicit Neural Representationscited by 220
  6. 2021BACON: Band-limited Coordinate Networks for Multiscale Scene Representationcited by 143
  7. 2021Beyond Periodicity: Towards a Unifying Framework for Activations in Coordinate-MLPscited by 135
  8. 2021A Structured Dictionary Perspective on Implicit Neural Representationscited by 100
  9. 2023FINER: Flexible spectral-bias tuning in Implicit NEural Representation by Variable-periodic Activation Functionscited by 78
  10. 2023Learning Spatial-Temporal Implicit Neural Representations for Event-Guided Video Super-Resolutioncited by 33
  11. 2023INCODE: Implicit Neural Conditioning with Prior Knowledge Embeddingscited by 31
  12. 2022DINER: Disorder-Invariant Implicit Neural Representationcited by 30
  13. 2022Residual Multiplicative Filter Networks for Multiscale Reconstructioncited by 25
  14. 2024A Sampling Theory Perspective on Activations for Implicit Neural Representationscited by 24
  15. 2022A Finite Element-Inspired Hypergraph Neural Network: Application to Fluid Dynamics Simulationscited by 14
  16. 2023FlowIBR: Leveraging Pre-Training for Efficient Neural Image-Based Rendering of Dynamic Scenescited by 14
  17. 2022NeuralGrasps: Learning Implicit Representations for Grasps of Multiple Robotic Handscited by 12
  18. 2023Learning Spatially Collaged Fourier Bases for Implicit Neural Representationcited by 11
  19. 2024BANF: Band-limited Neural Fields for Levels of Detail Reconstructioncited by 10
  20. 2024ASMR: Activation-sharing Multi-resolution Coordinate Networks For Efficient Inferencecited by 9
  21. 2023TRIDENT: The Nonlinear Trilogy for Implicit Neural Representationscited by 3
  22. 2024HOIN: High-Order Implicit Neural Representationscited by 3

Built on by

Cited by year (2026 to 14 Oct)

Citing papers per year: 2025: 4; 2026: 1.

5 papers.