H-SIREN: Improving implicit neural representations with hyperbolic periodic functions
Not on the map. Why?
Abstract (arXiv)
Implicit neural representations (INR) have been recently adopted in various applications ranging from computer vision tasks to physics simulations by solving partial differential equations. Among existing INR-based works, multi-layer perceptrons with sinusoidal activation functions find widespread applications and are also frequently treated as a baseline for the development of better activation functions for INR applications. Recent investigations claim that the use of sinusoidal activation functions could be sub-optimal due to their limited supported frequency set as well as their tendency to generate over-smoothed solutions. We provide a simple solution to mitigate such an issue by changing the activation function at the first layer from sin(x) to sin(sinh(2x)). We demonstrate H-SIREN in various computer vision and fluid flow problems, where it surpasses the performance of several state-of-the-art INRs.
Key facts. Cited by 5 papers in the map (data through 14 Oct 2026). Builds on 34 of its 44 references that are in the map. First posted on arXiv 7 Oct 2024.
Builds on
34 of 44 references.
References · 34
- 2019PyTorch: An Imperative Style, High-Performance Deep Learning Librarycited by 20,305
- 2022Instant Neural Graphics Primitives with a Multiresolution Hash Encodingcited by 3,723
- 2019DeepSDF: Learning Continuous Signed Distance Functions for Shape Representationcited by 2,689
- 2020Implicit Neural Representations with Periodic Activation Functionscited by 2,238
- 2020Fourier Features Let Networks Learn High Frequency Functions in Low Dimensional Domainscited by 2,200
- 2021Mip-NeRF: A Multiscale Representation for Anti-Aliasing Neural Radiance Fieldscited by 1,964
- 2020D-NeRF: Neural Radiance Fields for Dynamic Scenescited by 1,465
- 2018On the Spectral Bias of Neural Networkscited by 1,341
- 2020Nerfies: Deformable Neural Radiance Fieldscited by 1,198
- 2020Neural Sparse Voxel Fieldscited by 959
- 2021PlenOctrees for Real-time Rendering of Neural Radiance Fieldscited by 905
- 2020Learning Mesh-Based Simulation with Graph Networkscited by 868
22 more
- 2020NeRF++: Analyzing and Improving Neural Radiance Fieldscited by 861
- 2020pi-GAN: Periodic Implicit Generative Adversarial Networks for 3D-Aware Image Synthesiscited by 708
- 2021Neural Geometric Level of Detail: Real-time Rendering with Implicit 3D Shapescited by 426
- 2019SAL: Sign Agnostic Learning of Shapes from Raw Datacited by 390
- 2023WIRE: Wavelet Implicit Neural Representationscited by 220
- 2021BACON: Band-limited Coordinate Networks for Multiscale Scene Representationcited by 143
- 2021Beyond Periodicity: Towards a Unifying Framework for Activations in Coordinate-MLPscited by 135
- 2021A Structured Dictionary Perspective on Implicit Neural Representationscited by 100
- 2023FINER: Flexible spectral-bias tuning in Implicit NEural Representation by Variable-periodic Activation Functionscited by 78
- 2023Learning Spatial-Temporal Implicit Neural Representations for Event-Guided Video Super-Resolutioncited by 33
- 2023INCODE: Implicit Neural Conditioning with Prior Knowledge Embeddingscited by 31
- 2022DINER: Disorder-Invariant Implicit Neural Representationcited by 30
- 2022Residual Multiplicative Filter Networks for Multiscale Reconstructioncited by 25
- 2024A Sampling Theory Perspective on Activations for Implicit Neural Representationscited by 24
- 2022A Finite Element-Inspired Hypergraph Neural Network: Application to Fluid Dynamics Simulationscited by 14
- 2023FlowIBR: Leveraging Pre-Training for Efficient Neural Image-Based Rendering of Dynamic Scenescited by 14
- 2022NeuralGrasps: Learning Implicit Representations for Grasps of Multiple Robotic Handscited by 12
- 2023Learning Spatially Collaged Fourier Bases for Implicit Neural Representationcited by 11
- 2024BANF: Band-limited Neural Fields for Levels of Detail Reconstructioncited by 10
- 2024ASMR: Activation-sharing Multi-resolution Coordinate Networks For Efficient Inferencecited by 9
- 2023TRIDENT: The Nonlinear Trilogy for Implicit Neural Representationscited by 3
- 2024HOIN: High-Order Implicit Neural Representationscited by 3
Built on by
Citing papers per year: 2025: 4; 2026: 1.
5 papers.
- 2025ARC: Anchored Representation Clouds for High-Resolution INR Classificationcited by 3
- 2025Enhancing Transformers Through Conditioned Embedded Tokenscited by 3
- 2025I-INR: Iterative Implicit Neural Representationscited by 2
- 2025Squeeze3D: Extreme Neural Compression with Latent Space Bridgingcited by 0
- 2026The Inlet Rank Collapse in Implicit Neural Representations: Diagnosis and Unified Remedycited by 0
- 2026The Inlet Rank Collapse in Implicit Neural Representations: Diagnosis and Unified Remedy2 Feb 2026
- 2025Squeeze3D: Extreme Neural Compression with Latent Space Bridging9 Jun 2025
- 2025Enhancing Transformers Through Conditioned Embedded Tokens19 May 2025
- 2025I-INR: Iterative Implicit Neural Representations24 Apr 2025
- 2025ARC: Anchored Representation Clouds for High-Resolution INR Classification19 Mar 2025