Frequency Shift Physics-Informed Extreme Learning Machine for Solving High-Frequency Partial Differential Equations
Not on the map. Why?
Abstract (arXiv)
Solving partial differential equations (PDEs) with high-frequency solutions remains a central challenge in physics-informed machine learning due to spectral bias -- the tendency of neural networks to learn low-frequency components preferentially. This paper proposes a Frequency Shift Physics-Informed Extreme Learning Machine (FS-PIELM) framework that addresses this limitation through an additive mechanism for weight initialization. Rather than multiplying random weights by a scaling factor, the method translates the mean of the Gaussian weight distribution while keeping the variance fixed at unity, thereby avoiding the variance amplification inherent in scaling-based methods. Two variants are developed: FS-PIELM-L assigns independent frequency magnitudes to individual neurons, while FS-PIELM-G groups neurons for improved robustness. Theoretical analysis shows that the frequency variance under the proposed framework remains bounded and approaches unity regardless of target frequency, in contrast to the quadratic growth of conventional approaches. The method preserves the computational efficiency of extreme learning machines, requiring only a single linear solve. Experiments on seven benchmark problems spanning six equation types -- Helmholtz, wave, Poisson, Klein-Gordon, heat, and advection-diffusion -- on both regular and complex geometries show that the linear variant achieves the best accuracy in six of seven cases, with improvements of one to nearly five orders of magnitude over existing PIELM variants. The code and data accompanying this manuscript will be made publicly available at https://github.com/xgxgnpu/Physics-informed-vibe-coding/tree/main/FS-PIELM.
Key facts. No citing papers in the map yet (data through 7 Oct 2026). Builds on 27 of its 66 references that are in the map. First posted on arXiv 2 Jul 2026.
Builds on
27 of 66 references.
References · 27
- 2018Neural Tangent Kernel: Convergence and Generalization in Neural Networkscited by 2,597
- 2020Implicit Neural Representations with Periodic Activation Functionscited by 2,214
- 2020Fourier Features Let Networks Learn High Frequency Functions in Low Dimensional Domainscited by 2,170
- 2018On the Spectral Bias of Neural Networkscited by 1,321
- 2017DGM: A deep learning algorithm for solving partial differential equationscited by 674
- 2021Characterizing possible failure modes in physics-informed neural networkscited by 632
- 2020When and why PINNs fail to train: A neural tangent kernel perspectivecited by 629
- 2022Scientific Machine Learning through Physics-Informed Neural Networks: Where we are and What's nextcited by 603
- 2017The Deep Ritz method: A deep learning-based numerical algorithm for solving variational problemscited by 581
- 2017Solving high-dimensional partial differential equations using deep learningcited by 549
- 2021Physics-informed neural networks (PINNs) for fluid mechanics: A reviewcited by 470
- 2019Frequency Principle: Fourier Analysis Sheds Light on Deep Neural Networkscited by 360
15 more
- 2020On the eigenvector bias of Fourier feature networks: From regression to solving multi-scale PDEs with physics-informed neural networkscited by 279
- 2020Self-Adaptive Physics-Informed Neural Networks using a Soft Attention Mechanismcited by 231
- 2019Towards Understanding the Spectral Bias of Deep Learningcited by 173
- 2017A unified deep artificial neural network approach to partial differential equations in complex geometriescited by 122
- 2020The Random Feature Model for Input-Output Maps between Banach Spacescited by 90
- 2020Multi-scale Deep Neural Network (MscaleDNN) for Solving Poisson-Boltzmann Equation in Complex Domainscited by 78
- 2020Local Extreme Learning Machines and Domain Decomposition for Solving Linear and Nonlinear Partial Differential Equationscited by 78
- 2022Overview frequency principle/spectral bias in deep learningcited by 68
- 2019Physics Informed Extreme Learning Machine (PIELM) -- A rapid method for the numerical solution of partial differential equationscited by 66
- 2019Distributed physics informed neural network for data-efficient solution to partial differential equationscited by 26
- 2022Numerical Computation of Partial Differential Equations by Hidden-Layer Concatenated Extreme Learning Machinecited by 9
- 2024Solving Partial Differential Equations with Random Feature Modelscited by 6
- 2025Separated-Variable Spectral Neural Networks: A Physics-Informed Learning Approach for High-Frequency PDEscited by 3
- 2025General Fourier Feature Physics-Informed Extreme Learning Machine (GFF-PIELM) for High-Frequency PDEscited by 2
- 2025Physics-Informed Extreme Learning Machine (PIELM): Opportunities and Challengescited by 1
Built on by
Not cited yet.