mlsanityData to 14 Oct 2026

HEATNETs: Explainable Random Feature Neural Networks for High-Dimensional Parabolic PDEs

arXiv 2511.00886 ↗First posted 2 Nov 2025math.NA cs.LG cs.NAcited by 1

Not on the map. Why?

Abstract (arXiv)

We deal with the solution of the forward problem for high-dimensional parabolic PDEs with random feature (projection) neural networks (RFNNs). We first prove that there exists a single-hidden layer neural network with randomized heat-kernels arising from the fundamental solution (Green's functions) of the heat operator, that we call HEATNET, that provides an unbiased universal approximator to the solution of parabolic PDEs in arbitrary (high) dimensions, with the rate of convergence being analogous to the O(N-1/2), where N is the size of HEATNET. Thus, HEATNETs are explainable schemes, based on the analytical framework of parabolic PDEs, exploiting insights from physics-informed neural networks aided by numerical and functional analysis, and the structure of the corresponding solution operators. Importantly, we show how HEATNETs can be scaled up for the efficient numerical solution of arbitrary high-dimensional parabolic PDEs using suitable transformations and importance Monte Carlo sampling of the integral representation of the solution, in order to deal with the singularities of the heat kernel around the collocation points. We evaluate the performance of HEATNETs through benchmark linear parabolic problems up to 2,000 dimensions. We show that HEATNETs result in remarkable accuracy with the order of the approximation error ranging from 1.0E-05 to 1.0E-07 for problems up to 500 dimensions, and of the order of 1.0E-04 to 1.0E-03 for 1,000 to 2,000 dimensions, with a relatively low number (up to 15,000) of features.

Key facts. Cited by 1 paper in the map (data through 14 Oct 2026). Builds on 30 of its 49 references that are in the map. First posted on arXiv 2 Nov 2025.

Builds on

30 of 49 references.

References · 30

  1. 2020Fourier Neural Operator for Parametric Partial Differential Equationscited by 2,908
  2. 2019DeepONet: Learning nonlinear operators for identifying differential equations based on the universal approximation theorem of operatorscited by 2,018
  3. 2017DGM: A deep learning algorithm for solving partial differential equationscited by 678
  4. 2019DeepXDE: A deep learning library for solving differential equationscited by 619
  5. 2017Solving high-dimensional partial differential equations using deep learningcited by 556
  6. 2021Learning the solution operator of parametric partial differential equations with physics-informed DeepOnetscited by 540
  7. 2021Solving and Learning Nonlinear PDEs with Gaussian Processescited by 129
  8. 2020Local Extreme Learning Machines and Domain Decomposition for Solving Linear and Nonlinear Partial Differential Equationscited by 81
  9. 2023Tackling the Curse of Dimensionality with Physics-Informed Neural Networkscited by 79
  10. 2017Numerical Gaussian Processes for Time-dependent and Non-linear Partial Differential Equationscited by 72
  11. 2023Can Physics-Informed Neural Networks beat the Finite Element Method?cited by 68
  12. 2019Physics Informed Extreme Learning Machine (PIELM) -- A rapid method for the numerical solution of partial differential equationscited by 67
18 more
  1. 2023Separable Physics-Informed Neural Networkscited by 66
  2. 2019Learning in Modal Space: Solving Time-Dependent Stochastic PDEs Using Physics-Informed Neural Networkscited by 64
  3. 2021Error analysis for physics informed neural networks (PINNs) approximating Kolmogorov PDEscited by 57
  4. 2016Inferring solutions of differential equations using noisy multi-fidelity datacited by 38
  5. 2018Machine Learning for semi linear PDEscited by 28
  6. 2022Constructing coarse-scale bifurcation diagrams from spatio-temporal observations of microscopic simulations: A parsimonious machine learning approachcited by 25
  7. 2023An Extreme Learning Machine-Based Method for Computational PDEs in Higher Dimensionscited by 21
  8. 2023Sampling weights of deep neural networkscited by 20
  9. 2022Parsimonious Physics-Informed Random Projection Neural Networks for Initial-Value Problems of ODEs and index-1 DAEscited by 19
  10. 2024RandONet: Shallow-Networks with Random Projections for learning linear and nonlinear operatorscited by 16
  11. 2021A Modified Batch Intrinsic Plasticity Method for Pre-training the Random Coefficients of Extreme Learning Machinescited by 14
  12. 2023Learning Only On Boundaries: a Physics-Informed Neural operator for Solving Parametric Partial Differential Equations in Complex Geometriescited by 13
  13. 2024Random Projection Neural Networks of Best Approximation: Convergence theory and practical applicationscited by 11
  14. 2025Anant-Net: Breaking the Curse of Dimensionality with Scalable and Interpretable Neural Surrogate for High-Dimensional PDEscited by 11
  15. 2023Slow Invariant Manifolds of Singularly Perturbed Systems via Physics-Informed Machine Learningcited by 10
  16. 2025Enabling Local Neural Operators to perform Equation-Free System-Level Analysiscited by 10
  17. 2024Fast meta-solvers for 3D complex-shape scatterers using neural operators trained on a non-scattering problemcited by 8
  18. 2023Neural Control of Parametric Solutions for High-dimensional Evolution PDEscited by 5

Built on by

Cited by year (2026 to 14 Oct)

Citing papers per year: 2026: 1.

1 paper.

  1. 2026Stability and Bifurcation Analysis of Nonlinear PDEs via Random Projection-based PINNs: A Krylov-Arnoldi Approachcited by 0