mlsanityData to 14 Oct 2026

Learning a Neural Solver for Parametric PDE to Enhance Physics-Informed Methods

arXiv 2410.06820 ↗First posted 9 Oct 2024cs.LGcited by 10

Not on the map. Why?

Abstract (arXiv)

Physics-informed deep learning often faces optimization challenges due to the complexity of solving partial differential equations (PDEs), which involve exploring large solution spaces, require numerous iterations, and can lead to unstable training. These challenges arise particularly from the ill-conditioning of the optimization problem caused by the differential terms in the loss function. To address these issues, we propose learning a solver, i.e., solving PDEs using a physics-informed iterative algorithm trained on data. Our method learns to condition a gradient descent algorithm that automatically adapts to each PDE instance, significantly accelerating and stabilizing the optimization process and enabling faster convergence of physics-aware models. Furthermore, while traditional physics-informed methods solve for a single PDE instance, our approach extends to parametric PDEs. Specifically, we integrate the physical loss gradient with PDE parameters, allowing our method to solve over a distribution of PDE parameters, including coefficients, initial conditions, and boundary conditions. We demonstrate the effectiveness of our approach through empirical experiments on multiple datasets, comparing both training and test-time optimization performance. The code is available at https://github.com/2ailesB/neural-parametric-solver.

Key facts. Cited by 10 papers in the map (data through 14 Oct 2026). Builds on 24 of its 42 references that are in the map. First posted on arXiv 9 Oct 2024.

Builds on

24 of 42 references.

References · 24

  1. 2016Gaussian Error Linear Units (GELUs)cited by 3,502
  2. 2020Fourier Neural Operator for Parametric Partial Differential Equationscited by 2,908
  3. 2020Fourier Features Let Networks Learn High Frequency Functions in Low Dimensional Domainscited by 2,200
  4. 2019DeepONet: Learning nonlinear operators for identifying differential equations based on the universal approximation theorem of operatorscited by 2,018
  5. 2017DGM: A deep learning algorithm for solving partial differential equationscited by 678
  6. 2021Characterizing possible failure modes in physics-informed neural networkscited by 643
  7. 2020When and why PINNs fail to train: A neural tangent kernel perspectivecited by 634
  8. 2016Learning to learn by gradient descent by gradient descentcited by 620
  9. 2017The Deep Ritz method: A deep learning-based numerical algorithm for solving variational problemscited by 583
  10. 2021Learning the solution operator of parametric partial differential equations with physics-informed DeepOnetscited by 540
  11. 2021Physics-Informed Neural Operator for Learning Partial Differential Equationscited by 527
  12. 2023Convolutional Neural Operators for robust and accurate learning of PDEscited by 214
12 more
  1. 2021Learning to Optimize: A Primer and A Benchmarkcited by 208
  2. 2020Solver-in-the-Loop: Learning from Differentiable Physics to Interact with Iterative PDE-Solverscited by 205
  3. 2016Learning to Optimizecited by 195
  4. 2024Challenges in Training PINNs: A Loss Landscape Perspectivecited by 113
  5. 2020Augmenting Physical Models with Deep Networks for Complex Dynamics Forecastingcited by 95
  6. 2019Learning Neural PDE Solvers with Convergence Guaranteescited by 77
  7. 2021HyperPINN: Learning parameterized differential equations with physics-informed hypernetworkscited by 39
  8. 2021Meta-Auto-Decoder for Solving Parametric Partial Differential Equationscited by 36
  9. 2023Enhancing training of physics-informed neural networks using domain-decomposition based preconditioning strategiescited by 20
  10. 2023Improving physics-informed neural networks with meta-learned optimizationcited by 19
  11. 2024Masked Autoencoders are PDE Learnerscited by 14
  12. 2022Physics-informed neural networks for solving parametric magnetostatic problemscited by 10

Built on by

Cited by year (2026 to 14 Oct)

Citing papers per year: 2025: 5; 2026: 5.

10 papers.