Learning a Neural Solver for Parametric PDE to Enhance Physics-Informed Methods
Not on the map. Why?
Abstract (arXiv)
Physics-informed deep learning often faces optimization challenges due to the complexity of solving partial differential equations (PDEs), which involve exploring large solution spaces, require numerous iterations, and can lead to unstable training. These challenges arise particularly from the ill-conditioning of the optimization problem caused by the differential terms in the loss function. To address these issues, we propose learning a solver, i.e., solving PDEs using a physics-informed iterative algorithm trained on data. Our method learns to condition a gradient descent algorithm that automatically adapts to each PDE instance, significantly accelerating and stabilizing the optimization process and enabling faster convergence of physics-aware models. Furthermore, while traditional physics-informed methods solve for a single PDE instance, our approach extends to parametric PDEs. Specifically, we integrate the physical loss gradient with PDE parameters, allowing our method to solve over a distribution of PDE parameters, including coefficients, initial conditions, and boundary conditions. We demonstrate the effectiveness of our approach through empirical experiments on multiple datasets, comparing both training and test-time optimization performance. The code is available at https://github.com/2ailesB/neural-parametric-solver.
Key facts. Cited by 10 papers in the map (data through 14 Oct 2026). Builds on 24 of its 42 references that are in the map. First posted on arXiv 9 Oct 2024.
Builds on
24 of 42 references.
References · 24
- 2016Gaussian Error Linear Units (GELUs)cited by 3,502
- 2020Fourier Neural Operator for Parametric Partial Differential Equationscited by 2,908
- 2020Fourier Features Let Networks Learn High Frequency Functions in Low Dimensional Domainscited by 2,200
- 2019DeepONet: Learning nonlinear operators for identifying differential equations based on the universal approximation theorem of operatorscited by 2,018
- 2017DGM: A deep learning algorithm for solving partial differential equationscited by 678
- 2021Characterizing possible failure modes in physics-informed neural networkscited by 643
- 2020When and why PINNs fail to train: A neural tangent kernel perspectivecited by 634
- 2016Learning to learn by gradient descent by gradient descentcited by 620
- 2017The Deep Ritz method: A deep learning-based numerical algorithm for solving variational problemscited by 583
- 2021Learning the solution operator of parametric partial differential equations with physics-informed DeepOnetscited by 540
- 2021Physics-Informed Neural Operator for Learning Partial Differential Equationscited by 527
- 2023Convolutional Neural Operators for robust and accurate learning of PDEscited by 214
12 more
- 2021Learning to Optimize: A Primer and A Benchmarkcited by 208
- 2020Solver-in-the-Loop: Learning from Differentiable Physics to Interact with Iterative PDE-Solverscited by 205
- 2016Learning to Optimizecited by 195
- 2024Challenges in Training PINNs: A Loss Landscape Perspectivecited by 113
- 2020Augmenting Physical Models with Deep Networks for Complex Dynamics Forecastingcited by 95
- 2019Learning Neural PDE Solvers with Convergence Guaranteescited by 77
- 2021HyperPINN: Learning parameterized differential equations with physics-informed hypernetworkscited by 39
- 2021Meta-Auto-Decoder for Solving Parametric Partial Differential Equationscited by 36
- 2023Enhancing training of physics-informed neural networks using domain-decomposition based preconditioning strategiescited by 20
- 2023Improving physics-informed neural networks with meta-learned optimizationcited by 19
- 2024Masked Autoencoders are PDE Learnerscited by 14
- 2022Physics-informed neural networks for solving parametric magnetostatic problemscited by 10
Built on by
Citing papers per year: 2025: 5; 2026: 5.
10 papers.
- 2025HyPINO: Multi-Physics Neural Operators via HyperPINNs and the Method of Manufactured Solutionscited by 8
- 2026Learning PDE Solvers with Physics and Data: A Unifying View of Physics-Informed Neural Networks and Neural Operatorscited by 6
- 2025A Physics-Informed Meta-Learning Framework for the Continuous Solution of Parametric PDEs on Arbitrary Geometriescited by 5
- 2025Linear Attention with Global Context: A Multipole Attention Mechanism for Vision and Physicscited by 5
- 2025Equilibrium Conserving Neural Operators for Super-Resolution Learningcited by 2
- 2025Physics-Informed Deep B-Spline Networkscited by 1
- 2026Generalized Neural Operator for Parametric and Boundary-Value Problemscited by 1
- 2026Mitigating Gradient Pathology in PINNs through Aligned Constraintcited by 0
- 2026Higher-Order Geometric Updates for Levenberg-Marquardt Method via Riemann Normal Coordinatescited by 0
- 2026Hypernetwork-Parameterized Spatially Adaptive Neural Operators for PDE Learningcited by 0
- 2026Hypernetwork-Parameterized Spatially Adaptive Neural Operators for PDE Learning31 Jul 2026
- 2026Generalized Neural Operator for Parametric and Boundary-Value Problems24 Jul 2026
- 2026Higher-Order Geometric Updates for Levenberg-Marquardt Method via Riemann Normal Coordinates8 Jul 2026
- 2026Mitigating Gradient Pathology in PINNs through Aligned Constraint24 May 2026
- 2026Learning PDE Solvers with Physics and Data: A Unifying View of Physics-Informed Neural Networks and Neural Operators20 Jan 2026
- 2025HyPINO: Multi-Physics Neural Operators via HyperPINNs and the Method of Manufactured Solutions5 Sep 2025
- 2025Linear Attention with Global Context: A Multipole Attention Mechanism for Vision and Physics3 Jul 2025
- 2025Equilibrium Conserving Neural Operators for Super-Resolution Learning18 Apr 2025
- 2025A Physics-Informed Meta-Learning Framework for the Continuous Solution of Parametric PDEs on Arbitrary Geometries3 Apr 2025
- 2025Physics-Informed Deep B-Spline Networks21 Mar 2025