mlsanityData to 14 Oct 2026

A Control Perspective on Training PINNs

arXiv 2501.18582 ↗First posted 30 Jan 2025cs.LGcited by 3

Not on the map. Why?

Abstract (arXiv)

We investigate the training of Physics-Informed Neural Networks (PINNs) from a control-theoretic perspective. Using gradient descent with resampling, we interpret the training dynamics as asymptotically equivalent to a stochastic control-affine system, where sampling effects act as process disturbances and measurement noise. Within this framework, we introduce two controllers for dynamically adapting the physics weight: an integral controller and a leaky integral controller. We theoretically analyze their asymptotic properties under the accuracy-robustness trade-off, and we evaluate them on a toy example. Numerical evidence suggests that the integral controller achieves accurate and robust convergence when the physical model is correct, whereas the leaky integrator provides improved performance in the presence of model mismatch. This work represents a first step toward convergence guarantees and principled training algorithms tailored to the distinct characteristics of PINN tasks.

Key facts. Cited by 3 papers in the map (data through 14 Oct 2026). Builds on 17 of its 36 references that are in the map. First posted on arXiv 30 Jan 2025.

Builds on

17 of 36 references.

References · 17

  1. 2014Adam: A Method for Stochastic Optimizationcited by 37,240
  2. 2015Automatic differentiation in machine learning: a surveycited by 855
  3. 2017DGM: A deep learning algorithm for solving partial differential equationscited by 678
  4. 2020When and why PINNs fail to train: A neural tangent kernel perspectivecited by 634
  5. 2020Understanding and mitigating gradient pathologies in physics-informed neural networkscited by 135
  6. 2024Challenges in Training PINNs: A Loss Landscape Perspectivecited by 113
  7. 2021Parallel Physics-Informed Neural Networks via Domain Decompositioncited by 112
  8. 2018The Limit Points of (Optimistic) Gradient Descent in Min-Max Optimizationcited by 101
  9. 2020Lagrangian Duality for Constrained Deep Learningcited by 74
  10. 2021Meta-learning PINN loss functionscited by 51
  11. 2024ConFIG: Towards Conflict-free Training of Physics Informed Neural Networkscited by 46
  12. 2021Inverse-Dirichlet Weighting Enables Reliable Training of Physics Informed Neural Networkscited by 43
5 more
  1. 2021Continuous vs. Discrete Optimization of Deep Neural Networkscited by 34
  2. 2018On the Exponential Stability of Primal-Dual Gradient Dynamicscited by 12
  3. 2024A new framework for constrained optimization via feedback control of Lagrange multiplierscited by 3
  4. 2017Robust Decentralized Secondary Frequency Control in Power Systems: Merits and Trade-Offscited by 2
  5. 2025MILP initialization for solving parabolic PDEs with PINNscited by 1

Built on by

Cited by year (2026 to 14 Oct)

Citing papers per year: 2025: 2; 2026: 1.

3 papers.