AdamFLIP: Adaptive Momentum Feedback Linearization Optimization for Hard Constrained PINN Training
Not on the map. Why?
Abstract (arXiv)
Physics-informed neural networks (PINNs) provide a flexible framework for solving forward and inverse problems governed by partial differential equations (PDEs), but standard PINN training typically relies on soft penalty formulations that combine PDE residuals, data mismatch, and initial/boundary conditions using manually chosen weights. This often leads to ill-conditioning, sensitivity to loss weights, and poor constraint satisfaction. In this work, we reformulate PINN training as an equality-constrained optimization problem and propose a novel Adaptive Momentum Feedback Linearization Optimization for Hard Constrained PINN (AdamFLIP). The key idea is to view the constraint residuals as the output of a controlled dynamical system and to compute the Lagrange multiplier as a feedback input that locally drives these residuals toward stable linear contraction dynamics. AdamFLIP then applies Adam-style first- and second-moment adaptation to the resulting feedback-linearized Lagrangian gradient, combining principled constraint handling with the scalability and robustness of adaptive neural-network optimization. We test AdamFLIP on a range of benchmark forward and inverse PDE problem, and it consistently outperforms both the standard soft-constrained PINN and state-of-the-art constrained optimizers. Specifically, on the Navier--Stokes equations benchmark, AdamFLIP reduces relative L2 error by more than two thirds for the predicted solution compared to the next best method. Our AdamFLIP framework provides an effective and computationally scalable hard constraint optimization method for PINN training.
Key facts. Cited by 1 paper in the map (data through 7 Oct 2026). Builds on 27 of its 42 references that are in the map. First posted on arXiv 8 May 2026.
Builds on
27 of 42 references.
References · 27
- 2019On the Convergence of Adam and Beyondcited by 834
- 2021Characterizing possible failure modes in physics-informed neural networkscited by 632
- 2022Scientific Machine Learning through Physics-Informed Neural Networks: Where we are and What's nextcited by 603
- 2021Physics-informed neural networks (PINNs) for fluid mechanics: A reviewcited by 470
- 2020Responsive Safety in Reinforcement Learning by PID Lagrangian Methodscited by 302
- 2021Physics-informed neural networks with hard constraints for inverse designcited by 277
- 2021End-to-End Constrained Optimization Learning: A Surveycited by 154
- 2023An Expert's Guide to Training Physics-informed Neural Networkscited by 119
- 2024Challenges in Training PINNs: A Loss Landscape Perspectivecited by 109
- 2022Lie Point Symmetry Data Augmentation for Neural PDE Solverscited by 76
- 2022Error estimates for physics informed neural networks approximating the Navier-Stokes equationscited by 63
- 2025Physics-Constrained Flow Matching: Sampling Generative Models with Hard Constraintscited by 46
15 more
- 2021Inverse-Dirichlet Weighting Enables Reliable Training of Physics Informed Neural Networkscited by 43
- 2021Neural Networks with Physics-Informed Architectures and Constraints for Dynamical Systems Modelingcited by 40
- 2022Enhanced Physics-Informed Neural Networks with Augmented Lagrangian Relaxation Method (AL-PINNs)cited by 35
- 2020Sequential Quadratic Optimization for Nonlinear Equality Constrained Stochastic Optimizationcited by 30
- 2024Physics-Informed Neural Networks with Hard Linear Equality Constraintscited by 30
- 2023Self-Supervised Learning with Lie Symmetries for Partial Differential Equationscited by 29
- 2024HardNet: Hard-Constrained Neural Networks with Universal Approximation Guaranteescited by 29
- 2023Lie Point Symmetry and Physics Informed Networkscited by 24
- 2025Pinet: Optimizing hard-constrained neural networks with orthogonal projection layerscited by 17
- 2024Understanding the Difficulty of Solving Cauchy Problems with PINNscited by 5
- 2025Hard-constraining Neumann boundary conditions in physics-informed neural networks via Fourier feature embeddingscited by 5
- 2024Physics-Informed Neural Networks with Trust-Region Sequential Quadratic Programmingcited by 4
- 2024A new framework for constrained optimization via feedback control of Lagrange multiplierscited by 3
- 2025Constrained Optimization From a Control Perspective via Feedback Linearizationcited by 3
- 2025Zeroth-Order Constrained Optimization from a Control Perspective via Feedback Linearizationcited by 1
Built on by
Citing papers per year: 2026: 1.
1 paper.