Physics-Informed Neural Networks with Hard Nonlinear Equality and Inequality Constraints
Not on the map. Why?
Abstract (arXiv)
Traditional physics-informed neural networks (PINNs) do not guarantee strict constraint satisfaction. This is problematic in engineering systems where minor violations of governing laws can degrade the reliability and consistency of model predictions. In this work, we introduce KKT-Hardnet, a neural network architecture that enforces linear and nonlinear equality and inequality constraints up to machine precision. It leverages a differentiable projection onto the feasible region by solving Karush-Kuhn-Tucker (KKT) conditions of a distance minimization problem. Furthermore, we reformulate the nonlinear KKT conditions via a log-exponential transformation to construct a sparse system with linear and exponential terms. We apply KKT-Hardnet to nonconvex pooling problem and a real-world chemical process simulation. Compared to multilayer perceptrons and PINNs, KKT-Hardnet achieves strict constraint satisfaction. It also circumvents the need to balance data and physics residuals in PINN training. This enables the integration of domain knowledge into machine learning towards reliable hybrid modeling of complex systems.
Key facts. Cited by 14 papers in the map (data through 14 Oct 2026). Builds on 18 of its 46 references that are in the map. First posted on arXiv 10 Jul 2025.
Builds on
18 of 46 references.
References · 18
- 2017Attention Is All You Needcited by 60,361
- 2014Adam: A Method for Stochastic Optimizationcited by 37,240
- 2019PyTorch: An Imperative Style, High-Performance Deep Learning Librarycited by 20,305
- 2021Characterizing possible failure modes in physics-informed neural networkscited by 643
- 2020When and why PINNs fail to train: A neural tangent kernel perspectivecited by 634
- 2017OptNet: Differentiable Optimization as a Layer in Neural Networkscited by 599
- 2021Physics-informed neural networks (PINNs) for fluid mechanics: A reviewcited by 473
- 2019Differentiable Convex Optimization Layerscited by 465
- 2021DC3: A learning method for optimization with hard constraintscited by 184
- 2024Challenges in Training PINNs: A Loss Landscape Perspectivecited by 113
- 2021Physics-informed neural networks for solving Reynolds-averaged Navierunicodex2013Stokes equationscited by 68
- 2017Imposing Hard Constraints on Deep Networks: Promises and Limitationscited by 43
6 more
- 2024Physics-Informed Neural Networks with Hard Linear Equality Constraintscited by 30
- 2020Theory-guided hard constraint projection (HCP): a knowledge-based data-driven scientific machine learning methodcited by 29
- 2016Real-time optimal control via Deep Neural Networks: study on landing problemscited by 28
- 2022Is L2 Physics-Informed Loss Always Suitable for Training Physics-Informed Neural Network?cited by 23
- 2017The ALAMO approach to machine learningcited by 18
- 2025ENFORCE: Nonlinear Constrained Learning with Adaptive-depth Neural Projectioncited by 17
Built on by
Citing papers per year: 2025: 4; 2026: 10.
14 papers.
Sort:
- 2025Molecular Machine Learning in Chemical Process Designcited by 5
- 2025Physics-Constrained Machine Learning for Chemical Engineeringcited by 5
- 2025DAE-HardNet: A Physics Constrained Neural Network Enforcing Differential-Algebraic Hard Constraintscited by 3
- 2026SnareNet: Flexible Repair Layers for Neural Networks with Hard Constraintscited by 2
- 2026DiffSlack: Learning under Nonlinear Inequality Constraints via Learnable Slack Variablescited by 1
- 2025Self-Certifying Primal-Dual Optimization Proxies for Large-Scale Batch Economic Dispatchcited by 0
- 2026NLPOpt-Net: A Learning Method for Nonlinear Optimization with Feasibility Guaranteescited by 0
- 2026Enabling Structure-Only Initialization and Out-of-Distribution Generalization in GNN-based Molecular Dynamics Simulatorscited by 0
- 2026DisjunctiveNet: Neural Symbolic Learning via Differentiable Convexified Optimization Layerscited by 0
- 2026PL-KKT-hPINN: Enforcing Nonlinear Equality Constraints on Neural Networks via Piecewise-Linear Projectioncited by 0
- 2026Neural Slack Variables for Shape Constraintscited by 0
- 2026Embedding Linear Equality Constraints in Probabilistic Neural Networks for Dynamic Modellingcited by 0
- 2026SLP-ProbHard: Probabilistic Hard-Constrained Learning via Structural Latent Parameterization27 Sep 2026
- 2026ShardNet: Training Neural Controllers with Hard, Non-Convex Constraints29 Jun 2026
- 2026Embedding Linear Equality Constraints in Probabilistic Neural Networks for Dynamic Modelling19 Jun 2026
- 2026Neural Slack Variables for Shape Constraints11 Jun 2026
- 2026PL-KKT-hPINN: Enforcing Nonlinear Equality Constraints on Neural Networks via Piecewise-Linear Projection9 Jun 2026
- 2026DiffSlack: Learning under Nonlinear Inequality Constraints via Learnable Slack Variables3 Jun 2026
- 2026DisjunctiveNet: Neural Symbolic Learning via Differentiable Convexified Optimization Layers28 May 2026
- 2026Enabling Structure-Only Initialization and Out-of-Distribution Generalization in GNN-based Molecular Dynamics Simulators10 May 2026
- 2026NLPOpt-Net: A Learning Method for Nonlinear Optimization with Feasibility Guarantees30 Apr 2026
- 2026SnareNet: Flexible Repair Layers for Neural Networks with Hard Constraints10 Feb 2026
- 2025DAE-HardNet: A Physics Constrained Neural Network Enforcing Differential-Algebraic Hard Constraints5 Dec 2025
- 2025Self-Certifying Primal-Dual Optimization Proxies for Large-Scale Batch Economic Dispatch17 Oct 2025
2 more
- 2025Physics-Constrained Machine Learning for Chemical Engineering28 Aug 2025
- 2025Molecular Machine Learning in Chemical Process Design28 Aug 2025
- 2025Molecular Machine Learning in Chemical Process Designcited by 5
- 2025Physics-Constrained Machine Learning for Chemical Engineeringcited by 5
- 2025DAE-HardNet: A Physics Constrained Neural Network Enforcing Differential-Algebraic Hard Constraintscited by 3
- 2026SnareNet: Flexible Repair Layers for Neural Networks with Hard Constraintscited by 2
- 2026DiffSlack: Learning under Nonlinear Inequality Constraints via Learnable Slack Variablescited by 1
- 2025Self-Certifying Primal-Dual Optimization Proxies for Large-Scale Batch Economic Dispatchcited by 0
- 2026NLPOpt-Net: A Learning Method for Nonlinear Optimization with Feasibility Guaranteescited by 0
- 2026Enabling Structure-Only Initialization and Out-of-Distribution Generalization in GNN-based Molecular Dynamics Simulatorscited by 0
- 2026DisjunctiveNet: Neural Symbolic Learning via Differentiable Convexified Optimization Layerscited by 0
- 2026PL-KKT-hPINN: Enforcing Nonlinear Equality Constraints on Neural Networks via Piecewise-Linear Projectioncited by 0
- 2026Neural Slack Variables for Shape Constraintscited by 0
- 2026Embedding Linear Equality Constraints in Probabilistic Neural Networks for Dynamic Modellingcited by 0
12 most cited of 14 All 14 (JSON)
- 2026SLP-ProbHard: Probabilistic Hard-Constrained Learning via Structural Latent Parameterization27 Sep 2026
- 2026ShardNet: Training Neural Controllers with Hard, Non-Convex Constraints29 Jun 2026
- 2026Embedding Linear Equality Constraints in Probabilistic Neural Networks for Dynamic Modelling19 Jun 2026
- 2026Neural Slack Variables for Shape Constraints11 Jun 2026
- 2026PL-KKT-hPINN: Enforcing Nonlinear Equality Constraints on Neural Networks via Piecewise-Linear Projection9 Jun 2026
- 2026DiffSlack: Learning under Nonlinear Inequality Constraints via Learnable Slack Variables3 Jun 2026
- 2026DisjunctiveNet: Neural Symbolic Learning via Differentiable Convexified Optimization Layers28 May 2026
- 2026Enabling Structure-Only Initialization and Out-of-Distribution Generalization in GNN-based Molecular Dynamics Simulators10 May 2026
- 2026NLPOpt-Net: A Learning Method for Nonlinear Optimization with Feasibility Guarantees30 Apr 2026
- 2026SnareNet: Flexible Repair Layers for Neural Networks with Hard Constraints10 Feb 2026
- 2025DAE-HardNet: A Physics Constrained Neural Network Enforcing Differential-Algebraic Hard Constraints5 Dec 2025
- 2025Self-Certifying Primal-Dual Optimization Proxies for Large-Scale Batch Economic Dispatch17 Oct 2025
12 newest of 14 All 14 (JSON)