mlsanityData to 7 Oct 2026

Physics-informed neural networks with hard constraints for inverse design

arXiv 2102.04626 ↗First posted 9 Feb 2021physics.comp-ph cs.LGcited by 277

Not on the map. Why?

Abstract (arXiv)

Inverse design arises in a variety of areas in engineering such as acoustic, mechanics, thermal/electronic transport, electromagnetism, and optics. Topology optimization is a major form of inverse design, where we optimize a designed geometry to achieve targeted properties and the geometry is parameterized by a density function. This optimization is challenging, because it has a very high dimensionality and is usually constrained by partial differential equations (PDEs) and additional inequalities. Here, we propose a new deep learning method -- physics-informed neural networks with hard constraints (hPINNs) -- for solving topology optimization. hPINN leverages the recent development of PINNs for solving PDEs, and thus does not rely on any numerical PDE solver. However, all the constraints in PINNs are soft constraints, and hence we impose hard constraints by using the penalty method and the augmented Lagrangian method. We demonstrate the effectiveness of hPINN for a holography problem in optics and a fluid problem of Stokes flow. We achieve the same objective as conventional PDE-constrained optimization methods based on adjoint methods and numerical PDE solvers, but find that the design obtained from hPINN is often simpler and smoother for problems whose solution is not unique. Moreover, the implementation of inverse design with hPINN can be easier than that of conventional methods.

Key facts. Cited by 277 papers in the map (data through 7 Oct 2026). Builds on 15 of its 65 references that are in the map. First posted on arXiv 9 Feb 2021.

Builds on

15 of 65 references.

References · 15

  1. 2019DeepXDE: A deep learning library for solving differential equationscited by 617
  2. 2019AutoML: A Survey of the State-of-the-Artcited by 388
  3. 2018Quantifying total uncertainty in physics-informed neural networks for solving forward and inverse stochastic problemscited by 144
  4. 2020A Method for Representing Periodic Functions and Enforcing Exactly Periodic Boundary Conditions with Deep Neural Networkscited by 86
  5. 2019Machine learning in cardiovascular flows modeling: Predicting arterial blood pressure from non-invasive 4D flow MRI data using physics-informed neural networkscited by 76
  6. 2019Learning in Modal Space: Solving Time-Dependent Stochastic PDEs Using Physics-Informed Neural Networkscited by 63
  7. 2019Generalization in Deep Networks: The Role of Distance from Initializationcited by 49
  8. 2020Deep neural networks for the evaluation and design of photonic devicescited by 49
  9. 2020PFNN: A Penalty-Free Neural Network Method for Solving a Class of Second-Order Boundary-Value Problems on Complex Geometriescited by 38
  10. 2017Theory of Deep Learning III: explaining the non-overfitting puzzlecited by 32
  11. 2020Active learning of deep surrogates for PDEs: Application to metasurface designcited by 28
  12. 2018A Generative Model for Inverse Design of Metamaterialscited by 27
3 more
  1. 2019Quantifying the generalization error in deep learning in terms of data distribution and neural network smoothnesscited by 22
  2. 2020Training neural networks under physical constraints using a stochastic augmented Lagrangian approachcited by 19
  3. 2015Computational comparison of surface metrics for PDE constrained shape optimizationcited by 1

Built on by

Cited by year (2026 to 7 Oct)

Citing papers per year: 2021: 20; 2022: 46; 2023: 45; 2024: 71; 2025: 55; 2026: 40.

277 papers.

Sort:

By area:

  1. 2021Characterizing possible failure modes in physics-informed neural networkscited by 632
  2. 2022Scientific Machine Learning through Physics-Informed Neural Networks: Where we are and What's nextcited by 603
  3. 2021Physics-informed neural networks (PINNs) for fluid mechanics: A reviewcited by 470
  4. 2022A comprehensive study of non-adaptive and residual-based adaptive sampling for physics-informed neural networkscited by 233
  5. 2021Gradient-enhanced physics-informed neural networks for forward and inverse PDE problemscited by 220
  6. 2022MIONet: Learning multiple-input operators via tensor productcited by 180
  7. 2022Respecting causality is all you need for training physics-informed neural networkscited by 154
  8. 2023An Expert's Guide to Training Physics-informed Neural Networkscited by 119
  9. 2024Challenges in Training PINNs: A Loss Landscape Perspectivecited by 109
  10. 2022Multifidelity deep neural operators for efficient learning of partial differential equations with application to fast inverse design of nanoscale heat transportcited by 92
  11. 2022Physics-Informed Machine Learning: A Survey on Problems, Methods and Applicationscited by 88
  12. 2023Tackling the Curse of Dimensionality with Physics-Informed Neural Networkscited by 78
38 more
  1. 2024From PINNs to PIKANs: Recent Advances in Physics-Informed Machine Learningcited by 73
  2. 2023Residual-based attention in physics-informed neural networkscited by 72
  3. 2023PINNsFormer: A Transformer-Based Framework For Physics-Informed Neural Networkscited by 62
  4. 2024KAN-ODEs: Kolmogorov-Arnold Network Ordinary Differential Equations for Learning Dynamical Systems and Hidden Physicscited by 58
  5. 2025AB-UPT: Scaling Neural CFD Surrogates for High-Fidelity Automotive Aerodynamics Simulations via Anchored-Branched Universal Physics Transformerscited by 49
  6. 2023Fourier-MIONet: Fourier-enhanced multiple-input neural operators for multiphase modeling of geological carbon sequestrationcited by 46
  7. 2021Physics-Guided Deep Learning for Dynamical Systems: A Surveycited by 43
  8. 2021Neural Networks with Physics-Informed Architectures and Constraints for Dynamical Systems Modelingcited by 40
  9. 2021Physics and Equality Constrained Artificial Neural Networks: Application to Forward and Inverse Problems with Multi-fidelity Data Fusioncited by 38
  10. 2021Meta-Auto-Decoder for Solving Parametric Partial Differential Equationscited by 36
  11. 2022Enhanced Physics-Informed Neural Networks with Augmented Lagrangian Relaxation Method (AL-PINNs)cited by 35
  12. 2022Implicit Neural Spatial Representations for Time-dependent PDEscited by 35
  13. 2022Learning differentiable solvers for systems with hard constraintscited by 34
  14. 2022Deep Learning Methods for Partial Differential Equations and Related Parameter Identification Problemscited by 34
  15. 2021SPINN: Sparse, Physics-based, and partially Interpretable Neural Networks for PDEscited by 32
  16. 2024Unveiling the optimization process of Physics Informed Neural Networks: How accurate and competitive can PINNs be?cited by 31
  17. 2024Physics-Informed Neural Networks with Hard Linear Equality Constraintscited by 30
  18. 2021DAE-PINN: A Physics-Informed Neural Network Model for Simulating Differential-Algebraic Equations with Application to Power Networkscited by 28
  19. 2021One-shot learning for solution operators of partial differential equationscited by 27
  20. 2024Recent Advances on Machine Learning for Computational Fluid Dynamics: A Surveycited by 27
  21. 2021Data vs. Physics: The Apparent Pareto Front of Physics-Informed Neural Networkscited by 26
  22. 2022Lagrangian PINNs: A causality-conforming solution to failure modes of physics-informed neural networkscited by 26
  23. 2022Partial Differential Equations Meet Deep Neural Networks: A Surveycited by 25
  24. 2021Fast PDE-constrained optimization via self-supervised operator learningcited by 24
  25. 2024Scaling physics-informed hard constraints with mixture-of-expertscited by 24
  26. 2022On the Role of Fixed Points of Dynamical Systems in Training Physics-Informed Neural Networkscited by 23
  27. 2023Hutchinson Trace Estimation for High-Dimensional and High-Order Physics-Informed Neural Networkscited by 23
  28. 2024Score-Based Physics-Informed Neural Networks for High-Dimensional Fokker-Planck Equationscited by 22
  29. 2022Scalable algorithms for physics-informed neural and graph networkscited by 21
  30. 2022Guiding continuous operator learning through Physics-based boundary constraintscited by 21
  31. 2023Deep Learning in Deterministic Computational Mechanicscited by 21
  32. 2023Enhancing training of physics-informed neural networks using domain-decomposition based preconditioning strategiescited by 20
  33. 2024Stochastic Taylor Derivative Estimator: Efficient amortization for arbitrary differential operatorscited by 20
  34. 2022Improved Training of Physics-Informed Neural Networks with Model Ensemblescited by 19
  35. 2022Physics-informed neural networks for PDE-constrained optimization and controlcited by 19
  36. 2022Fully probabilistic deep models for forward and inverse problems in parametric PDEscited by 19
  37. 2023Bias-Variance Trade-off in Physics-Informed Neural Networks with Randomized Smoothing for High-Dimensional PDEscited by 19
  38. 2025FunDiff: Diffusion Models over Function Spaces for Physics-Informed Generative Modelingcited by 19

50 most cited of 277 All 277 (JSON)