mlsanityData to 7 Oct 2026

Adaptive Hard-Soft Physics-Informed Neural Networks for Robust Boundary-Constrained PDE Solving

arXiv 2606.23359 ↗First posted 22 Jun 2026cs.LG cs.AIcited by 1

Not on the map. Why?

Abstract (arXiv)

Physics-informed neural networks (PINNs) provide an effective way to solve partial differential equations (PDEs) by embedding physical principles into the learning process. However, the conventional PINN formulation, in which all constraints are imposed as soft penalty terms within a composite loss, often exhibits slow convergence, sensitivity to loss weight scaling, and inaccurate boundary enforcement due to poor conditioning of the optimization landscape. To address these limitations, this study proposes a unified hard--soft physics--informed neural network (HSPINN) with adaptive loss weighting. In this framework, Dirichlet and periodic boundary conditions are enforced exactly by construction through analytical or polynomial lifting, masking functions, and periodic feature mappings, while the governing PDE residuals, Neumann fluxes, and initial conditions are treated as soft constraints. An inverse-share softmax strategy dynamically balances the relative importance of individual loss components during training, eliminating manual penalty tuning and improving gradient stability. This formulation ensures boundary admissibility throughout optimization and enhances convergence efficiency and numerical robustness. Applications to representative elliptic (Poisson), parabolic (Burgers), and hyperbolic (convection with periodic boundaries) problems demonstrate that HSPINN consistently achieves faster convergence, higher accuracy, and greater stability than conventional PINNs, establishing a general and scalable foundation for physics-constrained deep learning across science and technology.

Key facts. Cited by 1 paper in the map (data through 7 Oct 2026). Builds on 11 of its 32 references that are in the map. First posted on arXiv 22 Jun 2026.

Builds on

11 of 32 references.

References · 11

  1. 2017GradNorm: Gradient Normalization for Adaptive Loss Balancing in Deep Multitask Networkscited by 816
  2. 2021Characterizing possible failure modes in physics-informed neural networkscited by 632
  3. 2019DeepXDE: A deep learning library for solving differential equationscited by 617
  4. 2022Scientific Machine Learning through Physics-Informed Neural Networks: Where we are and What's nextcited by 603
  5. 2021Physics-informed neural networks with hard constraints for inverse designcited by 277
  6. 2020Self-Adaptive Physics-Informed Neural Networks using a Soft Attention Mechanismcited by 231
  7. 2020Understanding and mitigating gradient pathologies in physics-informed neural networkscited by 134
  8. 2022Learning to Accelerate Partial Differential Equations via Latent Global Evolutioncited by 38
  9. 2024Parameterized Physics-informed Neural Networks for Parameterized PDEscited by 35
  10. 2020A Survey on Activation Functions and their relation with Xavier and He Normal Initializationcited by 13
  11. 2022Optimizing the optimizer for data driven deep neural networks and physics informed neural networkscited by 4

Built on by

Cited by year (2026 to 7 Oct)

Citing papers per year: 2026: 1.

1 paper.