mlsanityData to 14 Oct 2026

Mixed formulation of physics-informed neural networks for thermo-mechanically coupled systems and heterogeneous domains

arXiv 2302.04954 ↗First posted 9 Feb 2023cs.CE cs.AIcited by 14

Not on the map. Why?

Abstract (arXiv)

Physics-informed neural networks (PINNs) are a new tool for solving boundary value problems by defining loss functions of neural networks based on governing equations, boundary conditions, and initial conditions. Recent investigations have shown that when designing loss functions for many engineering problems, using first-order derivatives and combining equations from both strong and weak forms can lead to much better accuracy, especially when there are heterogeneity and variable jumps in the domain. This new approach is called the mixed formulation for PINNs, which takes ideas from the mixed finite element method. In this method, the PDE is reformulated as a system of equations where the primary unknowns are the fluxes or gradients of the solution, and the secondary unknowns are the solution itself. In this work, we propose applying the mixed formulation to solve multi-physical problems, specifically a stationary thermo-mechanically coupled system of equations. Additionally, we discuss both sequential and fully coupled unsupervised training and compare their accuracy and computational cost. To improve the accuracy of the network, we incorporate hard boundary constraints to ensure valid predictions. We then investigate how different optimizers and architectures affect accuracy and efficiency. Finally, we introduce a simple approach for parametric learning that is similar to transfer learning. This approach combines data and physics to address the limitations of PINNs regarding computational cost and improves the network's ability to predict the response of the system for unseen cases. The outcomes of this work will be useful for many other engineering applications where deep learning is employed on multiple coupled systems of equations for fast and reliable computations.

Key facts. Cited by 14 papers in the map (data through 14 Oct 2026). Builds on 37 of its 74 references that are in the map. First posted on arXiv 9 Feb 2023.

Builds on

37 of 74 references.

References · 37

  1. 2020Fourier Neural Operator for Parametric Partial Differential Equationscited by 2,908
  2. 2019DeepONet: Learning nonlinear operators for identifying differential equations based on the universal approximation theorem of operatorscited by 2,018
  3. 2019A Comprehensive Survey on Transfer Learningcited by 1,160
  4. 2015Automatic differentiation in machine learning: a surveycited by 855
  5. 2014Deep Learning in Neural Networks: An Overviewcited by 770
  6. 2021Learning the solution operator of parametric partial differential equations with physics-informed DeepOnetscited by 540
  7. 2020What is being transferred in transfer learning?cited by 368
  8. 2020On the eigenvector bias of Fourier feature networks: From regression to solving multi-scale PDEs with physics-informed neural networkscited by 284
  9. 2021Physics-informed neural networks with hard constraints for inverse designcited by 280
  10. 2020hp-VPINNs: Variational Physics-Informed Neural Networks With Domain Decompositioncited by 236
  11. 2020Self-Adaptive Physics-Informed Neural Networks using a Soft Attention Mechanismcited by 233
  12. 2019An Energy Approach to the Solution of Partial Differential Equations in Computational Mechanics via Machine Learning: Concepts, Implementation and Applicationscited by 118
25 more
  1. 2019Transfer learning enhanced physics informed neural network for phase-field modeling of fracturecited by 116
  2. 2021Parallel Physics-Informed Neural Networks via Domain Decompositioncited by 112
  3. 2021A physics-informed variational DeepONet for predicting the crack path in brittle materialscited by 98
  4. 2021CAN-PINN: A Fast Physics-Informed Neural Network Based on Coupled-Automatic-Numerical Differentiation Methodcited by 93
  5. 2021Multi-Objective Loss Balancing for Physics-Informed Deep Learningcited by 87
  6. 2021When Do Extended Physics-Informed Neural Networks (XPINNs) Improve Generalization?cited by 58
  7. 2021One-Shot Transfer Learning of Physics-Informed Neural Networkscited by 49
  8. 2021Physics informed neural networks for continuum micromechanicscited by 46
  9. 2022A mixed formulation for physics-informed neural networks as a potential solver for engineering problems in heterogeneous domains: comparison with finite element methodcited by 33
  10. 2022How important are activation functions in regression and classification? A survey, performance comparison, and future directionscited by 29
  11. 2021The mixed deep energy method for resolving concentration features in finite strain hyperelasticitycited by 28
  12. 2020Meshless physics-informed deep learning method for three-dimensional solid mechanicscited by 27
  13. 2021Data vs. Physics: The Apparent Pareto Front of Physics-Informed Neural Networkscited by 27
  14. 2021Physics-informed neural network simulation of multiphase poroelasticity using stress-split sequential trainingcited by 26
  15. 2021Lossless Multi-Scale Constitutive Elastic Relations with Artificial Intelligencecited by 17
  16. 2022SVD-PINNs: Transfer Learning of Physics-Informed Neural Networks via Singular Value Decompositioncited by 13
  17. 2022Transfer Learning with Physics-Informed Neural Networks for Efficient Simulation of Branched Flowscited by 12
  18. 2020Analysis of three dimensional potential problems in non-homogeneous media with physics-informed deep collocation method using material transfer learning and sensitivity analysiscited by 11
  19. 2021CENN: Conservative energy method based on neural networks with subdomains for solving variational problems involving heterogeneous and complex geometriescited by 10
  20. 2022Physical Activation Functions (PAFs): An Approach for More Efficient Induction of Physics into Physics-Informed Neural Networks (PINNs)cited by 10
  21. 2022Physics-informed neural network solution of thermo-hydro-mechanical (THM) processes in porous mediacited by 8
  22. 2022Enhanced physics-informed neural networks for hyperelasticitycited by 6
  23. 2021An anisotropic cohesive fracture model: advantages and limitations of length-scale insensitive phase-field damage modelscited by 3
  24. 2021Physics-informed neural networks for solving thermo-mechanics problems of functionally graded materialcited by 3
  25. 2022Comparison of two artificial neural networks trained for the surrogate modeling of stress in materially heterogeneous elastoplastic solidscited by 3

Built on by

Cited by year (2026 to 14 Oct)

Citing papers per year: 2023: 4; 2024: 4; 2025: 3; 2026: 3.

14 papers.

Sort:

  1. 2024A finite element-based physics-informed operator learning framework for spatiotemporal partial differential equations on arbitrary domainscited by 15
  2. 2023Theory and implementation of inelastic Constitutive Artificial Neural Networkscited by 12
  3. 2025Challenges and Advancements in Modeling Shock Fronts with Physics-Informed Neural Networks: A Review and Benchmarking Studycited by 11
  4. 2024A finite operator learning technique for mapping the elastic properties of microstructures to their mechanical deformationscited by 10
  5. 2025Inverse Design in Nanophotonics via Representation Learningcited by 7
  6. 2023Learning solution of nonlinear constitutive material models using physics-informed neural networks: COMM-PINNcited by 6
  7. 2023PINN surrogate of Li-ion battery models for parameter inference. Part I: Implementation and multi-fidelity hierarchies for the single-particle modelcited by 6
  8. 2024Separable Physics-Informed Neural Networks for the solution of elasticity problemscited by 6
  9. 2025A Physics-Informed Meta-Learning Framework for the Continuous Solution of Parametric PDEs on Arbitrary Geometriescited by 5
  10. 2024Integration of physics-informed operator learning and finite element method for parametric learning of partial differential equationscited by 4
  11. 2023Detecting hidden structures from a static loading experiment: topology optimization meets physics-informed neural networkscited by 0
  12. 2026Tackling multiphysics problems via finite element-guided physics-informed operator learningcited by 0
2 more
  1. 2026Coupling-Robust Accuracy in Multiphysics Physics Informed Neural Networks via Kronecker-Preconditioned Optimizationcited by 0
  2. 2026FlowForm: Synergizing Fluid Physics with Topological Consistency for Satellite Flood Synthesiscited by 0