mlsanityData to 7 Oct 2026

A finite element-based physics-informed operator learning framework for spatiotemporal partial differential equations on arbitrary domains

arXiv 2405.12465 ↗First posted 21 May 2024cs.LGcited by 15

Not on the map. Why?

Abstract (arXiv)

We propose a novel finite element-based physics-informed operator learning framework that allows for predicting spatiotemporal dynamics governed by partial differential equations (PDEs). The proposed framework employs a loss function inspired by the finite element method (FEM) with the implicit Euler time integration scheme. A transient thermal conduction problem is considered to benchmark the performance. The proposed operator learning framework takes a temperature field at the current time step as input and predicts a temperature field at the next time step. The Galerkin discretized weak formulation of the heat equation is employed to incorporate physics into the loss function, which is coined finite operator learning (FOL). Upon training, the networks successfully predict the temperature evolution over time for any initial temperature field at high accuracy compared to the FEM solution. The framework is also confirmed to be applicable to a heterogeneous thermal conductivity and arbitrary geometry. The advantages of FOL can be summarized as follows: First, the training is performed in an unsupervised manner, avoiding the need for a large data set prepared from costly simulations or experiments. Instead, random temperature patterns generated by the Gaussian random process and the Fourier series, combined with constant temperature fields, are used as training data to cover possible temperature cases. Second, shape functions and backward difference approximation are exploited for the domain discretization, resulting in a purely algebraic equation. This enhances training efficiency, as one avoids time-consuming automatic differentiation when optimizing weights and biases while accepting possible discretization errors. Finally, thanks to the interpolation power of FEM, any arbitrary geometry can be handled with FOL, which is crucial to addressing various engineering application scenarios.

Key facts. Cited by 15 papers in the map (data through 7 Oct 2026). Builds on 41 of its 82 references that are in the map. First posted on arXiv 21 May 2024.

Builds on

41 of 82 references.

References · 41

  1. 2019DeepONet: Learning nonlinear operators for identifying differential equations based on the universal approximation theorem of operatorscited by 1,965
  2. 2020When and why PINNs fail to train: A neural tangent kernel perspectivecited by 629
  3. 2022Scientific Machine Learning through Physics-Informed Neural Networks: Where we are and What's nextcited by 603
  4. 2021Learning the solution operator of parametric partial differential equations with physics-informed DeepOnetscited by 537
  5. 2021Physics-Informed Neural Operator for Learning Partial Differential Equationscited by 516
  6. 2020PhyGeoNet: Physics-Informed Geometry-Adaptive Convolutional Neural Networks for Solving Parameterized Steady-State PDEs on Irregular Domaincited by 173
  7. 2019Modeling the Dynamics of PDE Systems with Physics-Constrained Deep Auto-Regressive Networkscited by 127
  8. 2019An Energy Approach to the Solution of Partial Differential Equations in Computational Mechanics via Machine Learning: Concepts, Implementation and Applicationscited by 118
  9. 2024Challenges in Training PINNs: A Loss Landscape Perspectivecited by 109
  10. 2021A physics-informed variational DeepONet for predicting the crack path in brittle materialscited by 98
  11. 2021PhyCRNet: Physics-informed Convolutional-Recurrent Network for Solving Spatiotemporal PDEscited by 97
  12. 2021Improved architectures and training algorithms for deep operator networkscited by 85
29 more
  1. 2023A Mathematical Guide to Operator Learningcited by 74
  2. 2021Physics-informed neural networks for solving Reynolds-averaged Navierunicodex2013Stokes equationscited by 68
  3. 2020DeepGreen: Deep Learning of Green's Functions for Nonlinear Boundary Value Problemscited by 61
  4. 2020Physics-informed deep learning for incompressible laminar flowscited by 54
  5. 2020A Physics-Informed Machine Learning Approach for Solving Heat Transfer Equation in Advanced Manufacturing and Engineering Applicationscited by 53
  6. 2022Multi-resolution partial differential equations preserved learning framework for spatiotemporal dynamicscited by 44
  7. 2022Transfer learning based physics-informed neural networks for solving inverse problems in engineering structures under different loading scenarioscited by 44
  8. 2021Data-driven discovery of Green's functions with human-understandable deep learningcited by 43
  9. 2021Simulating progressive intramural damage leading to aortic dissection using an operator-regression neural networkcited by 35
  10. 2022A mixed formulation for physics-informed neural networks as a potential solver for engineering problems in heterogeneous domains: comparison with finite element methodcited by 33
  11. 2023Novel DeepONet architecture to predict stresses in elastoplastic structures with variable complex geometries and loadscited by 33
  12. 2021Physics-informed Convolutional Neural Networks for Temperature Field Prediction of Heat Source Layout without Labeled Datacited by 31
  13. 2020Meshless physics-informed deep learning method for three-dimensional solid mechanicscited by 27
  14. 2023Phase-Field DeepONet: Physics-informed deep operator neural network for fast simulations of pattern formation governed by gradient flows of free-energy functionalscited by 26
  15. 2021Hybrid FEM-NN models: Combining artificial neural networks with the finite element methodcited by 24
  16. 2021Stress field prediction in fiber-reinforced composite materials using a deep learning approachcited by 22
  17. 2023Learning in latent spaces improves the predictive accuracy of deep neural operatorscited by 19
  18. 2021Lossless Multi-Scale Constitutive Elastic Relations with Artificial Intelligencecited by 17
  19. 2023Mixed formulation of physics-informed neural networks for thermo-mechanically coupled systems and heterogeneous domainscited by 14
  20. 2022Finite Element Method-enhanced Neural Network for Forward and Inverse Problemscited by 13
  21. 2023Theory and implementation of inelastic Constitutive Artificial Neural Networkscited by 12
  22. 2021NeuFENet: Neural Finite Element Solutions with Theoretical Bounds for Parametric PDEscited by 10
  23. 2024A finite operator learning technique for mapping the elastic properties of microstructures to their mechanical deformationscited by 10
  24. 2022Temperature Field Inversion of Heat-Source Systems via Physics-Informed Neural Networkscited by 8
  25. 2021Deep learning of material transport in complex neurite networkscited by 7
  26. 2022Deep Convolutional Ritz Method: Parametric PDE surrogates without labeled datacited by 5
  27. 2022RBF-MGN:Solving spatiotemporal PDEs with Physics-informed Graph Neural Networkcited by 4
  28. 2024Integration of physics-informed operator learning and finite element method for parametric learning of partial differential equationscited by 4
  29. 2024Introducing a microstructure-embedded autoencoder approach for reconstructing high-resolution solution field data from a reduced parametric spacecited by 3

Built on by

Cited by year (2026 to 7 Oct)

Citing papers per year: 2024: 3; 2025: 4; 2026: 8.

15 papers.

Sort:

  1. 2024A physics-informed transformer neural operator for learning generalized solutions of initial boundary value problemscited by 6
  2. 2025Neural-Initialized Newton: Accelerating Nonlinear Finite Elements via Operator Learningcited by 6
  3. 2025A Physics-Informed Meta-Learning Framework for the Continuous Solution of Parametric PDEs on Arbitrary Geometriescited by 5
  4. 2026Scale-PINN: Learning Efficient Physics-Informed Neural Networks Through Sequential Correctioncited by 4
  5. 2024Projection Methods for Operator Learning and Universal Approximationcited by 2
  6. 2024Preconditioned FEM-based Neural Networks for Solving Incompressible Fluid Flows and Related Inverse Problemscited by 2
  7. 2025A discrete physics-informed training for projection-based reduced order models with neural networkscited by 1
  8. 2026A meshfree exterior calculus for generalizable and data-efficient learning of physics from point cloudscited by 1
  9. 2025Prescribed-Basis Coefficient-to-Coefficient Neural Operator for Partial Differential Equationscited by 0
  10. 2026High-Fidelity Modeling of Stochastic Chemical Dynamics on Complex Manifolds: A Multi-Scale SIREN-PINN Framework for the Curvature-Perturbed Ginzburg-Landau Equationcited by 0
  11. 2026Tackling multiphysics problems via finite element-guided physics-informed operator learningcited by 0
  12. 2026Physics-informed post-processing of stabilized finite element solutions for transient convection-dominated problemscited by 0
3 more
  1. 2026DeepRitzSplit Neural Operator for Phase-Field Models via Energy Splittingcited by 0
  2. 2026Learning the Constitutive Behavior of Materials via Neural Operators and Causal Attention: Case Studies in Plasticity and Damagecited by 0
  3. 2026Preconditioned Physics-Informed Neural Operator Trainingcited by 0