mlsanityData to 7 Oct 2026

Long-time integration of parametric evolution equations with physics-informed DeepONets

arXiv 2106.05384 ↗First posted 9 Jun 2021cs.LG physics.comp-phcited by 87

Not on the map. Why?

Abstract (arXiv)

Ordinary and partial differential equations (ODEs/PDEs) play a paramount role in analyzing and simulating complex dynamic processes across all corners of science and engineering. In recent years machine learning tools are aspiring to introduce new effective ways of simulating PDEs, however existing approaches are not able to reliably return stable and accurate predictions across long temporal horizons. We aim to address this challenge by introducing an effective framework for learning infinite-dimensional operators that map random initial conditions to associated PDE solutions within a short time interval. Such latent operators can be parametrized by deep neural networks that are trained in an entirely self-supervised manner without requiring any paired input-output observations. Global long-time predictions across a range of initial conditions can be then obtained by iteratively evaluating the trained model using each prediction as the initial condition for the next evaluation step. This introduces a new approach to temporal domain decomposition that is shown to be effective in performing accurate long-time simulations for a wide range of parametric ODE and PDE systems, from wave propagation, to reaction-diffusion dynamics and stiff chemical kinetics, all at a fraction of the computational cost needed by classical numerical solvers.

Key facts. Cited by 87 papers in the map (data through 7 Oct 2026). Builds on 29 of its 63 references that are in the map. First posted on arXiv 9 Jun 2021.

Builds on

29 of 63 references.

References · 29

  1. 2014Adam: A Method for Stochastic Optimizationcited by 36,960
  2. 2017Model-Agnostic Meta-Learning for Fast Adaptation of Deep Networkscited by 4,861
  3. 2020Fourier Features Let Networks Learn High Frequency Functions in Low Dimensional Domainscited by 2,170
  4. 2019DeepONet: Learning nonlinear operators for identifying differential equations based on the universal approximation theorem of operatorscited by 1,965
  5. 2018On the Spectral Bias of Neural Networkscited by 1,321
  6. 2020Learning to Simulate Complex Physics with Graph Networkscited by 867
  7. 2015Automatic differentiation in machine learning: a surveycited by 846
  8. 2020When and why PINNs fail to train: A neural tangent kernel perspectivecited by 629
  9. 2019DeepXDE: A deep learning library for solving differential equationscited by 617
  10. 2017The Deep Ritz method: A deep learning-based numerical algorithm for solving variational problemscited by 581
  11. 2017Solving high-dimensional partial differential equations using deep learningcited by 549
  12. 2021Learning the solution operator of parametric partial differential equations with physics-informed DeepOnetscited by 537
17 more
  1. 2021Machine learning accelerated computational fluid dynamicscited by 461
  2. 2020On the eigenvector bias of Fourier feature networks: From regression to solving multi-scale PDEs with physics-informed neural networkscited by 279
  3. 2019Physics-Constrained Deep Learning for High-dimensional Surrogate Modeling and Uncertainty Quantification without Labeled Datacited by 261
  4. 2020Self-Adaptive Physics-Informed Neural Networks using a Soft Attention Mechanismcited by 231
  5. 2019Variational Physics-Informed Neural Networks For Solving Partial Differential Equationscited by 144
  6. 2020Understanding and mitigating gradient pathologies in physics-informed neural networkscited by 134
  7. 2021Solving and Learning Nonlinear PDEs with Gaussian Processescited by 128
  8. 2019Modeling the Dynamics of PDE Systems with Physics-Constrained Deep Auto-Regressive Networkscited by 127
  9. 2020Solving Allen-Cahn and Cahn-Hilliard Equations using the Adaptive Physics Informed Neural Networkscited by 122
  10. 2019An Energy Approach to the Solution of Partial Differential Equations in Computational Mechanics via Machine Learning: Concepts, Implementation and Applicationscited by 118
  11. 2019Transfer learning enhanced physics informed neural network for phase-field modeling of fracturecited by 116
  12. 2019PPINN: Parareal Physics-Informed Neural Network for time-dependent PDEscited by 116
  13. 2019Machine learning in cardiovascular flows modeling: Predicting arterial blood pressure from non-invasive 4D flow MRI data using physics-informed neural networkscited by 76
  14. 2020NVIDIA SimNet^{TM}: an AI-accelerated multi-physics simulation frameworkcited by 58
  15. 2021Evolutional Deep Neural Networkcited by 48
  16. 2016Inferring solutions of differential equations using noisy multi-fidelity datacited by 38
  17. 2018Deep Learning of Turbulent Scalar Mixingcited by 17

Built on by

Cited by year (2026 to 7 Oct)

Citing papers per year: 2021: 5; 2022: 18; 2023: 21; 2024: 20; 2025: 12; 2026: 11.

87 papers.

Sort:

By area:

  1. 2023PDE-Refiner: Achieving Accurate Long Rollouts with Neural PDE Solverscited by 205
  2. 2022Respecting causality is all you need for training physics-informed neural networkscited by 154
  3. 2022Learning Operators with Coupled Attentioncited by 88
  4. 2022Physics-Informed Machine Learning: A Survey on Problems, Methods and Applicationscited by 88
  5. 2024Weak baselines and reporting biases lead to overoptimism in machine learning for fluid-related partial differential equationscited by 87
  6. 2021Improved architectures and training algorithms for deep operator networkscited by 85
  7. 2022Continuous PDE Dynamics Forecasting with Implicit Neural Representationscited by 71
  8. 2022Generic bounds on the approximation error for physics-informed (and) operator learningcited by 65
  9. 2022Error estimates for physics informed neural networks approximating the Navier-Stokes equationscited by 63
  10. 2022Multifidelity Deep Operator Networks For Data-Driven and Physics-Informed Problemscited by 57
  11. 2021Physics-Guided Deep Learning for Dynamical Systems: A Surveycited by 43
  12. 2022Learning to Solve PDE-constrained Inverse Problems with Graph Networkscited by 37
38 more
  1. 2022SVD Perspectives for Augmenting DeepONet Flexibility and Interpretabilitycited by 35
  2. 2022Implicit Neural Spatial Representations for Time-dependent PDEscited by 35
  3. 2023Neural Operator Learning for Long-Time Integration in Dynamical Systems with Recurrent Neural Networkscited by 32
  4. 2021A Metalearning Approach for Physics-Informed Neural Networks (PINNs): Application to Parameterized PDEscited by 31
  5. 2022wPINNs: Weak Physics informed neural networks for approximating entropy solutions of hyperbolic conservation lawscited by 29
  6. 2022Transfer Learning Enhanced DeepONet for Long-Time Prediction of Evolution Equationscited by 28
  7. 2022Bi-fidelity Modeling of Uncertain and Partially Unknown Systems using DeepONetscited by 27
  8. 2021Fast PDE-constrained optimization via self-supervised operator learningcited by 24
  9. 2023Stacked networks improve physics-informed training: applications to neural networks and deep operator networkscited by 21
  10. 2023Improving physics-informed neural networks with meta-learned optimizationcited by 19
  11. 2023Data-driven anisotropic finite viscoelasticity using neural ordinary differential equationscited by 16
  12. 2025TI-DeepONet: Learnable Time Integration for Stable Long-Term Extrapolationcited by 14
  13. 2022Bayesian Spline Learning for Equation Discovery of Nonlinear Dynamics with Quantified Uncertaintycited by 13
  14. 2023On Approximating the Dynamic Response of Synchronous Generators via Operator Learning: A Step Towards Building Deep Operator-based Power Grid Simulatorscited by 13
  15. 2023A multifidelity approach to continual learning for physical systemscited by 13
  16. 2023Exactly conservative physics-informed neural networks and deep operator networks for dynamical systemscited by 13
  17. 2021NeuFENet: Neural Finite Element Solutions with Theoretical Bounds for Parametric PDEscited by 10
  18. 2025Evolutionary Optimization of Physics-Informed Neural Networks: Evo-PINN Frontiers and Opportunitiescited by 10
  19. 2025Enabling Local Neural Operators to perform Equation-Free System-Level Analysiscited by 10
  20. 2023Improving physics-informed DeepONets with hard constraintscited by 9
  21. 2023Feature-adjacent multi-fidelity physics-informed machine learning for partial differential equationscited by 8
  22. 2023Understanding and Mitigating Extrapolation Failures in Physics-Informed Neural Networkscited by 8
  23. 2023Invariant preservation in machine learned PDE solvers via error correctioncited by 7
  24. 2022Adaptive physics-informed neural operator for coarse-grained non-equilibrium flowscited by 6
  25. 2024An Advanced Physics-Informed Neural Operator for Comprehensive Design Optimization of Highly-Nonlinear Systems: An Aerospace Composites Processing Case Studycited by 6
  26. 2022Accelerating discrete dislocation dynamics simulations with graph neural networkscited by 5
  27. 2022SMS: Spiking Marching Scheme for Efficient Long Time Integration of Differential Equationscited by 5
  28. 2024Micrometer: Micromechanics Transformer for Predicting Mechanical Responses of Heterogeneous Materialscited by 5
  29. 2024Advancing Generalization in PINNs through Latent-Space Representationscited by 5
  30. 2025Physics-Informed Time-Integrated DeepONet: Temporal Tangent Space Operator Learning for High-Accuracy Inferencecited by 5
  31. 2022Tunable Complexity Benchmarks for Evaluating Physics-Informed Neural Networks on Coupled Ordinary Differential Equationscited by 4
  32. 2024Multifidelity domain decomposition-based physics-informed neural networks and operators for time-dependent problemscited by 4
  33. 2024Adaptive deep density approximation for stochastic dynamical systemscited by 4
  34. 2024Symplectic Neural Flows for Modeling and Discoverycited by 4
  35. 2026DiffusionRollout: Uncertainty-Aware Rollout Planning in Long-Horizon PDE Solvingcited by 4
  36. 2023M-ENIAC: A machine learning recreation of the first successful numerical weather forecastscited by 3
  37. 2023A Sequential Meta-Transfer (SMT) Learning to Combat Complexities of Physics-Informed Neural Networks: Application to Composites Autoclave Processingcited by 3
  38. 2024TENG: Time-Evolving Natural Gradient for Solving PDEs With Deep Neural Nets Toward Machine Precisioncited by 3

50 most cited of 87 All 87 (JSON)