Long-time integration of parametric evolution equations with physics-informed DeepONets
Not on the map. Why?
Abstract (arXiv)
Ordinary and partial differential equations (ODEs/PDEs) play a paramount role in analyzing and simulating complex dynamic processes across all corners of science and engineering. In recent years machine learning tools are aspiring to introduce new effective ways of simulating PDEs, however existing approaches are not able to reliably return stable and accurate predictions across long temporal horizons. We aim to address this challenge by introducing an effective framework for learning infinite-dimensional operators that map random initial conditions to associated PDE solutions within a short time interval. Such latent operators can be parametrized by deep neural networks that are trained in an entirely self-supervised manner without requiring any paired input-output observations. Global long-time predictions across a range of initial conditions can be then obtained by iteratively evaluating the trained model using each prediction as the initial condition for the next evaluation step. This introduces a new approach to temporal domain decomposition that is shown to be effective in performing accurate long-time simulations for a wide range of parametric ODE and PDE systems, from wave propagation, to reaction-diffusion dynamics and stiff chemical kinetics, all at a fraction of the computational cost needed by classical numerical solvers.
Key facts. Cited by 87 papers in the map (data through 7 Oct 2026). Builds on 29 of its 63 references that are in the map. First posted on arXiv 9 Jun 2021.
Builds on
29 of 63 references.
References · 29
- 2014Adam: A Method for Stochastic Optimizationcited by 36,960
- 2017Model-Agnostic Meta-Learning for Fast Adaptation of Deep Networkscited by 4,861
- 2020Fourier Features Let Networks Learn High Frequency Functions in Low Dimensional Domainscited by 2,170
- 2019DeepONet: Learning nonlinear operators for identifying differential equations based on the universal approximation theorem of operatorscited by 1,965
- 2018On the Spectral Bias of Neural Networkscited by 1,321
- 2020Learning to Simulate Complex Physics with Graph Networkscited by 867
- 2015Automatic differentiation in machine learning: a surveycited by 846
- 2020When and why PINNs fail to train: A neural tangent kernel perspectivecited by 629
- 2019DeepXDE: A deep learning library for solving differential equationscited by 617
- 2017The Deep Ritz method: A deep learning-based numerical algorithm for solving variational problemscited by 581
- 2017Solving high-dimensional partial differential equations using deep learningcited by 549
- 2021Learning the solution operator of parametric partial differential equations with physics-informed DeepOnetscited by 537
17 more
- 2021Machine learning accelerated computational fluid dynamicscited by 461
- 2020On the eigenvector bias of Fourier feature networks: From regression to solving multi-scale PDEs with physics-informed neural networkscited by 279
- 2019Physics-Constrained Deep Learning for High-dimensional Surrogate Modeling and Uncertainty Quantification without Labeled Datacited by 261
- 2020Self-Adaptive Physics-Informed Neural Networks using a Soft Attention Mechanismcited by 231
- 2019Variational Physics-Informed Neural Networks For Solving Partial Differential Equationscited by 144
- 2020Understanding and mitigating gradient pathologies in physics-informed neural networkscited by 134
- 2021Solving and Learning Nonlinear PDEs with Gaussian Processescited by 128
- 2019Modeling the Dynamics of PDE Systems with Physics-Constrained Deep Auto-Regressive Networkscited by 127
- 2020Solving Allen-Cahn and Cahn-Hilliard Equations using the Adaptive Physics Informed Neural Networkscited by 122
- 2019An Energy Approach to the Solution of Partial Differential Equations in Computational Mechanics via Machine Learning: Concepts, Implementation and Applicationscited by 118
- 2019Transfer learning enhanced physics informed neural network for phase-field modeling of fracturecited by 116
- 2019PPINN: Parareal Physics-Informed Neural Network for time-dependent PDEscited by 116
- 2019Machine learning in cardiovascular flows modeling: Predicting arterial blood pressure from non-invasive 4D flow MRI data using physics-informed neural networkscited by 76
- 2020NVIDIA SimNet^{TM}: an AI-accelerated multi-physics simulation frameworkcited by 58
- 2021Evolutional Deep Neural Networkcited by 48
- 2016Inferring solutions of differential equations using noisy multi-fidelity datacited by 38
- 2018Deep Learning of Turbulent Scalar Mixingcited by 17
Built on by
Citing papers per year: 2021: 5; 2022: 18; 2023: 21; 2024: 20; 2025: 12; 2026: 11.
87 papers.
Sort:
By area:
- 2023PDE-Refiner: Achieving Accurate Long Rollouts with Neural PDE Solverscited by 205
- 2022Respecting causality is all you need for training physics-informed neural networkscited by 154
- 2022Learning Operators with Coupled Attentioncited by 88
- 2022Physics-Informed Machine Learning: A Survey on Problems, Methods and Applicationscited by 88
- 2024Weak baselines and reporting biases lead to overoptimism in machine learning for fluid-related partial differential equationscited by 87
- 2021Improved architectures and training algorithms for deep operator networkscited by 85
- 2022Continuous PDE Dynamics Forecasting with Implicit Neural Representationscited by 71
- 2022Generic bounds on the approximation error for physics-informed (and) operator learningcited by 65
- 2022Error estimates for physics informed neural networks approximating the Navier-Stokes equationscited by 63
- 2022Multifidelity Deep Operator Networks For Data-Driven and Physics-Informed Problemscited by 57
- 2021Physics-Guided Deep Learning for Dynamical Systems: A Surveycited by 43
- 2022Learning to Solve PDE-constrained Inverse Problems with Graph Networkscited by 37
38 more
- 2022SVD Perspectives for Augmenting DeepONet Flexibility and Interpretabilitycited by 35
- 2022Implicit Neural Spatial Representations for Time-dependent PDEscited by 35
- 2023Neural Operator Learning for Long-Time Integration in Dynamical Systems with Recurrent Neural Networkscited by 32
- 2021A Metalearning Approach for Physics-Informed Neural Networks (PINNs): Application to Parameterized PDEscited by 31
- 2022wPINNs: Weak Physics informed neural networks for approximating entropy solutions of hyperbolic conservation lawscited by 29
- 2022Transfer Learning Enhanced DeepONet for Long-Time Prediction of Evolution Equationscited by 28
- 2022Bi-fidelity Modeling of Uncertain and Partially Unknown Systems using DeepONetscited by 27
- 2021Fast PDE-constrained optimization via self-supervised operator learningcited by 24
- 2023Stacked networks improve physics-informed training: applications to neural networks and deep operator networkscited by 21
- 2023Improving physics-informed neural networks with meta-learned optimizationcited by 19
- 2023Data-driven anisotropic finite viscoelasticity using neural ordinary differential equationscited by 16
- 2025TI-DeepONet: Learnable Time Integration for Stable Long-Term Extrapolationcited by 14
- 2022Bayesian Spline Learning for Equation Discovery of Nonlinear Dynamics with Quantified Uncertaintycited by 13
- 2023On Approximating the Dynamic Response of Synchronous Generators via Operator Learning: A Step Towards Building Deep Operator-based Power Grid Simulatorscited by 13
- 2023A multifidelity approach to continual learning for physical systemscited by 13
- 2023Exactly conservative physics-informed neural networks and deep operator networks for dynamical systemscited by 13
- 2021NeuFENet: Neural Finite Element Solutions with Theoretical Bounds for Parametric PDEscited by 10
- 2025Evolutionary Optimization of Physics-Informed Neural Networks: Evo-PINN Frontiers and Opportunitiescited by 10
- 2025Enabling Local Neural Operators to perform Equation-Free System-Level Analysiscited by 10
- 2023Improving physics-informed DeepONets with hard constraintscited by 9
- 2023Feature-adjacent multi-fidelity physics-informed machine learning for partial differential equationscited by 8
- 2023Understanding and Mitigating Extrapolation Failures in Physics-Informed Neural Networkscited by 8
- 2023Invariant preservation in machine learned PDE solvers via error correctioncited by 7
- 2022Adaptive physics-informed neural operator for coarse-grained non-equilibrium flowscited by 6
- 2024An Advanced Physics-Informed Neural Operator for Comprehensive Design Optimization of Highly-Nonlinear Systems: An Aerospace Composites Processing Case Studycited by 6
- 2022Accelerating discrete dislocation dynamics simulations with graph neural networkscited by 5
- 2022SMS: Spiking Marching Scheme for Efficient Long Time Integration of Differential Equationscited by 5
- 2024Micrometer: Micromechanics Transformer for Predicting Mechanical Responses of Heterogeneous Materialscited by 5
- 2024Advancing Generalization in PINNs through Latent-Space Representationscited by 5
- 2025Physics-Informed Time-Integrated DeepONet: Temporal Tangent Space Operator Learning for High-Accuracy Inferencecited by 5
- 2022Tunable Complexity Benchmarks for Evaluating Physics-Informed Neural Networks on Coupled Ordinary Differential Equationscited by 4
- 2024Multifidelity domain decomposition-based physics-informed neural networks and operators for time-dependent problemscited by 4
- 2024Adaptive deep density approximation for stochastic dynamical systemscited by 4
- 2024Symplectic Neural Flows for Modeling and Discoverycited by 4
- 2026DiffusionRollout: Uncertainty-Aware Rollout Planning in Long-Horizon PDE Solvingcited by 4
- 2023M-ENIAC: A machine learning recreation of the first successful numerical weather forecastscited by 3
- 2023A Sequential Meta-Transfer (SMT) Learning to Combat Complexities of Physics-Informed Neural Networks: Application to Composites Autoclave Processingcited by 3
- 2024TENG: Time-Evolving Natural Gradient for Solving PDEs With Deep Neural Nets Toward Machine Precisioncited by 3
50 most cited of 87 All 87 (JSON)
- 2026Learning Unsteady Aneurysm Hemodynamics with Physics-Informed DeepONets13 Aug 2026
- 2026No Free Lunch in Flow Surrogates under Time-Varying Boundary Conditions: A Two-Regime Study26 Jul 2026
- 2026On the training of physics-informed neural operators for solving parametric partial differential equations4 Jun 2026
- 2026Variation Spaces for Encoder--Decoder Neural Operators: Approximation and Generalization31 May 2026
- 2026RHYME-XT: A Neural Operator for Spatiotemporal Control Systems18 Mar 2026
- 2026Parameterized Temporal Extrapolation of PDEs via Disentangled Latent Dynamics Manifold Fusion13 Mar 2026
- 2026TENG-BC: Unified Time-Evolving Natural Gradient for Neural PDE Solvers with General Boundary Conditions28 Feb 2026
- 2026The Error of Deep Operator Networks Is the Sum of Its Parts: Branch-Trunk and Mode Error Decompositions25 Feb 2026
- 2026BEACONS: Bounded-Error, Algebraically-Composable Neural Solvers for Partial Differential Equations16 Feb 2026
- 2026DiffusionRollout: Uncertainty-Aware Rollout Planning in Long-Horizon PDE Solving14 Feb 2026
- 2026Learning, Solving and Optimizing PDEs with TensorGalerkin: an efficient high-performance Galerkin assembly algorithm4 Feb 2026
- 2025Equation-Free Coarse Control of Distributed Parameter Systems via Local Neural Operators28 Sep 2025
38 more
- 2025Physics-Informed Operator Learning for Hemodynamic Modeling22 Sep 2025
- 2025Physics-Informed Time-Integrated DeepONet: Temporal Tangent Space Operator Learning for High-Accuracy Inference7 Aug 2025
- 2025Low-rank adaptive physics-informed HyperDeepONets for solving differential equations24 Jul 2025
- 2025NeuroPhysNet: A FitzHugh-Nagumo-Based Physics-Informed Neural Network Framework for Electroencephalograph (EEG) Analysis and Motor Imagery Classification16 Jun 2025
- 2025TI-DeepONet: Learnable Time Integration for Stable Long-Term Extrapolation22 May 2025
- 2025Enabling Local Neural Operators to perform Equation-Free System-Level Analysis5 May 2025
- 2025Integral regularization PINNs for evolution equations31 Mar 2025
- 2025Enhanced Vascular Flow Simulations in Aortic Aneurysm via Physics-Informed Neural Networks and Deep Operator Networks19 Mar 2025
- 2025Accelerated Gradient-based Design Optimization Via Differentiable Physics-Informed Neural Operator: A Composites Autoclave Processing Case Study17 Feb 2025
- 2025Inverse Evolution Data Augmentation for Neural PDE Solvers24 Jan 2025
- 2025Evolutionary Optimization of Physics-Informed Neural Networks: Evo-PINN Frontiers and Opportunities11 Jan 2025
- 2024Symplectic Neural Flows for Modeling and Discovery21 Dec 2024
- 2024Advancing Generalization in PINNs through Latent-Space Representations28 Nov 2024
- 2024What do physics-informed DeepONets learn? Understanding and improving training for scientific computing applications27 Nov 2024
- 2024Long-time Integration of Nonlinear Wave Equations with Neural Operators21 Oct 2024
- 2024Micrometer: Micromechanics Transformer for Predicting Mechanical Responses of Heterogeneous Materials23 Sep 2024
- 2024Unified theoretical guarantees for stability, consistency, and convergence in neural PDE solvers from non-IID data to physics-informed networks8 Sep 2024
- 2024A hybrid FEM-PINN method for time-dependent partial differential equations4 Sep 2024
- 2024Data-driven 2D stationary quantum droplets and wave propagations in the amended GP equation with two potentials via deep neural networks learning4 Sep 2024
- 2024Physics-informed DeepONet with stiffness-based loss functions for structural response prediction2 Sep 2024
- 2024Transfer Operator Learning with Fusion Frame20 Aug 2024
- 2024PinnDE: Physics-Informed Neural Networks for Solving Differential Equations19 Aug 2024
- 2024Parallel-in-Time Solutions with Random Projection Neural Networks19 Aug 2024
- 2024Weak baselines and reporting biases lead to overoptimism in machine learning for fluid-related partial differential equations9 Jul 2024
- 2024An Advanced Physics-Informed Neural Operator for Comprehensive Design Optimization of Highly-Nonlinear Systems: An Aerospace Composites Processing Case Study20 Jun 2024
- 2024Physics and geometry informed neural operator network with application to acoustic scattering2 Jun 2024
- 2024Adaptive deep density approximation for stochastic dynamical systems5 May 2024
- 2024Using Neural Implicit Flow To Represent Latent Dynamics Of Canonical Systems26 Apr 2024
- 2024TENG: Time-Evolving Natural Gradient for Solving PDEs With Deep Neural Nets Toward Machine Precision16 Apr 2024
- 2024Neural Parameter Regression for Explicit Representations of PDE Solution Operators19 Mar 2024
- 2024Multifidelity domain decomposition-based physics-informed neural networks and operators for time-dependent problems15 Jan 2024
- 2023Data-efficient operator learning for solving high Mach number fluid flow problems28 Nov 2023
- 2023Exactly conservative physics-informed neural networks and deep operator networks for dynamical systems23 Nov 2023
- 2023Stacked networks improve physics-informed training: applications to neural networks and deep operator networks11 Nov 2023
- 2023Waveformer for modelling dynamical systems8 Oct 2023
- 2023Improving physics-informed DeepONets with hard constraints14 Sep 2023
- 2023On the Approximation of Bi-Lipschitz Maps by Invertible Neural Networks18 Aug 2023
- 2023A Sequential Meta-Transfer (SMT) Learning to Combat Complexities of Physics-Informed Neural Networks: Application to Composites Autoclave Processing12 Aug 2023
50 newest of 87 All 87 (JSON)
- 2022Respecting causality is all you need for training physics-informed neural networkscited by 154
- 2022Learning Operators with Coupled Attentioncited by 88
- 2022Physics-Informed Machine Learning: A Survey on Problems, Methods and Applicationscited by 88
- 2024Weak baselines and reporting biases lead to overoptimism in machine learning for fluid-related partial differential equationscited by 87
- 2021Improved architectures and training algorithms for deep operator networkscited by 85
- 2022Continuous PDE Dynamics Forecasting with Implicit Neural Representationscited by 71
- 2022Generic bounds on the approximation error for physics-informed (and) operator learningcited by 65
- 2022Error estimates for physics informed neural networks approximating the Navier-Stokes equationscited by 63
- 2022Multifidelity Deep Operator Networks For Data-Driven and Physics-Informed Problemscited by 57
- 2021Physics-Guided Deep Learning for Dynamical Systems: A Surveycited by 43
- 2022Learning to Solve PDE-constrained Inverse Problems with Graph Networkscited by 37
- 2022SVD Perspectives for Augmenting DeepONet Flexibility and Interpretabilitycited by 35
12 most cited of 85 All 85 (JSON)
- 2026Learning Unsteady Aneurysm Hemodynamics with Physics-Informed DeepONets13 Aug 2026
- 2026No Free Lunch in Flow Surrogates under Time-Varying Boundary Conditions: A Two-Regime Study26 Jul 2026
- 2026On the training of physics-informed neural operators for solving parametric partial differential equations4 Jun 2026
- 2026Variation Spaces for Encoder--Decoder Neural Operators: Approximation and Generalization31 May 2026
- 2026RHYME-XT: A Neural Operator for Spatiotemporal Control Systems18 Mar 2026
- 2026Parameterized Temporal Extrapolation of PDEs via Disentangled Latent Dynamics Manifold Fusion13 Mar 2026
- 2026TENG-BC: Unified Time-Evolving Natural Gradient for Neural PDE Solvers with General Boundary Conditions28 Feb 2026
- 2026The Error of Deep Operator Networks Is the Sum of Its Parts: Branch-Trunk and Mode Error Decompositions25 Feb 2026
- 2026BEACONS: Bounded-Error, Algebraically-Composable Neural Solvers for Partial Differential Equations16 Feb 2026
- 2026Learning, Solving and Optimizing PDEs with TensorGalerkin: an efficient high-performance Galerkin assembly algorithm4 Feb 2026
- 2025Equation-Free Coarse Control of Distributed Parameter Systems via Local Neural Operators28 Sep 2025
- 2025Physics-Informed Operator Learning for Hemodynamic Modeling22 Sep 2025
12 newest of 85 All 85 (JSON)