TI-DeepONet: Learnable Time Integration for Stable Long-Term Extrapolation
Not on the map. Why?
Abstract (arXiv)
Accurate temporal extrapolation remains a fundamental challenge for neural operators modeling dynamical systems, where predictions must extend far beyond the training horizon. Conventional DeepONet approaches rely on two limited paradigms: fixed-horizon rollouts, which predict full spatiotemporal solutions while ignoring temporal causality, and autoregressive schemes, which accumulate errors through sequential prediction. We introduce TI-DeepONet, a framework that integrates neural operators with adaptive numerical time-stepping to preserve the Markovian structure of dynamical systems while mitigating long-term error growth. Our method shifts the learning objective from direct state prediction to approximating instantaneous time-derivative fields, which are then integrated using standard numerical solvers. This naturally enables continuous-time prediction and allows the use of higher-order integrators at inference than those used in training, improving both efficiency and accuracy. We further propose TI(L)-DeepONet, which incorporates learnable coefficients for intermediate stages in multi-stage integration, adapting to solution-specific dynamics and enhancing fidelity. Across six canonical PDEs featuring chaotic, dissipative, dispersive, and high-dimensional behavior, TI(L)-DeepONet maeginally outperforms TI-DeepONet, and both achieve major reductions in relative L2 extrapolation error: about 96.3% compared to autoregressive methods and 83.6% compared to fixed-horizon approaches. Notably, both models maintain stable predictions over temporal domains nearly twice the training interval. This work establishes a physics-aware operator learning framework that bridges neural approximation with numerical analysis principles, addressing a key gap in long-term forecasting of complex physical systems.
Key facts. Cited by 14 papers in the map (data through 14 Oct 2026). Builds on 17 of its 31 references that are in the map. First posted on arXiv 22 May 2025.
Builds on
17 of 31 references.
References · 17
- 2018Neural Ordinary Differential Equationscited by 3,779
- 2020Fourier Neural Operator for Parametric Partial Differential Equationscited by 2,908
- 2019DeepONet: Learning nonlinear operators for identifying differential equations based on the universal approximation theorem of operatorscited by 2,018
- 2020Neural Operator: Graph Kernel Network for Partial Differential Equationscited by 734
- 2022U-NO: U-shaped Neural Operatorscited by 230
- 2023Convolutional Neural Operators for robust and accurate learning of PDEscited by 214
- 2021Long-time integration of parametric evolution equations with physics-informed DeepONetscited by 89
- 2023Sequential Deep Operator Networks (S-DeepONet) for Predicting Full-field Solutions Under Time-dependent Loadscited by 47
- 2021Learning Dissipative Dynamics in Chaotic Systemscited by 42
- 2022Applications of physics informed neural operatorscited by 33
- 2023Neural Operator Learning for Long-Time Integration in Dynamical Systems with Recurrent Neural Networkscited by 32
- 2024On the Benefits of Memory for Modeling Time-Dependent PDEscited by 31
5 more
- 2022Transfer Learning Enhanced DeepONet for Long-Time Prediction of Evolution Equationscited by 28
- 2023Improved generalization with deep neural operators for engineering systems: Path towards digital twincited by 19
- 2023A multi-fidelity deep operator network (DeepONet) for fusing simulation and monitoring data: Application to real-time settlement prediction during tunnel constructioncited by 12
- 2024Advanced Deep Operator Networks to Predict Multiphysics Solution Fields in Materials Processing and Additive Manufacturingcited by 12
- 2023Solving High-Dimensional Inverse Problems with Auxiliary Uncertainty via Operator Learning with Limited Datacited by 4
Built on by
Citing papers per year: 2025: 6; 2026: 8.
14 papers.
Sort:
By area:
- 2025Physics-Informed Time-Integrated DeepONet: Temporal Tangent Space Operator Learning for High-Accuracy Inferencecited by 5
- 2025Data-Efficient Time-Dependent PDE Surrogates: Graph Neural Simulators vs. Neural Operatorscited by 2
- 2025Multimodal Neural Operators for Real-Time Biomechanical Modelling of Traumatic Brain Injurycited by 1
- 2026Learning Transient Convective Heat Transfer with Geometry Aware World Modelscited by 1
- 2025Enhanced accuracy through ensembling of randomly initialized auto-regressive models for time-dependent PDEscited by 0
- 2025Sensing Without Colocation: Operator-Based Virtual Instrumentation for Domains Beyond Physical Reachcited by 0
- 2025ANCHOR: Error-Controlled Adaptive Numerical Correction for Neural Operator Time Marchingcited by 0
- 2026Learning Heat-based Equations in Self-similar variablescited by 0
- 2026The Error of Deep Operator Networks Is the Sum of Its Parts: Branch-Trunk and Mode Error Decompositionscited by 0
- 2026Hybrid Neural World Modelscited by 0
- 2026A Trainable-by-Parts Operator Learning Framework: Bridging DeepONet and Karhunen-Loeve Expansions for Large-Scale Applicationscited by 0
- 2026No Free Lunch in Flow Surrogates under Time-Varying Boundary Conditions: A Two-Regime Studycited by 0
- 2026Neural Constitutive Learning for Generalized Reaction-Diffusion Systems29 Sep 2026
- 2026No Free Lunch in Flow Surrogates under Time-Varying Boundary Conditions: A Two-Regime Study26 Jul 2026
- 2026LSR-Net: Learning the Forward Evolution Operator for Nonlinear Fluid Dynamics20 Jul 2026
- 2026A Trainable-by-Parts Operator Learning Framework: Bridging DeepONet and Karhunen-Loeve Expansions for Large-Scale Applications26 Jun 2026
- 2026Hybrid Neural World Models27 May 2026
- 2026The Error of Deep Operator Networks Is the Sum of Its Parts: Branch-Trunk and Mode Error Decompositions25 Feb 2026
- 2026Learning Heat-based Equations in Self-similar variables31 Jan 2026
- 2026Learning Transient Convective Heat Transfer with Geometry Aware World Models29 Jan 2026
- 2025ANCHOR: Error-Controlled Adaptive Numerical Correction for Neural Operator Time Marching22 Dec 2025
- 2025Sensing Without Colocation: Operator-Based Virtual Instrumentation for Domains Beyond Physical Reach20 Oct 2025
- 2025Multimodal Neural Operators for Real-Time Biomechanical Modelling of Traumatic Brain Injury26 Sep 2025
- 2025Data-Efficient Time-Dependent PDE Surrogates: Graph Neural Simulators vs. Neural Operators7 Sep 2025
- 2026Learning Transient Convective Heat Transfer with Geometry Aware World Modelscited by 1
- 2026Hybrid Neural World Modelscited by 0
- 2026Hybrid Neural World Models27 May 2026
- 2026Learning Transient Convective Heat Transfer with Geometry Aware World Models29 Jan 2026
- 2025Physics-Informed Time-Integrated DeepONet: Temporal Tangent Space Operator Learning for High-Accuracy Inferencecited by 5
- 2025Data-Efficient Time-Dependent PDE Surrogates: Graph Neural Simulators vs. Neural Operatorscited by 2
- 2025Multimodal Neural Operators for Real-Time Biomechanical Modelling of Traumatic Brain Injurycited by 1
- 2025Enhanced accuracy through ensembling of randomly initialized auto-regressive models for time-dependent PDEscited by 0
- 2025Sensing Without Colocation: Operator-Based Virtual Instrumentation for Domains Beyond Physical Reachcited by 0
- 2025ANCHOR: Error-Controlled Adaptive Numerical Correction for Neural Operator Time Marchingcited by 0
- 2026Learning Heat-based Equations in Self-similar variablescited by 0
- 2026The Error of Deep Operator Networks Is the Sum of Its Parts: Branch-Trunk and Mode Error Decompositionscited by 0
- 2026A Trainable-by-Parts Operator Learning Framework: Bridging DeepONet and Karhunen-Loeve Expansions for Large-Scale Applicationscited by 0
- 2026No Free Lunch in Flow Surrogates under Time-Varying Boundary Conditions: A Two-Regime Studycited by 0
- 2026LSR-Net: Learning the Forward Evolution Operator for Nonlinear Fluid Dynamicscited by 0
- 2026Neural Constitutive Learning for Generalized Reaction-Diffusion Systemscited by 0
- 2026Neural Constitutive Learning for Generalized Reaction-Diffusion Systems29 Sep 2026
- 2026No Free Lunch in Flow Surrogates under Time-Varying Boundary Conditions: A Two-Regime Study26 Jul 2026
- 2026LSR-Net: Learning the Forward Evolution Operator for Nonlinear Fluid Dynamics20 Jul 2026
- 2026A Trainable-by-Parts Operator Learning Framework: Bridging DeepONet and Karhunen-Loeve Expansions for Large-Scale Applications26 Jun 2026
- 2026The Error of Deep Operator Networks Is the Sum of Its Parts: Branch-Trunk and Mode Error Decompositions25 Feb 2026
- 2026Learning Heat-based Equations in Self-similar variables31 Jan 2026
- 2025ANCHOR: Error-Controlled Adaptive Numerical Correction for Neural Operator Time Marching22 Dec 2025
- 2025Sensing Without Colocation: Operator-Based Virtual Instrumentation for Domains Beyond Physical Reach20 Oct 2025
- 2025Multimodal Neural Operators for Real-Time Biomechanical Modelling of Traumatic Brain Injury26 Sep 2025
- 2025Data-Efficient Time-Dependent PDE Surrogates: Graph Neural Simulators vs. Neural Operators7 Sep 2025
- 2025Physics-Informed Time-Integrated DeepONet: Temporal Tangent Space Operator Learning for High-Accuracy Inference7 Aug 2025
- 2025Enhanced accuracy through ensembling of randomly initialized auto-regressive models for time-dependent PDEs5 Jul 2025