mlsanityData to 14 Oct 2026

TI-DeepONet: Learnable Time Integration for Stable Long-Term Extrapolation

arXiv 2505.17341 ↗First posted 22 May 2025cs.LGcited by 14

Not on the map. Why?

Abstract (arXiv)

Accurate temporal extrapolation remains a fundamental challenge for neural operators modeling dynamical systems, where predictions must extend far beyond the training horizon. Conventional DeepONet approaches rely on two limited paradigms: fixed-horizon rollouts, which predict full spatiotemporal solutions while ignoring temporal causality, and autoregressive schemes, which accumulate errors through sequential prediction. We introduce TI-DeepONet, a framework that integrates neural operators with adaptive numerical time-stepping to preserve the Markovian structure of dynamical systems while mitigating long-term error growth. Our method shifts the learning objective from direct state prediction to approximating instantaneous time-derivative fields, which are then integrated using standard numerical solvers. This naturally enables continuous-time prediction and allows the use of higher-order integrators at inference than those used in training, improving both efficiency and accuracy. We further propose TI(L)-DeepONet, which incorporates learnable coefficients for intermediate stages in multi-stage integration, adapting to solution-specific dynamics and enhancing fidelity. Across six canonical PDEs featuring chaotic, dissipative, dispersive, and high-dimensional behavior, TI(L)-DeepONet maeginally outperforms TI-DeepONet, and both achieve major reductions in relative L2 extrapolation error: about 96.3% compared to autoregressive methods and 83.6% compared to fixed-horizon approaches. Notably, both models maintain stable predictions over temporal domains nearly twice the training interval. This work establishes a physics-aware operator learning framework that bridges neural approximation with numerical analysis principles, addressing a key gap in long-term forecasting of complex physical systems.

Key facts. Cited by 14 papers in the map (data through 14 Oct 2026). Builds on 17 of its 31 references that are in the map. First posted on arXiv 22 May 2025.

Builds on

17 of 31 references.

References · 17

  1. 2018Neural Ordinary Differential Equationscited by 3,779
  2. 2020Fourier Neural Operator for Parametric Partial Differential Equationscited by 2,908
  3. 2019DeepONet: Learning nonlinear operators for identifying differential equations based on the universal approximation theorem of operatorscited by 2,018
  4. 2020Neural Operator: Graph Kernel Network for Partial Differential Equationscited by 734
  5. 2022U-NO: U-shaped Neural Operatorscited by 230
  6. 2023Convolutional Neural Operators for robust and accurate learning of PDEscited by 214
  7. 2021Long-time integration of parametric evolution equations with physics-informed DeepONetscited by 89
  8. 2023Sequential Deep Operator Networks (S-DeepONet) for Predicting Full-field Solutions Under Time-dependent Loadscited by 47
  9. 2021Learning Dissipative Dynamics in Chaotic Systemscited by 42
  10. 2022Applications of physics informed neural operatorscited by 33
  11. 2023Neural Operator Learning for Long-Time Integration in Dynamical Systems with Recurrent Neural Networkscited by 32
  12. 2024On the Benefits of Memory for Modeling Time-Dependent PDEscited by 31
5 more
  1. 2022Transfer Learning Enhanced DeepONet for Long-Time Prediction of Evolution Equationscited by 28
  2. 2023Improved generalization with deep neural operators for engineering systems: Path towards digital twincited by 19
  3. 2023A multi-fidelity deep operator network (DeepONet) for fusing simulation and monitoring data: Application to real-time settlement prediction during tunnel constructioncited by 12
  4. 2024Advanced Deep Operator Networks to Predict Multiphysics Solution Fields in Materials Processing and Additive Manufacturingcited by 12
  5. 2023Solving High-Dimensional Inverse Problems with Auxiliary Uncertainty via Operator Learning with Limited Datacited by 4

Built on by

Cited by year (2026 to 14 Oct)

Citing papers per year: 2025: 6; 2026: 8.

14 papers.

Sort:

By area: