mlsanityData to 14 Oct 2026

TANTE: Time-Adaptive Operator Learning via Neural Taylor Expansion

arXiv 2502.08574 ↗First posted 12 Feb 2025cs.LG cs.AIcited by 8

Not on the map. Why?

Abstract (arXiv)

Operator learning for time-dependent partial differential equations (PDEs) has seen rapid progress in recent years, enabling efficient approximation of complex spatiotemporal dynamics. However, most existing methods rely on fixed time step sizes during rollout, which limits their ability to adapt to varying temporal complexity and often leads to error accumulation. Here, we propose the Time-Adaptive Transformer with Neural Taylor Expansion (TANTE), a novel operator-learning framework that produces continuous-time predictions with adaptive step sizes. TANTE predicts future states by performing a Taylor expansion at the current state, where neural networks learn both the higher-order temporal derivatives and the local radius of convergence. This allows the model to dynamically adjust its rollout based on the local behavior of the solution, thereby reducing cumulative error and improving computational efficiency. We demonstrate the effectiveness of TANTE across a wide range of PDE benchmarks, achieving superior accuracy and adaptability compared to fixed-step baselines, delivering accuracy gains of 60-80 % and speed-ups of 30-40 % at inference time. The code is publicly available at https://github.com/zwu88/TANTE for transparency and reproducibility.

Key facts. Cited by 8 papers in the map (data through 14 Oct 2026). Builds on 43 of its 75 references that are in the map. First posted on arXiv 12 Feb 2025.

Builds on

43 of 75 references.

References · 43

  1. 2017Attention Is All You Needcited by 60,361
  2. 2020End-to-End Object Detection with Transformerscited by 7,414
  3. 2022A ConvNet for the 2020scited by 3,579
  4. 2020Fourier Neural Operator for Parametric Partial Differential Equationscited by 2,908
  5. 2017FiLM: Visual Reasoning with a General Conditioning Layercited by 2,333
  6. 2019DeepONet: Learning nonlinear operators for identifying differential equations based on the universal approximation theorem of operatorscited by 2,018
  7. 2018Attention U-Net: Learning Where to Look for the Pancreascited by 1,435
  8. 2022FourCastNet: A Global Data-driven High-resolution Weather Model using Adaptive Fourier Neural Operatorscited by 776
  9. 2020Neural Operator: Graph Kernel Network for Partial Differential Equationscited by 734
  10. 2021Characterizing possible failure modes in physics-informed neural networkscited by 643
  11. 2021Learning the solution operator of parametric partial differential equations with physics-informed DeepOnetscited by 540
  12. 2021Physics-Informed Neural Operator for Learning Partial Differential Equationscited by 527
31 more
  1. 2021Neural Operator: Learning Maps Between Function Spacescited by 414
  2. 2019Machine Learning for Fluid Mechanicscited by 385
  3. 2020Multipole Graph Neural Operator for Parametric Partial Differential Equationscited by 349
  4. 2021Choose a Transformer: Fourier or Galerkincited by 343
  5. 2023GNOT: A General Neural Operator Transformer for Operator Learningcited by 336
  6. 2024Transolver: A Fast Transformer Solver for PDEs on General Geometriescited by 326
  7. 2023Geometry-Informed Neural Operator for Large-Scale 3D PDEscited by 303
  8. 2021U-FNO -- An enhanced Fourier neural operator-based deep-learning model for multiphase flowcited by 297
  9. 2022Transformer for Partial Differential Equations' Operator Learningcited by 283
  10. 2021Adaptive Fourier Neural Operators: Efficient Token Mixers for Transformerscited by 248
  11. 2022U-NO: U-shaped Neural Operatorscited by 230
  12. 2023Convolutional Neural Operators for robust and accurate learning of PDEscited by 214
  13. 2024Poseidon: Efficient Foundation Models for PDEscited by 200
  14. 2022FourCastNet: Accelerating Global High-Resolution Weather Forecasting using Adaptive Fourier Neural Operatorscited by 188
  15. 2022MIONet: Learning multiple-input operators via tensor productcited by 181
  16. 2024DPOT: Auto-Regressive Denoising Operator Transformer for Large-Scale PDE Pre-Trainingcited by 151
  17. 2024The Well: a Large-Scale Collection of Diverse Physics Simulations for Machine Learningcited by 145
  18. 2023Scalable Transformer for PDE Surrogate Modelingcited by 128
  19. 2022Multifidelity deep neural operators for efficient learning of partial differential equations with application to fast inverse design of nanoscale heat transportcited by 92
  20. 2022Wavelet neural operator: a neural operator for parametric partial differential equationscited by 78
  21. 2023Multi-Grid Tensorized Fourier Neural Operator for High-Resolution PDEscited by 68
  22. 2023Fourier-DeepONet: Fourier-enhanced deep operator networks for full waveform inversion with improved accuracy, generalizability, and robustnesscited by 60
  23. 2024CViT: Continuous Vision Transformer for Operator Learningcited by 51
  24. 2023Fourier-MIONet: Fourier-enhanced multiple-input neural operators for multiphase modeling of geological carbon sequestrationcited by 46
  25. 2021One-shot learning for solution operators of partial differential equationscited by 30
  26. 2022Generic Lithography Modeling with Dual-band Optics-Inspired Neural Networkscited by 14
  27. 2023Fourier neural operator for real-time simulation of 3D dynamic urban microclimatecited by 12
  28. 2024Efficient and generalizable nested Fourier-DeepONet for three-dimensional geological carbon sequestrationcited by 11
  29. 2023Learning fast, accurate, and stable closures of a kinetic theory of an active fluidcited by 9
  30. 2023Developing a cost-effective emulator for groundwater flow modeling using deep neural operatorscited by 8
  31. 2024Micrometer: Micromechanics Transformer for Predicting Mechanical Responses of Heterogeneous Materialscited by 5

Built on by

Cited by year (2026 to 14 Oct)

Citing papers per year: 2025: 4; 2026: 4.

8 papers.