TANTE: Time-Adaptive Operator Learning via Neural Taylor Expansion
Not on the map. Why?
Abstract (arXiv)
Operator learning for time-dependent partial differential equations (PDEs) has seen rapid progress in recent years, enabling efficient approximation of complex spatiotemporal dynamics. However, most existing methods rely on fixed time step sizes during rollout, which limits their ability to adapt to varying temporal complexity and often leads to error accumulation. Here, we propose the Time-Adaptive Transformer with Neural Taylor Expansion (TANTE), a novel operator-learning framework that produces continuous-time predictions with adaptive step sizes. TANTE predicts future states by performing a Taylor expansion at the current state, where neural networks learn both the higher-order temporal derivatives and the local radius of convergence. This allows the model to dynamically adjust its rollout based on the local behavior of the solution, thereby reducing cumulative error and improving computational efficiency. We demonstrate the effectiveness of TANTE across a wide range of PDE benchmarks, achieving superior accuracy and adaptability compared to fixed-step baselines, delivering accuracy gains of 60-80 % and speed-ups of 30-40 % at inference time. The code is publicly available at https://github.com/zwu88/TANTE for transparency and reproducibility.
Key facts. Cited by 8 papers in the map (data through 14 Oct 2026). Builds on 43 of its 75 references that are in the map. First posted on arXiv 12 Feb 2025.
Builds on
43 of 75 references.
References · 43
- 2017Attention Is All You Needcited by 60,361
- 2020End-to-End Object Detection with Transformerscited by 7,414
- 2022A ConvNet for the 2020scited by 3,579
- 2020Fourier Neural Operator for Parametric Partial Differential Equationscited by 2,908
- 2017FiLM: Visual Reasoning with a General Conditioning Layercited by 2,333
- 2019DeepONet: Learning nonlinear operators for identifying differential equations based on the universal approximation theorem of operatorscited by 2,018
- 2018Attention U-Net: Learning Where to Look for the Pancreascited by 1,435
- 2022FourCastNet: A Global Data-driven High-resolution Weather Model using Adaptive Fourier Neural Operatorscited by 776
- 2020Neural Operator: Graph Kernel Network for Partial Differential Equationscited by 734
- 2021Characterizing possible failure modes in physics-informed neural networkscited by 643
- 2021Learning the solution operator of parametric partial differential equations with physics-informed DeepOnetscited by 540
- 2021Physics-Informed Neural Operator for Learning Partial Differential Equationscited by 527
31 more
- 2021Neural Operator: Learning Maps Between Function Spacescited by 414
- 2019Machine Learning for Fluid Mechanicscited by 385
- 2020Multipole Graph Neural Operator for Parametric Partial Differential Equationscited by 349
- 2021Choose a Transformer: Fourier or Galerkincited by 343
- 2023GNOT: A General Neural Operator Transformer for Operator Learningcited by 336
- 2024Transolver: A Fast Transformer Solver for PDEs on General Geometriescited by 326
- 2023Geometry-Informed Neural Operator for Large-Scale 3D PDEscited by 303
- 2021U-FNO -- An enhanced Fourier neural operator-based deep-learning model for multiphase flowcited by 297
- 2022Transformer for Partial Differential Equations' Operator Learningcited by 283
- 2021Adaptive Fourier Neural Operators: Efficient Token Mixers for Transformerscited by 248
- 2022U-NO: U-shaped Neural Operatorscited by 230
- 2023Convolutional Neural Operators for robust and accurate learning of PDEscited by 214
- 2024Poseidon: Efficient Foundation Models for PDEscited by 200
- 2022FourCastNet: Accelerating Global High-Resolution Weather Forecasting using Adaptive Fourier Neural Operatorscited by 188
- 2022MIONet: Learning multiple-input operators via tensor productcited by 181
- 2024DPOT: Auto-Regressive Denoising Operator Transformer for Large-Scale PDE Pre-Trainingcited by 151
- 2024The Well: a Large-Scale Collection of Diverse Physics Simulations for Machine Learningcited by 145
- 2023Scalable Transformer for PDE Surrogate Modelingcited by 128
- 2022Multifidelity deep neural operators for efficient learning of partial differential equations with application to fast inverse design of nanoscale heat transportcited by 92
- 2022Wavelet neural operator: a neural operator for parametric partial differential equationscited by 78
- 2023Multi-Grid Tensorized Fourier Neural Operator for High-Resolution PDEscited by 68
- 2023Fourier-DeepONet: Fourier-enhanced deep operator networks for full waveform inversion with improved accuracy, generalizability, and robustnesscited by 60
- 2024CViT: Continuous Vision Transformer for Operator Learningcited by 51
- 2023Fourier-MIONet: Fourier-enhanced multiple-input neural operators for multiphase modeling of geological carbon sequestrationcited by 46
- 2021One-shot learning for solution operators of partial differential equationscited by 30
- 2022Generic Lithography Modeling with Dual-band Optics-Inspired Neural Networkscited by 14
- 2023Fourier neural operator for real-time simulation of 3D dynamic urban microclimatecited by 12
- 2024Efficient and generalizable nested Fourier-DeepONet for three-dimensional geological carbon sequestrationcited by 11
- 2023Learning fast, accurate, and stable closures of a kinetic theory of an active fluidcited by 9
- 2023Developing a cost-effective emulator for groundwater flow modeling using deep neural operatorscited by 8
- 2024Micrometer: Micromechanics Transformer for Predicting Mechanical Responses of Heterogeneous Materialscited by 5
Built on by
Citing papers per year: 2025: 4; 2026: 4.
8 papers.
- 2025Lost in Latent Space: An Empirical Study of Latent Diffusion Models for Physics Emulationcited by 19
- 2025PI-MFM: Physics-informed multimodal foundation model for solving partial differential equationscited by 7
- 2025A Two-Phase Deep Learning Framework for Adaptive Time-Stepping in High-Speed Flow Modelingcited by 3
- 2026On the training of physics-informed neural operators for solving parametric partial differential equationscited by 1
- 2025ANCHOR: Error-Controlled Adaptive Numerical Correction for Neural Operator Time Marchingcited by 0
- 2026Fourier Neural Operators for Rayleigh-B'enard Convectioncited by 0
- 2026Local gradient neural operatorcited by 0
- 2026Learning When to Refine: Long-Horizon Reinforcement Learning for Budgeted Neural-Operator PDE Solverscited by 0
- 2026Learning When to Refine: Long-Horizon Reinforcement Learning for Budgeted Neural-Operator PDE Solvers19 Sep 2026
- 2026Local gradient neural operator7 Sep 2026
- 2026Fourier Neural Operators for Rayleigh-B'enard Convection2 Jul 2026
- 2026On the training of physics-informed neural operators for solving parametric partial differential equations4 Jun 2026
- 2025PI-MFM: Physics-informed multimodal foundation model for solving partial differential equations28 Dec 2025
- 2025ANCHOR: Error-Controlled Adaptive Numerical Correction for Neural Operator Time Marching22 Dec 2025
- 2025Lost in Latent Space: An Empirical Study of Latent Diffusion Models for Physics Emulation3 Jul 2025
- 2025A Two-Phase Deep Learning Framework for Adaptive Time-Stepping in High-Speed Flow Modeling9 Jun 2025