mlsanityData to 7 Oct 2026

Autoregression-Free Neural Operators for Time-Dependent PDEs

arXiv 2605.25413 ↗First posted 25 May 2026cs.LG cs.AI cs.NAcited by 2

Not on the map. Why?

Abstract (arXiv)

Neural operators learn mappings from function-dependent inputs to solutions, providing an effective framework for solving partial differential equations (PDEs). For time-dependent PDEs, existing methods typically perform long-horizon prediction through autoregressive rollout directly in high-dimensional physical field spaces, where each predicted state is recursively fed back as the input for the next step. Although effective for short-term prediction, this autoregressive rollout and the lack of continuous-time modeling lead to progressive error accumulation over long-horizon rollouts. In this work, we propose Autoregression-Free Neural Operators (AFNO), which map the time evolution of PDEs into a latent space and model continuous-time vector fields within it. AFNO uses flow matching to learn the latent vector field, thereby enabling continuous evolution over extended horizons, avoiding autoregressive rollout and capturing dynamics under varying parameter configurations through explicit conditioning on physical parameters. Theoretical analysis and extensive experiments on six PDEs demonstrate that AFNO improves long-horizon prediction stability and consistently reduces rollout errors compared with the baselines.

Key facts. Cited by 2 papers in the map (data through 7 Oct 2026). Builds on 43 of its 63 references that are in the map. First posted on arXiv 25 May 2026.

Builds on

43 of 63 references.

References · 43

  1. 2017Attention Is All You Needcited by 59,932
  2. 2015Deep Residual Learning for Image Recognitioncited by 51,809
  3. 2018BERT: Pre-training of Deep Bidirectional Transformers for Language Understandingcited by 40,204
  4. 2014Adam: A Method for Stochastic Optimizationcited by 36,960
  5. 2020Denoising Diffusion Probabilistic Modelscited by 20,851
  6. 2021High-Resolution Image Synthesis with Latent Diffusion Modelscited by 18,694
  7. 2022Generative Adversarial Networkscited by 5,603
  8. 2017Neural Discrete Representation Learningcited by 4,650
  9. 2023Mamba: Linear-Time Sequence Modeling with Selective State Spacescited by 4,616
  10. 2018Neural Ordinary Differential Equationscited by 3,733
  11. 2020Fourier Neural Operator for Parametric Partial Differential Equationscited by 2,806
  12. 2016Density estimation using Real NVPcited by 2,029
31 more
  1. 2016WaveNet: A Generative Model for Raw Audiocited by 1,710
  2. 2018Glow: Generative Flow with Invertible 1x1 Convolutionscited by 1,539
  3. 2022Diffusion Models in Vision: A Surveycited by 1,008
  4. 2015Scheduled Sampling for Sequence Prediction with Recurrent Neural Networkscited by 779
  5. 2020Neural Operator: Graph Kernel Network for Partial Differential Equationscited by 722
  6. 2022Scientific Machine Learning through Physics-Informed Neural Networks: Where we are and What's nextcited by 603
  7. 2021Physics-Informed Neural Operator for Learning Partial Differential Equationscited by 516
  8. 2022Fourier Neural Operator with Learned Deformations for PDEs on General Geometriescited by 416
  9. 2022PDEBENCH: An Extensive Benchmark for Scientific Machine Learningcited by 396
  10. 2022Message Passing Neural PDE Solverscited by 368
  11. 2023GNOT: A General Neural Operator Transformer for Operator Learningcited by 321
  12. 2022U-NO: U-shaped Neural Operatorscited by 219
  13. 2023Neural Operators for Accelerating Scientific Simulations and Designcited by 218
  14. 2023Convolutional Neural Operators for robust and accurate learning of PDEscited by 207
  15. 2019DeepMDP: Learning Continuous Latent Space Models for Representation Learningcited by 204
  16. 2019Towards Physics-informed Deep Learning for Turbulent Flow Predictioncited by 203
  17. 2023Flow Matching in Latent Spacecited by 155
  18. 2014A Tutorial on Principal Component Analysiscited by 139
  19. 2024Latent Neural Operator for Solving Forward and Inverse PDE Problemscited by 76
  20. 2022When Physics Meets Machine Learning: A Survey of Physics-Informed Machine Learningcited by 64
  21. 2019NeuPDE: Neural Network Based Ordinary and Partial Differential Equations for Modeling Time-Dependent Datacited by 42
  22. 2023Domain Agnostic Fourier Neural Operatorscited by 36
  23. 2022Deep Learning Methods for Partial Differential Equations and Related Parameter Identification Problemscited by 34
  24. 2022Partial Differential Equations Meet Deep Neural Networks: A Surveycited by 25
  25. 2023Rethinking materials simulations: Blending direct numerical simulations with neural operatorscited by 25
  26. 2024Mamba Neural Operator: Who Wins? Transformers vs. State-Space Models for PDEscited by 16
  27. 2025Recurrent Neural Operators: Stable Long-Term PDE Predictioncited by 15
  28. 2023WeditGAN: Few-Shot Image Generation via Latent Space Relocationcited by 12
  29. 2025Temporal Neural Operator for Modeling Time-Dependent Physical Phenomenacited by 8
  30. 2024FlowTurbo: Towards Real-time Flow-Based Image Generation with Velocity Refinercited by 6
  31. 2025FreqMoE: Dynamic Frequency Enhancement for Neural PDE Solverscited by 6

Built on by

Cited by year (2026 to 7 Oct)

Citing papers per year: 2026: 2.

2 papers.

Similar, not cited

Close in wording, no citation either way

  1. 2025CFO: Learning Continuous-Time PDE Dynamics via Flow-Matched Neural Operators
  2. 2025Merging Memory and Space: A State Space Neural Operator
  3. 2024On the Benefits of Memory for Modeling Time-Dependent PDEs
  4. 2023PDE-Refiner: Achieving Accurate Long Rollouts with Neural PDE Solvers
  5. 2025ENMA: Tokenwise Autoregression for Generative Neural PDE Operators
  6. 2025Generative Latent Neural PDE Solver using Flow Matching
  7. 2026Memory-Conditioned Flow-Matching for Stable Autoregressive PDE Rollouts
  8. 2026A Constitutive Markov Physics-Informed Neural Operator (MPNO) for Autoregressive Stability in Transient Dynamics