mlsanityData to 7 Oct 2026

Autoregressive One-Step Generative Modeling for Dynamical System Forecasting

arXiv 2605.05540 ↗First posted 7 May 2026cs.LG physics.flu-dyncited by 0

Not on the map. Why?

Abstract (arXiv)

Fast surrogate modeling for high-dimensional physical dynamics requires more than low short-term error: useful models must roll out efficiently while preserving the statistical structure of long trajectories. Neural operators provide inexpensive autoregressive forecasts but can drift in turbulent regimes, whereas rolling diffusion and latent generative surrogates can represent stochastic transitions at the cost of multi-step denoising, noise-schedule design, or auxiliary compression models. We propose MeanFlow Long-term Invariant Spatiotemporal Consistency Autoregressive Models (MeLISA), a latent-free autoregressive generative surrogate built on pixel-space MeanFlow. MeLISA defines a blockwise stochastic transition kernel that generates each forecast block with a single model evaluation, avoiding latent encoders and iterative diffusion solvers at inference time. To stabilize long-horizon rollouts, MeLISA combines a Window-Consistency MeanFlow objective that learns conditional spatiotemporal generation from partially observed temporal windows with a Time Increment Consistency loss that constrains multi-lag finite increments and targets temporal-correlation structure. We evaluate MeLISA with compact UNet and scalable DiT backbones on two high-resolution benchmarks, extended 2D Kolmogorov flow at 256 × 256 and turbulent channel-flow slice at 192 × 192. MeLISA outperforms neural-operator baselines on short-term forecasting accuracy and long-horizon statistical metrics, including energy spectra, turbulent kinetic energy, and mixing-rate-related dynamics, while achieving inference speeds comparable to, and in some cases faster than, neural operators. To our knowledge, this is the first method for high-resolution one-step generation for physical dynamical systems with performance comparable to state-of-the-art deterministic surrogates.

Key facts. No citing papers in the map yet (data through 7 Oct 2026). Builds on 60 of its 80 references that are in the map. First posted on arXiv 7 May 2026.

Builds on

60 of 80 references.

References · 60

  1. 2020Denoising Diffusion Probabilistic Modelscited by 20,851
  2. 2020Score-Based Generative Modeling through Stochastic Differential Equationscited by 8,964
  3. 2021Masked Autoencoders Are Scalable Vision Learnerscited by 7,339
  4. 2022Scalable Diffusion Models with Transformerscited by 5,931
  5. 2022Flow Matching for Generative Modelingcited by 5,426
  6. 2021Improved Denoising Diffusion Probabilistic Modelscited by 3,736
  7. 2022Elucidating the Design Space of Diffusion-Based Generative Modelscited by 2,994
  8. 2020Fourier Neural Operator for Parametric Partial Differential Equationscited by 2,806
  9. 2023Stable Video Diffusion: Scaling Latent Video Diffusion Models to Large Datasetscited by 2,526
  10. 2019DeepONet: Learning nonlinear operators for identifying differential equations based on the universal approximation theorem of operatorscited by 1,965
  11. 2023Consistency Modelscited by 1,778
  12. 2022Null-text Inversion for Editing Real Images using Guided Diffusion Modelscited by 1,168
38 more
  1. 2023Self-Supervised Learning from Images with a Joint-Embedding Predictive Architecturecited by 982
  2. 2023Latent Consistency Models: Synthesizing High-Resolution Images with Few-Step Inferencecited by 826
  3. 2025Mean Flows for One-step Generative Modelingcited by 524
  4. 2021Machine learning accelerated computational fluid dynamicscited by 461
  5. 2018Shampoo: Preconditioned Stochastic Tensor Optimizationcited by 413
  6. 2023Simple diffusion: End-to-end diffusion for high resolution imagescited by 413
  7. 2025Muon is Scalable for LLM Trainingcited by 381
  8. 2024One Step Diffusion via Shortcut Modelscited by 373
  9. 2022Rectified Flow: A Marginal Preserving Approach to Optimal Transportcited by 277
  10. 2024Simplifying, Stabilizing and Scaling Continuous-Time Consistency Modelscited by 276
  11. 2022Diffusion Probabilistic Modeling for Video Generationcited by 237
  12. 2023SEINE: Short-to-Long Video Diffusion Model for Generative Transition and Predictioncited by 231
  13. 2022U-NO: U-shaped Neural Operatorscited by 219
  14. 2022Pangu-Weather: A 3D High-Resolution Model for Fast and Accurate Global Weather Forecastcited by 164
  15. 2022A Physics-informed Diffusion Model for High-fidelity Flow Field Reconstructioncited by 150
  16. 2024FIFO-Diffusion: Generating Infinite Videos from Text without Trainingcited by 134
  17. 2023AR-Diffusion: Auto-Regressive Diffusion Model for Text Generationcited by 113
  18. 2025Inductive Moment Matchingcited by 107
  19. 2023DYffusion: A Dynamics-informed Diffusion Model for Spatiotemporal Forecastingcited by 105
  20. 2021Deep Generative Learning via Schr"odinger Bridgecited by 103
  21. 2024Rolling Diffusion Modelscited by 102
  22. 2025Improved Mean Flows: On the Challenges of Fastforward Generative Modelscited by 102
  23. 2023PreDiff: Precipitation Nowcasting with Latent Diffusion Modelscited by 96
  24. 2023VideoLCM: Video Latent Consistency Modelcited by 90
  25. 2023Benchmarking Autoregressive Conditional Diffusion Models for Turbulent Flow Simulationcited by 65
  26. 2024Neural Operators with Localized Integral and Differential Kernelscited by 59
  27. 2023Generalized Teacher Forcing for Learning Chaotic Dynamicscited by 55
  28. 2023Towards Stability of Autoregressive Neural Operatorscited by 54
  29. 2026One-step Latent-free Image Generation with Pixel Mean Flowscited by 49
  30. 2022A Self-Attention Ansatz for Ab-initio Quantum Chemistrycited by 45
  31. 2023Training neural operators to preserve invariant measures of chaotic attractorscited by 43
  32. 2025AlphaFlow: Understanding and Improving MeanFlow Modelscited by 40
  33. 2024Integrating Neural Operators with Diffusion Models Improves Spectral Representation in Turbulence Modelingcited by 36
  34. 2024OSV: One Step is Enough for High-Quality Image to Video Generationcited by 36
  35. 2025Mitigating Spectral Bias in Neural Operators via High-Frequency Scaling for Physical Systemscited by 29
  36. 2024Generative AI for fast and accurate statistical computation of fluidscited by 28
  37. 2025Walrus: A Cross-Domain Foundation Model for Continuum Dynamicscited by 26
  38. 2018FermiNets: Learning generative machines to generate efficient neural networks via generative synthesiscited by 21

50 most cited of 60 All 60 (JSON)

Built on by

Not cited yet.