mlsanityData to 7 Oct 2026

One Scale at a Time: Scale-Autoregressive Modeling for Fluid Flow Distributions

arXiv 2604.11403 ↗First posted 13 Apr 2026cs.CE cs.AI physics.flu-dyncited by 0

On the map: Diffusion models → Flow matching, time series and science

Abstract (arXiv)

Analyzing unsteady fluid flows often requires access to the full distribution of possible temporal states, yet conventional PDE solvers are computationally prohibitive and learned time-stepping surrogates quickly accumulate error over long rollouts. Generative models avoid compounding error by sampling states independently, but diffusion and flow-matching methods, while accurate, are limited by the cost of many evaluations over the entire mesh. We introduce scale-autoregressive modeling (SAR) for sampling flows on unstructured meshes hierarchically from coarse to fine: it first generates a low-resolution field, then refines it by progressively sampling higher resolutions conditioned on coarser predictions. This coarse-to-fine factorization improves efficiency by concentrating computation at coarser scales, where uncertainty is greatest, while requiring fewer steps at finer scales. Across unsteady-flow benchmarks of varying complexity, SAR attains substantially lower distributional error and higher per-sample accuracy than state-of-the-art diffusion models based on multi-scale GNNs, while matching or surpassing a flow-matching Transolver (a linear-time transformer) yet running 2-7x faster than this depending on the task. Overall, SAR provides a practical tool for fast and accurate estimation of statistical flow quantities (e.g., turbulent kinetic energy and two-point correlations) in real-world settings.

Key facts. No citing papers in the map yet (data through 7 Oct 2026). Placed in Flow matching, time series and science, one of 14 directions in Diffusion models. Builds on 41 of its 62 references that are in the map. First posted on arXiv 13 Apr 2026.

Builds on

41 of 62 references.

Closest ancestors · 6

Same direction, newest first

  1. 2025Learning Distributions of Complex Fluid Simulations with Diffusion Graph Networks19 Mar
  2. 2023Uncertainty-aware Surrogate Models for Airfoil Flow Simulations with Denoising Diffusion Probabilistic Models8 Dec
  3. 2023PDE-Refiner: Achieving Accurate Long Rollouts with Neural PDE Solvers10 Aug
  4. 2023DYffusion: A Dynamics-informed Diffusion Model for Spatiotemporal Forecasting3 Jun
  5. 2022A Physics-informed Diffusion Model for High-fidelity Flow Field Reconstruction26 Nov
  6. 2022Flow Matching for Generative Modeling6 Oct

Other references · 35

  1. 2017Attention Is All You Needcited by 59,932
  2. 2020Denoising Diffusion Probabilistic Modelscited by 20,851
  3. 2021Diffusion Models Beat GANs on Image Synthesiscited by 8,185
  4. 2021Masked Autoencoders Are Scalable Vision Learnerscited by 7,339
  5. 2022Scalable Diffusion Models with Transformerscited by 5,931
  6. 2016Layer Normalizationcited by 5,579
  7. 2021Improved Denoising Diffusion Probabilistic Modelscited by 3,736
  8. 2020Taming Transformers for High-Resolution Image Synthesiscited by 3,229
  9. 2020Transformers are RNNs: Fast Autoregressive Transformers with Linear Attentioncited by 1,979
  10. 2019Generating Diverse High-Fidelity Images with VQ-VAE-2cited by 1,376
  11. 2018Relational inductive biases, deep learning, and graph networkscited by 1,341
  12. 2022MaskGIT: Masked Generative Image Transformercited by 1,082
23 more
  1. 2020Improved Techniques for Training Score-Based Generative Modelscited by 1,036
  2. 2024Visual Autoregressive Modeling: Scalable Image Generation via Next-Scale Predictioncited by 1,005
  3. 2020Learning to Simulate Complex Physics with Graph Networkscited by 867
  4. 2020Learning Mesh-Based Simulation with Graph Networkscited by 840
  5. 2022Autoregressive Image Generation using Residual Quantizationcited by 706
  6. 2024Autoregressive Image Generation without Vector Quantizationcited by 644
  7. 2017Self-Normalizing Neural Networkscited by 591
  8. 2016Interaction Networks for Learning about Objects, Relations and Physicscited by 503
  9. 2021Choose a Transformer: Fourier or Galerkincited by 333
  10. 2023GNOT: A General Neural Operator Transformer for Operator Learningcited by 321
  11. 2024Transolver: A Fast Transformer Solver for PDEs on General Geometriescited by 299
  12. 2022Transformer for Partial Differential Equations' Operator Learningcited by 270
  13. 2022MAGE: MAsked Generative Encoder to Unify Representation Learning and Image Synthesiscited by 222
  14. 2018Deep Fluids: A Generative Network for Parameterized Fluid Simulationscited by 121
  15. 2022MultiScale MeshGraphNetscited by 94
  16. 2021Learned Coarse Models for Efficient Turbulence Simulationcited by 90
  17. 2025Transolver++: An Accurate Neural Solver for PDEs on Million-Scale Geometriescited by 89
  18. 2025Geometry Aware Operator Transformer as an Efficient and Accurate Neural Surrogate for PDEs on Arbitrary Domainscited by 56
  19. 2025AB-UPT: Scaling Neural CFD Surrogates for High-Fidelity Automotive Aerodynamics Simulations via Anchored-Branched Universal Physics Transformerscited by 49
  20. 2023From Zero to Turbulence: Generative Modeling for 3D Flow Simulationcited by 46
  21. 2022Efficient Learning of Mesh-Based Physical Simulation with BSMS-GNNcited by 43
  22. 2025Energy-Based Transformers are Scalable Learners and Thinkerscited by 30
  23. 2021Generative Modeling of Turbulencecited by 26

Built on by

Not cited yet.

Similar, not cited

Close in wording, no citation either way

  1. 2025Autoregressive regularized score-based diffusion models for multi-scenarios fluid flow prediction
  2. 2023Benchmarking Autoregressive Conditional Diffusion Models for Turbulent Flow Simulation
  3. 2025Rectified Flows for Fast Multiscale Fluid Flow Modeling
  4. 2025Guiding diffusion models to reconstruct flow fields from sparse data
  5. 2026Uni-Flow: a unified autoregressive-diffusion model for complex multiscale flows
  6. 2024Generative AI for fast and accurate statistical computation of fluids
  7. 2026FluidFlow: a flow-matching generative model for fluid dynamics surrogates on unstructured meshes
  8. 2025Fine-Tuning Flow Matching via Maximum Likelihood Estimation of Reconstructions