mlsanityData to 14 Oct 2026

FourierFlow: Frequency-aware Flow Matching for Generative Turbulence Modeling

arXiv 2506.00862 ↗First posted 1 Jun 2025cs.LGcited by 8

On the map: Diffusion models → Flow matching, time series and science

Abstract (arXiv)

Modeling complex fluid systems, especially turbulence governed by partial differential equations (PDEs), remains a fundamental challenge in science and engineering. Recently, diffusion-based generative models have gained attention as a powerful approach for these tasks, owing to their capacity to capture long-range dependencies and recover hierarchical structures. However, we present both empirical and theoretical evidence showing that generative models struggle with significant spectral bias and common-mode noise when generating high-fidelity turbulent flows. Here we propose FourierFlow, a novel generative turbulence modeling framework that enhances the frequency-aware learning by both implicitly and explicitly mitigating spectral bias and common-mode noise. FourierFlow comprises three key innovations. Firstly, we adopt a dual-branch backbone architecture, consisting of a salient flow attention branch with local-global awareness to focus on sensitive turbulence areas. Secondly, we introduce a frequency-guided Fourier mixing branch, which is integrated via an adaptive fusion strategy to explicitly mitigate spectral bias in the generative model. Thirdly, we leverage the high-frequency modeling capabilities of the masked auto-encoder pre-training and implicitly align the features of the generative model toward high-frequency components. We validate the effectiveness of FourierFlow on three canonical turbulent flow scenarios, demonstrating superior performance compared to state-of-the-art methods. Furthermore, we show that our model exhibits strong generalization capabilities in challenging settings such as out-of-distribution domains, long-term temporal extrapolation, and robustness to noisy inputs. The code can be found at https://github.com/AI4Science-WestlakeU/FourierFlow.

Key facts. Cited by 8 papers in the map (data through 14 Oct 2026). Placed in Flow matching, time series and science, one of 14 directions in Diffusion models. Builds on 37 of its 38 references that are in the map. First posted on arXiv 1 Jun 2025.

Builds on

37 of 38 references.

Closest ancestors · 7

Same direction, newest first

  1. 2025Mitigating Spectral Bias in Neural Operators via High-Frequency Scaling for Physical Systems17 Mar
  2. 2024On conditional diffusion models for PDE simulations21 Oct
  3. 2024Integrating Neural Operators with Diffusion Models Improves Spectral Representation in Turbulence Modeling13 Sep
  4. 2024DiffusionPDE: Generative PDE-Solving Under Partial Observation25 Jun
  5. 2023DYffusion: A Dynamics-informed Diffusion Model for Spatiotemporal Forecasting3 Jun
  6. 2022Flow Matching for Generative Modeling6 Oct
  7. 2022Flow Straight and Fast: Learning to Generate and Transfer Data with Rectified Flow7 Sep

Other references · 30

  1. 2017Attention Is All You Needcited by 60,361
  2. 2020An Image is Worth 16x16 Words: Transformers for Image Recognition at Scalecited by 30,186
  3. 2020Denoising Diffusion Probabilistic Modelscited by 21,076
  4. 2021High-Resolution Image Synthesis with Latent Diffusion Modelscited by 18,863
  5. 2020Denoising Diffusion Implicit Modelscited by 9,781
  6. 2023DINOv2: Learning Robust Visual Features without Supervisioncited by 7,974
  7. 2022Scalable Diffusion Models with Transformerscited by 6,054
  8. 2022Classifier-Free Diffusion Guidancecited by 5,847
  9. 2021RoFormer: Enhanced Transformer with Rotary Position Embeddingcited by 4,703
  10. 2024Scaling Rectified Flow Transformers for High-Resolution Image Synthesiscited by 4,181
  11. 2019Generative Modeling by Estimating Gradients of the Data Distributioncited by 4,101
  12. 2020Fourier Neural Operator for Parametric Partial Differential Equationscited by 2,908
18 more
  1. 2022Video Diffusion Modelscited by 2,305
  2. 2021ViViT: A Video Vision Transformercited by 1,620
  3. 2023Stochastic Interpolants: A Unifying Framework for Flows and Diffusionscited by 939
  4. 2024SiT: Exploring Flow and Diffusion-based Generative Models with Scalable Interpolant Transformerscited by 737
  5. 2024Representation Alignment for Generation: Training Diffusion Transformers Is Easier Than You Thinkcited by 703
  6. 2022Is Conditional Generative Modeling all you need for Decision-Making?cited by 516
  7. 2022PDEBENCH: An Extensive Benchmark for Scientific Machine Learningcited by 413
  8. 2022Transformer for Partial Differential Equations' Operator Learningcited by 283
  9. 2021Factorized Fourier Neural Operatorscited by 249
  10. 2021Adaptive Fourier Neural Operators: Efficient Token Mixers for Transformerscited by 248
  11. 2023Reduce, Reuse, Recycle: Compositional Generation with Energy-Based Diffusion Models and MCMCcited by 220
  12. 2025Open-Sora 2.0: Training a Commercial-Level Video Generation Model in 200kcited by 163
  13. 2024DPOT: Auto-Regressive Denoising Operator Transformer for Large-Scale PDE Pre-Trainingcited by 151
  14. 2024The Well: a Large-Scale Collection of Diverse Physics Simulations for Machine Learningcited by 145
  15. 2023What Do Self-Supervised Vision Transformers Learn?cited by 93
  16. 2024Recent Advances on Machine Learning for Computational Fluid Dynamics: A Surveycited by 28
  17. 2024Your Diffusion Model is Secretly a Certifiably Robust Classifiercited by 24
  18. 2022Masked Contrastive Pre-Training for Efficient Video-Text Retrievalcited by 11

Built on by

Cited by year (2026 to 14 Oct)

Citing papers per year: 2026: 8.

8 papers.

Similar, not cited

Close in wording, no citation either way

  1. 2026Optimal-Transport-Guided Functional Flow Matching for Turbulent Field Generation in Hilbert Space
  2. 2026Spectrally Regularized Latent Flow Matching for Turbulence Generation
  3. 2025Physics-aware generative models for turbulent fluid flows through energy-consistent stochastic interpolants
  4. 2025Scale-Adaptive Generative Flows for Multiscale Scientific Data
  5. 2023Turbulence Scaling from Deep Learning Diffusion Generative Models
  6. 2024Generative AI for fast and accurate statistical computation of fluids
  7. 2023Bayesian Conditional Diffusion Models for Versatile Spatiotemporal Turbulence Generation
  8. 2025Lazy Diffusion: Mitigating spectral collapse in generative diffusion-based stable autoregressive emulation of turbulent flows