FourierFlow: Frequency-aware Flow Matching for Generative Turbulence Modeling
On the map: Diffusion models → Flow matching, time series and science
Abstract (arXiv)
Modeling complex fluid systems, especially turbulence governed by partial differential equations (PDEs), remains a fundamental challenge in science and engineering. Recently, diffusion-based generative models have gained attention as a powerful approach for these tasks, owing to their capacity to capture long-range dependencies and recover hierarchical structures. However, we present both empirical and theoretical evidence showing that generative models struggle with significant spectral bias and common-mode noise when generating high-fidelity turbulent flows. Here we propose FourierFlow, a novel generative turbulence modeling framework that enhances the frequency-aware learning by both implicitly and explicitly mitigating spectral bias and common-mode noise. FourierFlow comprises three key innovations. Firstly, we adopt a dual-branch backbone architecture, consisting of a salient flow attention branch with local-global awareness to focus on sensitive turbulence areas. Secondly, we introduce a frequency-guided Fourier mixing branch, which is integrated via an adaptive fusion strategy to explicitly mitigate spectral bias in the generative model. Thirdly, we leverage the high-frequency modeling capabilities of the masked auto-encoder pre-training and implicitly align the features of the generative model toward high-frequency components. We validate the effectiveness of FourierFlow on three canonical turbulent flow scenarios, demonstrating superior performance compared to state-of-the-art methods. Furthermore, we show that our model exhibits strong generalization capabilities in challenging settings such as out-of-distribution domains, long-term temporal extrapolation, and robustness to noisy inputs. The code can be found at https://github.com/AI4Science-WestlakeU/FourierFlow.
Key facts. Cited by 8 papers in the map (data through 14 Oct 2026). Placed in Flow matching, time series and science, one of 14 directions in Diffusion models. Builds on 37 of its 38 references that are in the map. First posted on arXiv 1 Jun 2025.
Builds on
37 of 38 references.
Closest ancestors · 7
Same direction, newest first
- 2025Mitigating Spectral Bias in Neural Operators via High-Frequency Scaling for Physical Systems17 Mar
- 2024On conditional diffusion models for PDE simulations21 Oct
- 2024Integrating Neural Operators with Diffusion Models Improves Spectral Representation in Turbulence Modeling13 Sep
- 2024DiffusionPDE: Generative PDE-Solving Under Partial Observation25 Jun
- 2023DYffusion: A Dynamics-informed Diffusion Model for Spatiotemporal Forecasting3 Jun
- 2022Flow Matching for Generative Modeling6 Oct
- 2022Flow Straight and Fast: Learning to Generate and Transfer Data with Rectified Flow7 Sep
Other references · 30
- 2017Attention Is All You Needcited by 60,361
- 2020An Image is Worth 16x16 Words: Transformers for Image Recognition at Scalecited by 30,186
- 2020Denoising Diffusion Probabilistic Modelscited by 21,076
- 2021High-Resolution Image Synthesis with Latent Diffusion Modelscited by 18,863
- 2020Denoising Diffusion Implicit Modelscited by 9,781
- 2023DINOv2: Learning Robust Visual Features without Supervisioncited by 7,974
- 2022Scalable Diffusion Models with Transformerscited by 6,054
- 2022Classifier-Free Diffusion Guidancecited by 5,847
- 2021RoFormer: Enhanced Transformer with Rotary Position Embeddingcited by 4,703
- 2024Scaling Rectified Flow Transformers for High-Resolution Image Synthesiscited by 4,181
- 2019Generative Modeling by Estimating Gradients of the Data Distributioncited by 4,101
- 2020Fourier Neural Operator for Parametric Partial Differential Equationscited by 2,908
18 more
- 2022Video Diffusion Modelscited by 2,305
- 2021ViViT: A Video Vision Transformercited by 1,620
- 2023Stochastic Interpolants: A Unifying Framework for Flows and Diffusionscited by 939
- 2024SiT: Exploring Flow and Diffusion-based Generative Models with Scalable Interpolant Transformerscited by 737
- 2024Representation Alignment for Generation: Training Diffusion Transformers Is Easier Than You Thinkcited by 703
- 2022Is Conditional Generative Modeling all you need for Decision-Making?cited by 516
- 2022PDEBENCH: An Extensive Benchmark for Scientific Machine Learningcited by 413
- 2022Transformer for Partial Differential Equations' Operator Learningcited by 283
- 2021Factorized Fourier Neural Operatorscited by 249
- 2021Adaptive Fourier Neural Operators: Efficient Token Mixers for Transformerscited by 248
- 2023Reduce, Reuse, Recycle: Compositional Generation with Energy-Based Diffusion Models and MCMCcited by 220
- 2025Open-Sora 2.0: Training a Commercial-Level Video Generation Model in 200kcited by 163
- 2024DPOT: Auto-Regressive Denoising Operator Transformer for Large-Scale PDE Pre-Trainingcited by 151
- 2024The Well: a Large-Scale Collection of Diverse Physics Simulations for Machine Learningcited by 145
- 2023What Do Self-Supervised Vision Transformers Learn?cited by 93
- 2024Recent Advances on Machine Learning for Computational Fluid Dynamics: A Surveycited by 28
- 2024Your Diffusion Model is Secretly a Certifiably Robust Classifiercited by 24
- 2022Masked Contrastive Pre-Training for Efficient Video-Text Retrievalcited by 11
Built on by
Citing papers per year: 2026: 8.
8 papers.
- 2026FlowRefiner: Flow Matching-Based Iterative Refinement for 3D Turbulent Flow Simulationcited by 5
- 2026FluidFlow: a flow-matching generative model for fluid dynamics surrogates on unstructured meshescited by 3
- 2026MOSAIC: Modular Orchestration for Structured Agentic Intelligence and Compositioncited by 2
- 2026A Physics-Informed Fourier-Wavelet Transformer for Multiscale Computational Fluid Dynamics Surrogate Modelingcited by 2
- 2026Recovering Physical Dynamics from Discrete Observations via Intrinsic Differential Consistencycited by 1
- 2026Parallel Complex Diffusion for Scalable Time Series Generationcited by 0
- 2026Wavelet Flow Matching for Multi-Scale Physics Emulationcited by 0
- 2026Low-Pass Flow Matchingcited by 0
- 2026A Physics-Informed Fourier-Wavelet Transformer for Multiscale Computational Fluid Dynamics Surrogate Modeling23 Jun 2026
- 2026Low-Pass Flow Matching1 Jun 2026
- 2026MOSAIC: Modular Orchestration for Structured Agentic Intelligence and Composition30 May 2026
- 2026Wavelet Flow Matching for Multi-Scale Physics Emulation15 May 2026
- 2026Recovering Physical Dynamics from Discrete Observations via Intrinsic Differential Consistency8 May 2026
- 2026FlowRefiner: Flow Matching-Based Iterative Refinement for 3D Turbulent Flow Simulation18 Apr 2026
- 2026FluidFlow: a flow-matching generative model for fluid dynamics surrogates on unstructured meshes30 Mar 2026
- 2026Parallel Complex Diffusion for Scalable Time Series Generation10 Feb 2026
Similar, not cited
Close in wording, no citation either way
- 2026Optimal-Transport-Guided Functional Flow Matching for Turbulent Field Generation in Hilbert Space
- 2026Spectrally Regularized Latent Flow Matching for Turbulence Generation
- 2025Physics-aware generative models for turbulent fluid flows through energy-consistent stochastic interpolants
- 2025Scale-Adaptive Generative Flows for Multiscale Scientific Data
- 2023Turbulence Scaling from Deep Learning Diffusion Generative Models
- 2024Generative AI for fast and accurate statistical computation of fluids
- 2023Bayesian Conditional Diffusion Models for Versatile Spatiotemporal Turbulence Generation
- 2025Lazy Diffusion: Mitigating spectral collapse in generative diffusion-based stable autoregressive emulation of turbulent flows