Scale-Adaptive Generative Flows for Multiscale Scientific Data
Not on the map. Why?
Abstract (arXiv)
Flow-based generative models can face numerical challenges on scientific data with multiscale Fourier spectra, often producing large errors at fine scales. We approach this problem within the flow matching and stochastic interpolants framework, through the principled design of noise distributions and interpolation schedules. Working in function space ensures that the generative model remains well defined as the resolution is refined; the Lipschitz regularity of the drift is important to both this function-space well-posedness and the integration cost at fixed resolution. The central observation is that the noise should be at least as rough as the target distribution -- measured by Fourier-spectrum decay -- in order to keep the Lipschitz constant finite. For Gaussian and near-Gaussian targets whose fine-scale structure is known, matched-spectrum noise improves numerical efficiency over standard white-noise choices. For more complex non-Gaussian targets, matched-spectrum noise may not be sufficient, and we propose scale-adaptive interpolation schedules to mitigate the terminal-time stiffness that arises when the noise is rougher than the data. Numerical experiments on synthetic Gaussian random fields and on invariant measures of the stochastic Allen--Cahn and Navier--Stokes equations illustrate the approach and demonstrate its ability to generate high-fidelity samples at lower computational cost than traditional approaches.
Key facts. Cited by 5 papers in the map (data through 14 Oct 2026). Builds on 45 of its 65 references that are in the map. First posted on arXiv 3 Sep 2025.
Builds on
45 of 65 references.
References · 45
- 2020Denoising Diffusion Probabilistic Modelscited by 21,076
- 2020Score-Based Generative Modeling through Stochastic Differential Equationscited by 9,122
- 2021Diffusion Models Beat GANs on Image Synthesiscited by 8,255
- 2015Deep Unsupervised Learning using Nonequilibrium Thermodynamicscited by 7,058
- 2022Flow Matching for Generative Modelingcited by 5,702
- 2019Generative Modeling by Estimating Gradients of the Data Distributioncited by 4,101
- 2021Improved Denoising Diffusion Probabilistic Modelscited by 3,761
- 2022Flow Straight and Fast: Learning to Generate and Transfer Data with Rectified Flowcited by 3,700
- 2022Elucidating the Design Space of Diffusion-Based Generative Modelscited by 3,045
- 2020Fourier Neural Operator for Parametric Partial Differential Equationscited by 2,908
- 2022Video Diffusion Modelscited by 2,305
- 2019DeepONet: Learning nonlinear operators for identifying differential equations based on the universal approximation theorem of operatorscited by 2,018
33 more
- 2021Image Super-Resolution via Iterative Refinementcited by 1,511
- 2021Cascaded Diffusion Models for High Fidelity Image Generationcited by 1,163
- 2021Variational Diffusion Modelscited by 1,153
- 2022Diffusion Models: A Comprehensive Survey of Methods and Applicationscited by 1,114
- 2020Improved Techniques for Training Score-Based Generative Modelscited by 1,043
- 2022Building Normalizing Flows with Stochastic Interpolantscited by 995
- 2023Stochastic Interpolants: A Unifying Framework for Flows and Diffusionscited by 939
- 2022Sampling is as easy as learning the score: theory for diffusion models with minimal data assumptionscited by 445
- 2021Gotta Go Fast When Generating Data with Score-Based Modelscited by 219
- 2022Structure-based Drug Design with Equivariant Diffusion Modelscited by 217
- 2022Generative Modelling With Inverse Heat Dissipationcited by 167
- 2022Wavelet Diffusion Models are fast and scalable Image Generatorscited by 117
- 2021Noise Estimation for Generative Diffusion Modelscited by 94
- 2022Blurring Diffusion Modelscited by 91
- 2023Score-based Diffusion Models in Function Spacecited by 82
- 2022Subspace Diffusion Generative Modelscited by 70
- 2023Functional Flow Matchingcited by 67
- 2024Probabilistic Forecasting with Stochastic Interpolants and F"ollmer Processescited by 66
- 2022Wavelet Score-Based Generative Modelingcited by 62
- 2022Diffusion Generative Models in Infinite Dimensionscited by 49
- 2023Infinite-Dimensional Diffusion Modelscited by 39
- 2023Conditional score-based diffusion models for Bayesian inference in infinite dimensionscited by 38
- 2023Multilevel Diffusion: Infinite Dimensional Score-Based Diffusion Models for Image Generationcited by 37
- 2023Bespoke Solvers for Generative Flow Modelscited by 37
- 2020Wavelet Flow: Fast Training of High Resolution Normalizing Flowscited by 33
- 2022Spectral Diffusion Processescited by 25
- 2023∞-Diff: Infinite Resolution Diffusion with Subsampled Mollified Statescited by 21
- 2025FunDiff: Diffusion Models over Function Spaces for Physics-Informed Generative Modelingcited by 20
- 2023Gaussian Interpolation Flowscited by 17
- 2025Lipschitz-Guided Design of Interpolation Schedules in Generative Modelscited by 17
- 2023Renormalizing Diffusion Modelscited by 16
- 2025New affine invariant ensemble samplers and their dimensional scalingcited by 4
- 2024Hierarchic Flows to Estimate and Sample High-dimensional Probabilitiescited by 3
Built on by
Citing papers per year: 2026: 5.
5 papers.
- 2026Variational Optimality of F"ollmer Processes in Generative Diffusionscited by 1
- 2026Relative Entropy Estimation in Function Space: Theory and Applications to Trajectory Inferencecited by 1
- 2026The critical slowing down in training diffusion modelscited by 1
- 2026Discretization and Statistical Consistency of Functional Flow Matchingcited by 1
- 2026Scale-Recursive Rectified Flows for Few-Step Precipitation Ensemblescited by 0
- 2026Scale-Recursive Rectified Flows for Few-Step Precipitation Ensembles2 Oct 2026
- 2026Discretization and Statistical Consistency of Functional Flow Matching5 Aug 2026
- 2026The critical slowing down in training diffusion models12 May 2026
- 2026Relative Entropy Estimation in Function Space: Theory and Applications to Trajectory Inference22 Apr 2026
- 2026Variational Optimality of F"ollmer Processes in Generative Diffusions11 Feb 2026
Similar, not cited
Close in wording, no citation either way
- 2026Calibrating Generative Flows through Regional Probability Matching
- 2025FourierFlow: Frequency-aware Flow Matching for Generative Turbulence Modeling
- 2024Stochastic Flow Matching for Resolving Small-Scale Physics
- 2024Flow map matching with stochastic interpolants: A mathematical framework for consistency models
- 2026Beyond Random Couplings: Contrastive Noise Alignment in Generative Flows
- 2025Three Forms of Stochastic Injection for Improved Distribution-to-Distribution Generative Modeling
- 2025Physics-aware generative models for turbulent fluid flows through energy-consistent stochastic interpolants
- 2025Optimizing Noise Schedules of Generative Models in High Dimensionss