Memory-Conditioned Flow-Matching for Stable Autoregressive PDE Rollouts
On the map: Diffusion models → Flow matching, time series and science
Abstract (arXiv)
Autoregressive generative PDE solvers can be accurate one step ahead yet drift over long rollouts, especially in coarse-to-fine regimes where each step must regenerate unresolved fine scales. This is the regime of diffusion and flow-matching generators: although their internal dynamics are Markovian, rollout stability is governed by per-step conditional law errors. Using the Mori--Zwanzig projection formalism, we show that eliminating unresolved variables yields an exact resolved evolution with a Markov term, a memory term, and an orthogonal forcing, exposing a structural limitation of memoryless closures. Motivated by this, we introduce memory-conditioned diffusion/flow-matching with a compact online state injected into denoising via latent features. Via disintegration, memory induces a structured conditional tail prior for unresolved scales and reduces the transport needed to populate missing frequencies. We prove Wasserstein stability of the resulting conditional kernel. We then derive discrete Gr"onwall rollout bounds that separate memory approximation from conditional generation error. Experiments on compressible flows with shocks and multiscale mixing show improved accuracy and markedly more stable long-horizon rollouts, with better fine-scale spectral and statistical fidelity.
Key facts. Cited by 2 papers in the map (data through 14 Oct 2026). Placed in Flow matching, time series and science, one of 14 directions in Diffusion models. Builds on 20 of its 28 references that are in the map. First posted on arXiv 6 Feb 2026.
Builds on
20 of 28 references.
Closest ancestors · 5
Same direction, newest first
- 2025Rectified Flows for Fast Multiscale Fluid Flow Modeling3 Jun
- 2024Rectified Diffusion: Straightness Is Not Your Need in Rectified Flow9 Oct
- 2024Generative AI for fast and accurate statistical computation of fluids27 Sep
- 2023Improving and generalizing flow-based generative models with minibatch optimal transport1 Feb
- 2022Flow Matching for Generative Modeling6 Oct
Other references · 15
- 2022Photorealistic Text-to-Image Diffusion Models with Deep Language Understandingcited by 6,355
- 2023Mamba: Linear-Time Sequence Modeling with Selective State Spacescited by 4,718
- 2020Fourier Neural Operator for Parametric Partial Differential Equationscited by 2,908
- 2021Efficiently Modeling Long Sequences with Structured State Spacescited by 2,465
- 2023Stochastic Interpolants: A Unifying Framework for Flows and Diffusionscited by 939
- 2022FourCastNet: A Global Data-driven High-resolution Weather Model using Adaptive Fourier Neural Operatorscited by 776
- 2022PDEBENCH: An Extensive Benchmark for Scientific Machine Learningcited by 413
- 2023Resurrecting Recurrent Neural Networks for Long Sequencescited by 408
- 2022Message Passing Neural PDE Solverscited by 386
- 2019Deep Lagrangian Networks: Using Physics as Model Prior for Deep Learningcited by 212
- 2022Mega: Moving Average Equipped Gated Attentioncited by 179
- 2022Multi-resolution partial differential equations preserved learning framework for spatiotemporal dynamicscited by 44
Built on by
Citing papers per year: 2026: 2.
2 papers.
Similar, not cited
Close in wording, no citation either way
- 2025Generative Latent Neural PDE Solver using Flow Matching
- 2023Benchmarking Autoregressive Conditional Diffusion Models for Turbulent Flow Simulation
- 2025Operator Flow Matching for Timeseries Forecasting
- 2026Bias-Constrained Diffusion Schedules for PDE Emulations: Reconstruction Error Minimization and Efficient Unrolled Training
- 2026A Unified Measure-Theoretic View of Diffusion, Score-Based, and Flow Matching Generative Models
- 2025Theoretical Guarantees for High Order Trajectory Refinement in Generative Flows
- 2026Memory-Conditioned Diffusion Model for Generalized Langevin Dynamics
- 2026Autoregression-Free Neural Operators for Time-Dependent PDEs