mlsanityData to 7 Oct 2026

Generative Latent Neural PDE Solver using Flow Matching

arXiv 2503.22600 ↗First posted 28 Mar 2025cs.LG cs.AIcited by 28

On the map: Diffusion models → Flow matching, time series and science

Abstract (arXiv)

Autoregressive next-step prediction models have become the de-facto standard for building data-driven neural solvers to forecast time-dependent partial differential equations (PDEs). Denoise training that is closely related to diffusion probabilistic model has been shown to enhance the temporal stability of neural solvers, while its stochastic inference mechanism enables ensemble predictions and uncertainty quantification. In principle, such training involves sampling a series of discretized diffusion timesteps during both training and inference, inevitably increasing computational overhead. In addition, most diffusion models apply isotropic Gaussian noise on structured, uniform grids, limiting their adaptability to irregular domains. We propose a latent diffusion model for PDE simulation that embeds the PDE state in a lower-dimensional latent space, which significantly reduces computational costs. Our framework uses an autoencoder to map different types of meshes onto a unified structured latent grid, capturing complex geometries. By analyzing common diffusion paths, we propose to use a coarsely sampled noise schedule from flow matching for both training and testing. Numerical experiments show that the proposed model outperforms several deterministic baselines in both accuracy and long-term stability, highlighting the potential of diffusion-based approaches for robust data-driven PDE learning.

Key facts. Cited by 28 papers in the map (data through 7 Oct 2026). Placed in Flow matching, time series and science, one of 14 directions in Diffusion models. Builds on 68 of its 105 references that are in the map. First posted on arXiv 28 Mar 2025.

Builds on

68 of 105 references.

Closest ancestors · 11

Same direction, newest first

  1. 2025Learning Distributions of Complex Fluid Simulations with Diffusion Graph Networks19 Mar
  2. 2024On conditional diffusion models for PDE simulations21 Oct
  3. 2024Text2PDE: Latent Diffusion Models for Accessible Physics Simulation2 Oct
  4. 2024DiffusionPDE: Generative PDE-Solving Under Partial Observation25 Jun
  5. 2023Uncertainty-aware Surrogate Models for Airfoil Flow Simulations with Denoising Diffusion Probabilistic Models8 Dec
  6. 2023Benchmarking Autoregressive Conditional Diffusion Models for Turbulent Flow Simulation4 Sep
  7. 2023PDE-Refiner: Achieving Accurate Long Rollouts with Neural PDE Solvers10 Aug
  8. 2023Synthetic Lagrangian Turbulence by Generative Diffusion Models17 Jul
  9. 2022A Physics-informed Diffusion Model for High-fidelity Flow Field Reconstruction26 Nov
  10. 2022Flow Matching for Generative Modeling6 Oct
  11. 2022Flow Straight and Fast: Learning to Generate and Transfer Data with Rectified Flow7 Sep

Other references · 57

  1. 2014Adam: A Method for Stochastic Optimizationcited by 36,960
  2. 2020Denoising Diffusion Probabilistic Modelscited by 20,851
  3. 2015U-Net: Convolutional Networks for Biomedical Image Segmentationcited by 19,604
  4. 2020Denoising Diffusion Implicit Modelscited by 9,655
  5. 2020Score-Based Generative Modeling through Stochastic Differential Equationscited by 8,964
  6. 2015Deep Unsupervised Learning using Nonequilibrium Thermodynamicscited by 7,005
  7. 2019Generative Modeling by Estimating Gradients of the Data Distributioncited by 4,067
  8. 2020Fourier Neural Operator for Parametric Partial Differential Equationscited by 2,806
  9. 2019DeepONet: Learning nonlinear operators for identifying differential equations based on the universal approximation theorem of operatorscited by 1,965
  10. 2022DPM-Solver: A Fast ODE Solver for Diffusion Probabilistic Model Sampling in Around 10 Stepscited by 1,961
  11. 2022Diffusion Posterior Sampling for General Noisy Inverse Problemscited by 1,375
  12. 2018On the Spectral Bias of Neural Networkscited by 1,321
38 more
  1. 2020Learning to Simulate Complex Physics with Graph Networkscited by 867
  2. 2020Learning Mesh-Based Simulation with Graph Networkscited by 840
  3. 2020Neural Operator: Graph Kernel Network for Partial Differential Equationscited by 722
  4. 2021Learning the solution operator of parametric partial differential equations with physics-informed DeepOnetscited by 537
  5. 2022Fast Sampling of Diffusion Models with Exponential Integratorcited by 526
  6. 2017Deep learning for universal linear embeddings of nonlinear dynamicscited by 491
  7. 2020Multipole Graph Neural Operator for Parametric Partial Differential Equationscited by 343
  8. 2021Choose a Transformer: Fourier or Galerkincited by 333
  9. 2023GNOT: A General Neural Operator Transformer for Operator Learningcited by 321
  10. 2023Common Diffusion Noise Schedules and Sample Steps are Flawedcited by 308
  11. 2024Transolver: A Fast Transformer Solver for PDEs on General Geometriescited by 299
  12. 2023Geometry-Informed Neural Operator for Large-Scale 3D PDEscited by 293
  13. 2022Transformer for Partial Differential Equations' Operator Learningcited by 270
  14. 2021Modern Koopman Theory for Dynamical Systemscited by 269
  15. 2022GraphCast: Learning skillful medium-range global weather forecastingcited by 261
  16. 2023Efficient Diffusion Training via Min-SNR Weighting Strategycited by 242
  17. 2021Multiwavelet-based Operator Learning for Differential Equationscited by 229
  18. 2023Neural Operators for Accelerating Scientific Simulations and Designcited by 218
  19. 2023Convolutional Neural Operators for robust and accurate learning of PDEscited by 207
  20. 2022Towards Multi-spatiotemporal-scale Generalized PDE Modelingcited by 190
  21. 2023GenCast: Diffusion-based ensemble forecasting for medium-range weathercited by 169
  22. 2024The Well: a Large-Scale Collection of Diverse Physics Simulations for Machine Learningcited by 134
  23. 2016Accelerating Eulerian Fluid Simulation With Convolutional Networkscited by 128
  24. 2023Towards Foundation Models for Scientific Machine Learning: Characterizing Scaling and Transfer Behaviorcited by 128
  25. 2023Scalable Transformer for PDE Surrogate Modelingcited by 123
  26. 2018Latent-space Physics: Towards Learning the Temporal Evolution of Fluid Flowcited by 97
  27. 2023Multiple Physics Pretraining for Physical Surrogate Modelscited by 90
  28. 2022Physics-Informed Machine Learning: A Survey on Problems, Methods and Applicationscited by 88
  29. 2020Multiscale Simulations of Complex Systems by Learning their Effective Dynamicscited by 86
  30. 2022Predicting Physics in Mesh-reduced Space with Temporal Attentioncited by 82
  31. 2023Operator Learning with Neural Fields: Tackling PDEs on General Geometriescited by 80
  32. 2022Continuous PDE Dynamics Forecasting with Implicit Neural Representationscited by 71
  33. 2023Multi-Grid Tensorized Fourier Neural Operator for High-Resolution PDEscited by 66
  34. 2022CROM: Continuous Reduced-Order Modeling of PDEs Using Implicit Neural Representationscited by 56
  35. 2023Eagle: Large-Scale Learning of Turbulent Fluid Dynamics with Mesh Transformerscited by 54
  36. 2023Towards Stability of Autoregressive Neural Operatorscited by 54
  37. 2023From Zero to Turbulence: Generative Modeling for 3D Flow Simulationcited by 46
  38. 2022Neural Implicit Flow: a mesh-agnostic dimensionality reduction paradigm of spatio-temporal datacited by 37

50 most cited of 57 All 57 (JSON)

Built on by

Cited by year (2026 to 7 Oct)

Citing papers per year: 2025: 11; 2026: 17.

28 papers.

Sort:

By area:

  1. 2025Lost in Latent Space: An Empirical Study of Latent Diffusion Models for Physics Emulationcited by 19
  2. 2025Towards High-Order Mean Flow Generative Models: Feasibility, Expressivity, and Provably Efficient Criteriacited by 5
  3. 2026D-Flow SGLD: Source-Space Posterior Sampling for Scientific Inverse Problems with Flow Matchingcited by 5
  4. 2026Particle-Guided Diffusion Models for Partial Differential Equationscited by 4
  5. 2026Flow Learners for PDEs: Toward a Physics-to-Physics Paradigm for Scientific Computingcited by 4
  6. 2026FlowRefiner: Flow Matching-Based Iterative Refinement for 3D Turbulent Flow Simulationcited by 4
  7. 2025Surrogate Modeling of 3D Rayleigh-Benard Convection with Equivariant Autoencoderscited by 3
  8. 2025Flow marching for a generative PDE foundation modelcited by 3
  9. 2025Reframing Generative Models for Physical Systems using Stochastic Interpolantscited by 2
  10. 2025Efficient Generative Transformer Operators For Million-Point PDEscited by 2
  11. 2025Residual-augmented flow matching operators for probabilistic partial differential equationscited by 2
  12. 2026Flow Matching and Diffusion Models via PointNet for Generating Fluid Fields on Irregular Geometriescited by 2
16 more
  1. 2026Latent Generative Solvers for Generalizable Long-Term Physics Simulationcited by 2
  2. 2025EquiReg: Equivariance Regularized Diffusion for Inverse Problemscited by 1
  3. 2025Efficient probabilistic surrogate modeling techniques for partially-observed large-scale dynamical systemscited by 1
  4. 2026Neural-HSS: Hierarchical Semi-Separable Neural PDE Solvercited by 1
  5. 2026Di-BiLPS: Denoising induced Bidirectional Latent-PDE-Solver under Sparse Observationscited by 1
  6. 2025Hamiltonian Neural PDE Solvers through Functional Approximationcited by 0
  7. 2025GeoFunFlow: Geometric Function Flow Matching for Inverse Operator Learning over Complex Geometriescited by 0
  8. 2026Generative Neural Operators through Diffusion Last Layercited by 0
  9. 2026PerFlow: Physics-Embedded Rectified Flow for Efficient Reconstruction and Uncertainty Quantification of Spatiotemporal Dynamicscited by 0
  10. 2026Recovering Physical Dynamics from Discrete Observations via Intrinsic Differential Consistencycited by 0
  11. 2026Wavelet Flow Matching for Multi-Scale Physics Emulationcited by 0
  12. 2026Learning to Discretize: Diffusion-Based Adaptive Mesh with Spectral Guidancecited by 0
  13. 2026Round-Trip Consistency: Bidirectional Diffusion Models Can Predict Their Own Rollout Errorscited by 0
  14. 2026Composing Flow-Matching Energies with Known Physics: Generation, OOD Detection, and Inversion on PDE Fieldscited by 0
  15. 2026FLARE: Flow Matching with Local Axis-Angle Representations for Stochastic Micromagnetic Evolutioncited by 0
  16. 2026Cross-Domain Pretraining for Steady-State Neural CFD Surrogatescited by 0

Similar, not cited

Close in wording, no citation either way

  1. 2026Bias-Constrained Diffusion Schedules for PDE Emulations: Reconstruction Error Minimization and Efficient Unrolled Training
  2. 2026Memory-Conditioned Flow-Matching for Stable Autoregressive PDE Rollouts
  3. 2024Diffusion models as probabilistic neural operators for recovering unobserved states of dynamical systems
  4. 2025Autoregressive regularized score-based diffusion models for multi-scenarios fluid flow prediction
  5. 2026Divergence-Free Diffusion Models for Incompressible Fluid Flows
  6. 2026Autoregression-Free Neural Operators for Time-Dependent PDEs
  7. 2025Operator Flow Matching for Timeseries Forecasting
  8. 2026Latent Diffusion Posterior Sampling with Surrogate Likelihood Guidance for PDE Inverse Problems