mlsanityData to 14 Oct 2026

Control-Augmented Autoregressive Diffusion for Data Assimilation

arXiv 2510.06637 ↗First posted 8 Oct 2025cs.LG cs.AI cs.CVcited by 1

On the map: Diffusion models → Flow matching, time series and science

Abstract (arXiv)

Despite advances in test-time scaling and diffusion finetuning, guidance for Auto-Regressive Diffusion Models (ARDMs) remains underexplored. We introduce an amortized framework that augments a pretrained ARDM with an offline-trained controller. By previewing future rollouts, the controller learns stepwise corrections that anticipate observations under a terminal-cost objective, yielding a reusable policy for guided generation. Motivated by a stochastic optimal control view of ARDM trajectories, our method injects small controls within each denoising sub-step while staying close to the pretrained dynamics. We study this approach for dataassimilation (DA) in chaotic spatiotemporal partial differential equations (PDEs), where existing methods are often computationally expensive and susceptible to forecast drift under sparse observations. At inference, DA becomes a feed-forward rollout with on-the-fly corrections, achieving an order-of-magnitude speedup over strong diffusion-based baselines. Across two canonical PDEs and a compact ECMWF Reanalysis v5 (ERA5) pilot spanning six observation regimes, our method consistently improves stability and accuracy over state-of-the-art alternatives, with similar improvements observed in a larger-scale GenCast study.

Key facts. Cited by 1 paper in the map (data through 14 Oct 2026). Placed in Flow matching, time series and science, one of 14 directions in Diffusion models. Builds on 44 of its 63 references that are in the map. First posted on arXiv 8 Oct 2025.

Builds on

44 of 63 references.

Closest ancestors · 10

Same direction, newest first

  1. 2025PhyDA: Physics-Guided Diffusion Models for Data Assimilation in Atmospheric Systems19 May
  2. 2024On conditional diffusion models for PDE simulations21 Oct
  3. 2024Kilometer-Scale Convection Allowing Model Emulation using Generative Diffusion Modeling20 Aug
  4. 2024DiffDA: a Diffusion Model for Weather-scale Data Assimilation11 Jan
  5. 2023Precipitation Downscaling with Spatiotemporal Video Diffusion11 Dec
  6. 2023Bayesian Conditional Diffusion Models for Versatile Spatiotemporal Turbulence Generation14 Nov
  7. 2023Training-free Linear Image Inverses via Flows25 Sep
  8. 2023Residual Corrective Diffusion Modeling for Km-scale Atmospheric Downscaling24 Sep
  9. 2023PDE-Refiner: Achieving Accurate Long Rollouts with Neural PDE Solvers10 Aug
  10. 2023DYffusion: A Dynamics-informed Diffusion Model for Spatiotemporal Forecasting3 Jun

Other references · 34

  1. 2020Denoising Diffusion Probabilistic Modelscited by 21,076
  2. 2020Denoising Diffusion Implicit Modelscited by 9,781
  3. 2021Diffusion Models Beat GANs on Image Synthesiscited by 8,255
  4. 2015Deep Unsupervised Learning using Nonequilibrium Thermodynamicscited by 7,058
  5. 2019Generative Modeling by Estimating Gradients of the Data Distributioncited by 4,101
  6. 2022Diffusion Posterior Sampling for General Noisy Inverse Problemscited by 1,416
  7. 2022Scaling Laws for Reward Model Overoptimizationcited by 1,095
  8. 2023ImageReward: Learning and Evaluating Human Preferences for Text-to-Image Generationcited by 1,045
  9. 2022Denoising Diffusion Restoration Modelscited by 963
  10. 2023Language Model Beats Diffusion -- Tokenizer is Key to Visual Generationcited by 640
  11. 2025Self Forcing: Bridging the Train-Test Gap in Autoregressive Video Diffusioncited by 625
  12. 2023Directly Fine-Tuning Diffusion Models on Differentiable Rewardscited by 448
22 more
  1. 2022Diffusion Probabilistic Modeling for Video Generationcited by 238
  2. 2017Advances in Variational Inferencecited by 236
  3. 2024Adjoint Matching: Fine-tuning Flow and Diffusion Generative Models with Memoryless Stochastic Optimal Controlcited by 233
  4. 2025A General Framework for Inference-time Scaling and Steering of Diffusion Modelscited by 224
  5. 2024A Survey on Diffusion Models for Inverse Problemscited by 180
  6. 2023GenCast: Diffusion-based ensemble forecasting for medium-range weathercited by 177
  7. 2023Denoising Diffusion Samplerscited by 149
  8. 2023Improved sampling via learned diffusionscited by 104
  9. 2024Understanding Reinforcement Learning-Based Fine-Tuning of Diffusion Models: A Tutorial and Reviewcited by 98
  10. 2023Score-based Data Assimilationcited by 96
  11. 2025Inference-Time Alignment in Diffusion Models with Reward-Guided Generation: Tutorial and Reviewcited by 88
  12. 2022Lie Point Symmetry Data Augmentation for Neural PDE Solverscited by 77
  13. 2021Evolutional Deep Neural Networkcited by 50
  14. 2021Physics-Guided Deep Learning for Dynamical Systems: A Surveycited by 44
  15. 2024Heavy-Tailed Diffusion Modelscited by 40
  16. 2024Deep Generative Data Assimilation in Multimodal Settingcited by 29
  17. 2024Generative Data Assimilation of Sparse Weather Station Observations at Kilometer Scalescited by 27
  18. 2025Generative Uncertainty in Diffusion Modelscited by 23
  19. 2025Variational Control for Guidance in Diffusion Modelscited by 22
  20. 2018Inverse Problems and Data Assimilationcited by 18
  21. 2023A Complete Recipe for Diffusion Generative Modelscited by 17
  22. 2024Fast Samplers for Inverse Problems in Iterative Refinement Modelscited by 17

Built on by

Cited by year (2026 to 14 Oct)

Citing papers per year: 2026: 1.

1 paper.

Similar, not cited

Close in wording, no citation either way

  1. 2021Autoregressive Diffusion Models
  2. 2025NoiseAR: AutoRegressing Initial Noise Prior for Diffusion Models
  3. 2026SURGE: Approximation and Training Free Particle Filter for Diffusion Surrogate
  4. 2025FlowDAS: A Stochastic Interpolant-based Framework for Data Assimilation
  5. 2025Fast-ARDiff: An Entropy-informed Acceleration Framework for Continuous Space Autoregressive Generation
  6. 2025Thermalizer: Stable autoregressive neural emulation of spatiotemporal chaos
  7. 2024State-observation augmented diffusion model for nonlinear assimilation with unknown dynamics
  8. 2026Bias-Constrained Diffusion Schedules for PDE Emulations: Reconstruction Error Minimization and Efficient Unrolled Training