mlsanityData to 7 Oct 2026

Align-DA: Align Score-based Atmospheric Data Assimilation with Multiple Preferences

arXiv 2505.22008 ↗First posted 28 May 2025physics.ao-ph cs.LGcited by 5

On the map: Diffusion models → Flow matching, time series and science

also in 1 more
Abstract (arXiv)

Data assimilation (DA) aims to estimate the full state of a dynamical system by combining partial and noisy observations with a prior model forecast, commonly referred to as the background. In atmospheric applications, this problem is fundamentally ill-posed due to the sparsity of observations relative to the high-dimensional state space. Traditional methods address this challenge by simplifying background priors to regularize the solution, which are empirical and require continual tuning for application. Inspired by alignment techniques in text-to-image diffusion models, we propose Align-DA, which formulates DA as a generative process and uses reward signals to guide background priors, replacing manual tuning with data-driven alignment. Specifically, we train a score-based model in the latent space to approximate the background-conditioned prior, and align it using three complementary reward signals for DA: (1) assimilation accuracy, (2) forecast skill initialized from the assimilated state, and (3) physical adherence of the analysis fields. Experiments with multiple reward signals demonstrate consistent improvements in analysis quality across different evaluation metrics and observation-guidance strategies. These results show that preference alignment, implemented as a soft constraint, can automatically adapt complex background priors tailored to DA, offering a promising new direction for advancing the field.

Key facts. Cited by 5 papers in the map (data through 7 Oct 2026). Placed in Flow matching, time series and science, one of 14 directions in Diffusion models. Builds on 44 of its 73 references that are in the map. First posted on arXiv 28 May 2025.

Builds on

44 of 73 references.

Closest ancestors · 1

Same direction, newest first

  1. 2024DiffDA: a Diffusion Model for Weather-scale Data Assimilation11 Jan

Other references · 43

  1. 2020Denoising Diffusion Probabilistic Modelscited by 20,851
  2. 2022Training language models to follow instructions with human feedbackcited by 15,712
  3. 2021Swin Transformer: Hierarchical Vision Transformer using Shifted Windowscited by 12,082
  4. 2020Score-Based Generative Modeling through Stochastic Differential Equationscited by 8,964
  5. 2023Direct Preference Optimization: Your Language Model is Secretly a Reward Modelcited by 7,916
  6. 2015Deep Unsupervised Learning using Nonequilibrium Thermodynamicscited by 7,005
  7. 2022Scalable Diffusion Models with Transformerscited by 5,931
  8. 2017Decoupled Weight Decay Regularizationcited by 1,722
  9. 2022Diffusion Posterior Sampling for General Noisy Inverse Problemscited by 1,375
  10. 2022Scaling Laws for Reward Model Overoptimizationcited by 1,056
  11. 2023ImageReward: Learning and Evaluating Human Preferences for Text-to-Image Generationcited by 1,010
  12. 2023Pick-a-Pic: An Open Dataset of User Preferences for Text-to-Image Generationcited by 950
31 more
  1. 2023Training Diffusion Models with Reinforcement Learningcited by 939
  2. 2023Human Preference Score v2: A Solid Benchmark for Evaluating Human Preferences of Text-to-Image Synthesiscited by 847
  3. 2023Diffusion Model Alignment Using Direct Preference Optimizationcited by 767
  4. 2022FourCastNet: A Global Data-driven High-resolution Weather Model using Adaptive Fourier Neural Operatorscited by 748
  5. 2023DPOK: Reinforcement Learning for Fine-tuning Text-to-Image Diffusion Modelscited by 431
  6. 2023Aligning Text-to-Image Models using Human Feedbackcited by 418
  7. 2016Tutorial on Variational Autoencoderscited by 404
  8. 2023Human Preference Score: Better Aligning Text-to-Image Models with Human Preferencecited by 284
  9. 2020WeatherBench: A benchmark dataset for data-driven weather forecastingcited by 272
  10. 2023FuXi: A cascade machine learning forecasting system for 15-day global weather forecastcited by 237
  11. 2023WeatherBench 2: A benchmark for the next generation of data-driven global weather modelscited by 227
  12. 2023Score-based Data Assimilationcited by 91
  13. 2024Aesthetic Post-Training Diffusion Models from Generic Preferences with Step-by-step Preference Optimizationcited by 81
  14. 2023Machine learning with data assimilation and uncertainty quantification for dynamical systems: a reviewcited by 74
  15. 2020Combining data assimilation and machine learning to emulate a dynamical model from sparse and noisy observations: a case study with the Lorenz 96 modelcited by 72
  16. 2024PRDP: Proximal Reward Difference Prediction for Large-Scale Reward Finetuning of Diffusion Modelscited by 41
  17. 2020Combining data assimilation and machine learning to infer unresolved scale parametrisationcited by 40
  18. 2020Using machine learning to correct model error in data assimilation and forecast applicationscited by 40
  19. 2025Calibrated Multi-Preference Optimization for Aligning Diffusion Modelscited by 40
  20. 2021Latent Space Data Assimilation by using Deep Learningcited by 29
  21. 2024Deep Generative Data Assimilation in Multimodal Settingcited by 28
  22. 2024Generative Data Assimilation of Sparse Weather Station Observations at Kilometer Scalescited by 27
  23. 2024CRA5: Extreme Compression of ERA5 for Portable Global Climate and Weather Research via an Efficient Variational Transformercited by 22
  24. 2023Towards an end-to-end artificial intelligence driven global weather forecasting systemcited by 20
  25. 2024Fuxi-DA: A Generalized Deep Learning Data Assimilation Framework for Assimilating Satellite Observationscited by 18
  26. 2023Score-based Data Assimilation for a Two-Layer Quasi-Geostrophic Modelcited by 11
  27. 2024ADAF: An Artificial Intelligence Data Assimilation Framework for Weather Forecastingcited by 10
  28. 2024FNP: Fourier Neural Processes for Arbitrary-Resolution Data Assimilationcited by 8
  29. 2025BalancedDPO: Adaptive Multi-Metric Alignmentcited by 6
  30. 2024Data Assimilation in Chaotic Systems Using Deep Reinforcement Learningcited by 5
  31. 2020Reinforcement learning and Bayesian data assimilation for model-informed precision dosing in oncologycited by 2

Built on by

Cited by year (2026 to 7 Oct)

Citing papers per year: 2025: 3; 2026: 2.

5 papers.

Similar, not cited

Close in wording, no citation either way

  1. 2026Multimodal Spatiotemporal Atmospheric Data Assimilation with Latent Video Flow-matching
  2. 2026EnJoi: Ensemble Joint Score Filter for Generative Data Assimilation
  3. 2025Appa: Bending Weather Dynamics with Latent Diffusion Models for Global Data Assimilation
  4. 2026DAWIS: Data Assimilation with Windowed Inverse Sampling via Multitask Interpolants
  5. 2026Benchmarking Generative Models for Weather Data Assimilation on Real Station Observations
  6. 2025PhyDA: Physics-Guided Diffusion Models for Data Assimilation in Atmospheric Systems
  7. 2026A Unified Framework for Bayesian Data Assimilation with Generative Models and Observation Interpolants
  8. 2026Generative Atmospheric Super-Resolution from Heterogeneous In Situ Observations through Composable Interfaces