PuYun-LDM: A Latent Diffusion Model for High-Resolution Ensemble Weather Forecasts
On the map: Diffusion models → Flow matching, time series and science
Abstract (arXiv)
Latent diffusion models (LDMs) suffer from limited diffusability in high-resolution (<=0.25deg) ensemble weather forecasting, where diffusability characterizes how easily a latent data distribution can be modeled by a diffusion process. Unlike natural image fields, meteorological fields lack task-agnostic foundation models and explicit semantic structures, making VFM-based regularization inapplicable. Moreover, existing frequency-based approaches impose identical spectral regularization across channels under a homogeneity assumption, which leads to uneven regularization strength under the inter-variable spectral heterogeneity in multivariate meteorological data. To address these challenges, we propose a 3D Masked AutoEncoder (3D-MAE) that encodes weather-state evolution features as an additional conditioning for the diffusion model, together with a Variable-Aware Masked Frequency Modeling (VA-MFM) strategy that adaptively selects thresholds based on the spectral energy distribution of each variable. Together, we propose PuYun-LDM, which enhances latent diffusability and achieves superior performance to ENS at short lead times while remaining comparable to ENS at longer horizons. PuYun-LDM generates a 15-day global forecast with a 6-hour temporal resolution in five minutes on a single NVIDIA H200 GPU, while ensemble forecasts can be efficiently produced in parallel.
Key facts. No citing papers in the map yet (data through 7 Oct 2026). Placed in Flow matching, time series and science, one of 14 directions in Diffusion models. Builds on 29 of its 47 references that are in the map. First posted on arXiv 12 Feb 2026.
Builds on
29 of 47 references.
Closest ancestors · 2
Same direction, newest first
- 2025OmniCast: A Masked Latent Diffusion Model for Weather Forecasting Across Time Scales20 Oct
- 2025LaDCast: A Latent Diffusion Model for Medium-Range Ensemble Weather Forecasting10 Jun
Other references · 27
- 2021High-Resolution Image Synthesis with Latent Diffusion Modelscited by 18,694
- 2021Masked Autoencoders Are Scalable Vision Learnerscited by 7,339
- 2022Scalable Diffusion Models with Transformerscited by 5,931
- 2021RoFormer: Enhanced Transformer with Rotary Position Embeddingcited by 4,581
- 2024Scaling Rectified Flow Transformers for High-Resolution Image Synthesiscited by 4,094
- 2022Elucidating the Design Space of Diffusion-Based Generative Modelscited by 2,994
- 2025Wan: Open and Advanced Large-Scale Video Generative Modelscited by 2,536
- 2020GLU Variants Improve Transformercited by 1,724
- 2019Root Mean Square Layer Normalizationcited by 1,425
- 2024Representation Alignment for Generation: Training Diffusion Transformers Is Easier Than You Thinkcited by 666
- 2025Reconstruction vs. Generation: Taming Optimization Dilemma in Latent Diffusion Modelscited by 376
- 2022GraphCast: Learning skillful medium-range global weather forecastingcited by 261
15 more
- 2023FuXi: A cascade machine learning forecasting system for 15-day global weather forecastcited by 237
- 2023WeatherBench 2: A benchmark for the next generation of data-driven global weather modelscited by 227
- 2024Deep Compression Autoencoder for Efficient High-Resolution Diffusion Modelscited by 209
- 2023GenCast: Diffusion-based ensemble forecasting for medium-range weathercited by 169
- 2022Pangu-Weather: A 3D High-Resolution Model for Fast and Accurate Global Weather Forecastcited by 164
- 2025DDT: Decoupled Diffusion Transformercited by 100
- 2025EQ-VAE: Equivariance Regularized Latent Space for Improved Generative Image Modelingcited by 85
- 2025Improving the Diffusability of Autoencoderscited by 74
- 2025A Fourier Space Perspective on Diffusion Modelscited by 48
- 2025DC-AE 1.5: Accelerating Diffusion Model Convergence with Structured Latent Spacecited by 44
- 2025Alias-Free Latent Diffusion Models: Improving Fractional Shift Equivariance of Diffusion Latent Spacecited by 14
- 2024Computational Tradeoffs in Image Synthesis: Diffusion, Masked-Token, and Next-Token Predictioncited by 13
- 2025Decoupling High and Low Frequencies for Faithful Image Generation with Fine Detailscited by 7
- 2025Toward Diffusible High-Dimensional Latent Spaces: A Frequency Perspectivecited by 7
- 2025Denoising Vision Transformer Autoencoder with Spectral Self-Regularizationcited by 4
Built on by
Not cited yet.
Similar, not cited
Close in wording, no citation either way
- 2025Data-Efficient Ensemble Weather Forecasting with Diffusion Models
- 2026Universal Diffusion-Based Probabilistic Downscaling
- 2026Downscaling weather forecasts from Low- to High-Resolution with Diffusion Models
- 2024Continuous Ensemble Weather Forecasting with Diffusion models
- 2024Latent Diffusion Model for Generating Ensembles of Climate Simulations
- 2025STLDM: Spatio-Temporal Latent Diffusion Model for Precipitation Nowcasting
- 2024DiffDA: a Diffusion Model for Weather-scale Data Assimilation
- 2025DEF: Diffusion-augmented Ensemble Forecasting