mlsanityData to 14 Oct 2026

Tropical Cyclone Forecasting via Latent Rectified Flow using Satellite Imagery and Atmospheric Fields

arXiv 2608.08354 ↗First posted 8 Aug 2026cs.CVcited by 0

Not on the map. Why?

Abstract (arXiv)

Tropical cyclones are growing more destructive in a changing climate, and efficient forecasting of their structure and track has become a necessity. Deep generative models promise an alternative to computationally expensive numerical weather prediction (NWP), yet current systems produce either satellite imagery or atmospheric fields, never both; they need many sampling steps, putting them out of reach of modest hardware; and their storm tracks come from regression heads with no physical link to the generated atmosphere. This work presents a single-pass model that jointly forecasts GRIDSAT-B1 infrared imagery and four ERA5 atmospheric fields (U-wind, V-wind, air temperature, and surface pressure) out to nine hours. A five-channel variational autoencoder compresses each 5 x 256 x 256 frame to a 4 x 64 x 64 latent, and a conditional rectified-flow UNet with a factorized temporal-attention module predicts the next three frames from three past frames, their best-track coordinates, and timestamps. The model is then reward-fine-tuned (DRaFT) against a differentiable track error derived from the predicted winds through a steering-flow calculation. On held-out 2022 storms the model reaches 16.35 dB PSNR and 0.759 SSIM, ahead of a reproduced cascaded-diffusion baseline at every lead time (+0.84 dB at +9 h) while sampling ~30x faster (56 ms vs. 1673 ms). Track error at +9 h is 62.4 km, 15% below the baseline, and a reward fine-tuning study demonstrates a further 8-11% track-error reduction across sampler budgets.

Key facts. No citing papers in the map yet (data through 14 Oct 2026). Builds on 11 of its 20 references that are in the map. First posted on arXiv 8 Aug 2026.

Builds on

11 of 20 references.

References · 11

  1. 2020Denoising Diffusion Probabilistic Modelscited by 21,076
  2. 2021High-Resolution Image Synthesis with Latent Diffusion Modelscited by 18,863
  3. 2022Flow Straight and Fast: Learning to Generate and Transfer Data with Rectified Flowcited by 3,700
  4. 2025Flow-GRPO: Training Flow Matching Models via Online RLcited by 661
  5. 2023Directly Fine-Tuning Diffusion Models on Differentiable Rewardscited by 448
  6. 2023Forecasting Tropical Cyclones with Cascaded Diffusion Modelscited by 10
  7. 2024Global Tropical Cyclone Intensity Forecasting with Multi-modal Multi-scale Causal Autoregressive Modelcited by 9
  8. 2024TCP-Diffusion: A Multi-modal Diffusion Model for Global Tropical Cyclone Precipitation Forecasting with Change Awarenesscited by 4
  9. 2025Improving Tropical Cyclone Forecasting With Video Diffusion Modelscited by 3
  10. 2024Estimating Atmospheric Variables from Digital Typhoon Satellite Images via Conditional Denoising Diffusion Modelscited by 1
  11. 2026Diffusion Fine-tuning with Rewarded Moment Matching Distillationcited by 1

Built on by

Not cited yet.

Similar, not cited

Close in wording, no citation either way

  1. 2026Physics-Informed Diffusion Model for Generating Synthetic Extreme Rare Weather Events Data
  2. 2026Benchmarking Generative Models for Weather Data Assimilation on Real Station Observations
  3. 2024Kilometer-Scale Convection Allowing Model Emulation using Generative Diffusion Modeling
  4. 2026Marchuk: Efficient Global Weather Forecasting from Mid-Range to Sub-Seasonal Scales via Flow Matching
  5. 2025GAIA: A Foundation Model for Operational Atmospheric Dynamics
  6. 20263DTCR: Vortex-following generative reconstruction improves tropical cyclone intensity prediction from global AI weather forecasts
  7. 2026WIND: Weather Inverse Diffusion for Zero-Shot Atmospheric Modeling
  8. 2025Using Generative Models to Produce Realistic Populations of UK Windstorms