LangPrecip: Language-Aware Multimodal Precipitation Nowcasting
Not on the map. Why?
Abstract (arXiv)
Short-term precipitation nowcasting is an inherently uncertain and under-constrained spatiotemporal forecasting problem, especially for rapidly evolving and extreme weather events. Existing generative approaches rely primarily on visual conditioning, leaving future motion weakly constrained and ambiguous. We propose a language-aware multimodal nowcasting framework(LangPrecip) that treats meteorological text as a semantic motion constraint on precipitation evolution. By formulating nowcasting as a semantically constrained trajectory generation problem under the Rectified Flow paradigm, our method enables efficient and physically consistent integration of textual and radar information in latent space.We further introduce LangPrecip-160k, a large-scale multimodal dataset with 160k paired radar sequences and motion descriptions. Experiments on Swedish and MRMS datasets show consistent improvements over state-of-the-art methods, achieving over 60 % and 19% gains in heavy-rainfall CSI at an 80-minute lead time.
Key facts. Cited by 2 papers in the map (data through 14 Oct 2026). Builds on 32 of its 47 references that are in the map. First posted on arXiv 26 Dec 2025.
Builds on
32 of 47 references.
References · 32
- 2020Denoising Diffusion Probabilistic Modelscited by 21,076
- 2021High-Resolution Image Synthesis with Latent Diffusion Modelscited by 18,863
- 2018The Unreasonable Effectiveness of Deep Features as a Perceptual Metriccited by 11,177
- 2022Flow Matching for Generative Modelingcited by 5,702
- 2022Flow Straight and Fast: Learning to Generate and Transfer Data with Rectified Flowcited by 3,700
- 2022Scaling Instruction-Finetuned Language Modelscited by 3,024
- 2025Wan: Open and Advanced Large-Scale Video Generative Modelscited by 2,708
- 2024CogVideoX: Text-to-Video Diffusion Models with An Expert Transformercited by 2,261
- 2017The Kinetics Human Action Video Datasetcited by 1,909
- 2022Imagen Video: High Definition Video Generation with Diffusion Modelscited by 1,778
- 2022Make-A-Video: Text-to-Video Generation without Text-Video Datacited by 1,742
- 2023Align your Latents: High-Resolution Video Synthesis with Latent Diffusion Modelscited by 1,476
20 more
- 2015Convolutional LSTM Network: A Machine Learning Approach for Precipitation Nowcastingcited by 1,436
- 2021Frozen in Time: A Joint Video and Image Encoder for End-to-End Retrievalcited by 1,177
- 2018TSM: Temporal Shift Module for Efficient Video Understandingcited by 856
- 2024Open-Sora: Democratizing Efficient Video Production for Allcited by 652
- 2024Latte: Latent Diffusion Transformer for Video Generationcited by 546
- 2023LAVIE: High-Quality Video Generation with Cascaded Latent Diffusion Modelscited by 349
- 2023ClimaX: A foundation model for weather and climatecited by 337
- 2021Skillful Precipitation Nowcasting using Deep Generative Models of Radarcited by 311
- 2021Advancing High-Resolution Video-Language Representation with Large-Scale Video Transcriptionscited by 226
- 2025Open-Sora 2.0: Training a Commercial-Level Video Generation Model in 200kcited by 163
- 2022Earthformer: Exploring Space-Time Transformers for Earth System Forecastingcited by 152
- 2023PreDiff: Precipitation Nowcasting with Latent Diffusion Modelscited by 98
- 2023DiffCast: A Unified Framework via Residual Diffusion for Precipitation Nowcastingcited by 61
- 2024ChaosBench: A Multi-Channel, Physics-Based Benchmark for Subseasonal-to-Seasonal Climate Predictioncited by 43
- 2024Fourier Amplitude and Correlation Loss: Beyond Using L2 Loss for Skillful Precipitation Nowcastingcited by 16
- 2024PostCast: Generalizable Postprocessing for Precipitation Nowcasting via Unsupervised Blurriness Modelingcited by 10
- 2025Satellite Observations Guided Diffusion Model for Accurate Meteorological States at Arbitrary Resolutioncited by 9
- 2024Precipitation Nowcasting Using Diffusion Transformer with Causal Attentioncited by 6
- 2024Two-stage Rainfall-Forecasting Diffusion Modelcited by 4
- 2025Probability calibration for precipitation nowcastingcited by 1
Built on by
Citing papers per year: 2026: 2.
2 papers.
Similar, not cited
Close in wording, no citation either way
- 2025RainDiff: End-to-end Precipitation Nowcasting Via Token-wise Attention Diffusion
- 2025SimCast: Enhancing Precipitation Nowcasting with Short-to-Long Term Knowledge Distillation
- 2025SynCast: Synergizing Contradictions in Precipitation Nowcasting via Diffusion Sequential Preference Optimization
- 2024GPTCast: a weather language model for precipitation nowcasting
- 2026PixelFlowCast: Latent-Free Precipitation Nowcasting via Pixel Mean Flows
- 2026NowcastDiT: Diffusion Transformers are Effective Precipitation Nowcasters
- 2025FlowCast: Advancing Precipitation Nowcasting with Conditional Flow Matching
- 2026Extreme Weather Nowcasting via Local Precipitation Pattern Prediction