The promising potential of vision language models for the generation of textual weather forecasts
On the map: Multimodal LLMs / vision-language models → Embodied and 3D vision-language models
Abstract (arXiv)
Despite the promising capability of multimodal foundation models, their application to the generation of meteorological products and services remains nascent. To accelerate aspiration and adoption, we explore the novel use of a vision language model for writing the iconic Shipping Forecast text directly from video-encoded gridded weather data. These early results demonstrate promising scalable technological opportunities for enhancing production efficiency and service innovation within the weather enterprise and beyond.
Key facts. No citing papers in the map yet (data through 14 Oct 2026). Placed in Embodied and 3D vision-language models, one of 16 directions in Multimodal LLMs / vision-language models. Builds on 3 of its 14 references that are in the map. First posted on arXiv 3 Dec 2025.
Builds on
3 of 14 references.
References · 3
- 2017Attention Is All You Needcited by 60,361
- 2019BERTScore: Evaluating Text Generation with BERTcited by 5,512
- 2025The Amazon Nova Family of Models: Technical Report and Model Cardcited by 41
Built on by
Not cited yet.
Similar, not cited
Close in wording, no citation either way
- 2026SynopticBench: Evaluating Vision-Language Models on Generating Weather Forecast Discussions of the Future
- 2025Exploring Multimodal AI Reasoning for Meteorological Forecasting from Skew-T Diagrams
- 2025Time-VLM: Exploring Multimodal Vision-Language Models for Augmented Time Series Forecasting
- 2024MM-Forecast: A Multimodal Approach to Temporal Event Forecasting with Large Language Models
- 2026Optimizing Multi-Agent Weather Captioning via Text Gradient Descent: A Training-Free Approach with Consensus-Aware Gradient Fusion
- 2025LangPrecip: Language-Aware Multimodal Precipitation Nowcasting
- 2025Teaching Time Series to See and Speak: Forecasting with Aligned Visual and Textual Perspectives
- 2026Image Synthesis as an Intermediate for Controllable Time Series Generation