WeatherSyn: An Instruction Tuning MLLM For Weather Forecasting Report Generation
Not on the map. Why?
Abstract (arXiv)
Accurate weather forecast reporting enables individuals and communities to better plan daily activities and agricultural operations. However, the current reporting process primarily relies on manual analysis of multi-source data, which leads to information overload and reduced efficiency. With the development of multimodal large language models (MLLMs), leveraging data-driven models to analyze and generate reports in the weather forecasting domain remains largely underexplored. In this work, we propose the Weather Forecasting Report (WFR) task and construct the first instruction-tuning dataset for this task, named~DatasetNameL, which covers 31 cities in America and 8 weather aspects. Based on this corpus, we develop the first model, ModelNameL, specialized in generating weather forecast reports. Evaluation across multiple metrics on our dataset shows that ModelNameL~ consistently outperforms leading closed-source MLLMs, particularly on structurally complex weather aspects. We further analyze its performance across diverse geographic regions and weather aspects. ModelNameL~ demonstrates strong transferability across different regions, highlighting its zero-shot generalization capability. ModelNameL~offers valuable insight for developing MLLMs specialized in weather report generation. .
Key facts. Cited by 1 paper in the map (data through 14 Oct 2026). Builds on 20 of its 35 references that are in the map. First posted on arXiv 8 May 2026.
Builds on
20 of 35 references.
References · 20
- 2019Sentence-BERT: Sentence Embeddings using Siamese BERT-Networkscited by 9,170
- 2023LLaVA-Med: Training a Large Language-and-Vision Assistant for Biomedicine in One Daycited by 1,305
- 2022FourCastNet: A Global Data-driven High-resolution Weather Model using Adaptive Fourier Neural Operatorscited by 776
- 2023Med-Flamingo: a Multimodal Medical Few-shot Learnercited by 392
- 2023GeoChat: Grounded Large Vision-Language Model for Remote Sensingcited by 328
- 2022GraphCast: Learning skillful medium-range global weather forecastingcited by 267
- 2023FuXi: A cascade machine learning forecasting system for 15-day global weather forecastcited by 241
- 2024EarthGPT: A Universal Multi-modal Large Language Model for Multi-sensor Image Comprehension in Remote Sensing Domaincited by 184
- 2023PreDiff: Precipitation Nowcasting with Latent Diffusion Modelscited by 98
- 2024VHM: Versatile and Honest Vision Language Model for Remote Sensing Image Analysiscited by 86
- 2023Breaking Language Barriers in Multilingual Mathematical Reasoning: Insights and Observationscited by 59
- 2024ChaosBench: A Multi-Channel, Physics-Based Benchmark for Subseasonal-to-Seasonal Climate Predictioncited by 43
8 more
- 2024WeatherQA: Can Multimodal Language Models Reason about Severe Weather?cited by 22
- 2024CLLMate: A Multimodal Benchmark for Weather and Climate Events Forecastingcited by 20
- 2023Digital Typhoon: Long-term Satellite Image Dataset for the Spatio-Temporal Modeling of Tropical Cyclonescited by 19
- 2025CirT: Global Subseasonal-to-Seasonal Forecasting with Geometry-inspired Transformercited by 14
- 2025OmniEarth-Bench: Towards Holistic Evaluation of Earth's Six Spheres and Cross-Spheres Interactions with Multimodal Observational Earth Datacited by 14
- 2025Chain of Execution Supervision Promotes General Reasoning in Large Language Modelscited by 4
- 2025TianQuan-S2S: A Subseasonal-to-Seasonal Global Weather Model via Incorporate Climatology Statecited by 3
- 2025Mesh Interpolation Graph Network for Dynamic and Spatially Irregular Global Weather Forecastingcited by 3
Built on by
Citing papers per year: 2026: 1.
1 paper.
Similar, not cited
Close in wording, no citation either way
- 2026SynopticBench: Evaluating Vision-Language Models on Generating Weather Forecast Discussions of the Future
- 2026AFDBench: A Reasoning-First AI Scientist for NationalWeather Service Forecast Discussions
- 2025RadarQA: Multi-modal Quality Analysis of Weather Radar Forecasts
- 2025ClimateLLM: Efficient Weather Forecasting via Frequency-Aware Large Language Models
- 2025ClimaEmpact: Domain-Aligned Small Language Models and Datasets for Extreme Weather Analytics
- 2025MeteorPred: A Meteorological Multimodal Large Model and Dataset for Severe Weather Event Prediction
- 2025Zephyrus: An Agentic Framework for Weather Science
- 2025Hierarchical AI-Meteorologist: LLM-Agent System for Multi-Scale and Explainable Weather Forecast Reporting