# SIREN: Towards End-to-End Extreme-Weather Early Warning with Experience-Grounded LLM Agents

arXiv: https://arxiv.org/abs/2607.24588 · HTML: https://mlsanity.com/paper/2607.24588/

## Key facts

- Cited by 2 papers in the map (data through 14 Oct 2026).
- Placed in Financial trading and forecasting agents, one of 16 directions in LLM agents and tool use.
- Builds on 10 of its 42 references that are in the map.
- First posted on arXiv 27 Jul 2026.

## Placed in

- LLM agents and tool use / [Financial trading and forecasting agents](https://mlsanity.com/agents/financial-trading-and-forecasting-agents/)

## Builds on (most cited first, 10 of 10)

- [WeatherBench 2: A benchmark for the next generation of data-driven global weather models](https://mlsanity.com/paper/2308.15560/) (2023)
- [Data Interpreter: An LLM Agent For Data Science](https://mlsanity.com/paper/2402.18679/) (2024)
- [WeatherQA: Can Multimodal Language Models Reason about Severe Weather?](https://mlsanity.com/paper/2406.11217/) (2024)
- [CLLMate: A Multimodal Benchmark for Weather and Climate Events Forecasting](https://mlsanity.com/paper/2409.19058/) (2024)
- [A Self-Evolving AI Agent System for Climate Science](https://mlsanity.com/paper/2507.17311/) (2025)
- [CLIMATEAGENT: Multi-Agent Orchestration for Complex Climate Data Science Workflows](https://mlsanity.com/paper/2511.20109/) (2025)
- [TianJi:An autonomous AI meteorologist for discovering physical mechanisms in atmospheric science](https://mlsanity.com/paper/2603.27738/) (2026)
- [ClimAgent: LLM as Agents for Autonomous Open-ended Climate Science Analysis](https://mlsanity.com/paper/2604.16922/) (2026)
- [EvoDS: Self-Evolving Autonomous Data Science Agent with Skill Learning and Context Management](https://mlsanity.com/paper/2606.03841/) (2026)
- [UniExtreme: A Universal Foundation Model for Extreme Weather Forecasting](https://mlsanity.com/paper/2508.01426/) (2025)

## Built on by (most cited first, 2 of 2)

- [LLM-based Agents for Forecasting and Prediction: Methods, Training, Evaluation, and Applications](https://mlsanity.com/paper/2608.23058/) (2026)
- [WeatherDiagFlow: Evidence-Grounded Radar Nowcasting with Diagnostic Flow Refinement](https://mlsanity.com/paper/2609.29772/) (2026)

## Abstract (arXiv)

Early warning of extreme weather is essential for mitigating the societal, economic, and environmental risks posed by hazardous weather events. However, expert-centered warning workflows are costly, labor-intensive, and difficult to scale throughout the warning-to-action process. Although recent advances in Large Language Model (LLM) agents have enabled the automation of weather-related tasks, existing studies remain centered on isolated scientific tasks and overlook the chain of interdependent processes required for operational extreme-weather early warning. To bridge this gap, this study investigates automated end-to-end extreme-weather early warning through LLM agents. We first develop SIREN-Bench, a comprehensive benchmark comprising 600 question-answer instances across 19 tasks, and covering four individual warning procedures and an end-to-end warning chain. Evaluation on SIREN-Bench reveals substantial capability gaps in existing weather agent frameworks. This motivates us to develop SIREN, an experience-grounded agent framework inspired by experts' use of historical cases, which combines an agentic execution environment integrating heterogeneous weather evidence and tools with a family of agent harnesses that exploit historical cases through retrieval, skill distillation, and predictive modeling. Extensive experiments demonstrate that SIREN outperforms weather-agent baselines on both individual warning procedures and end-to-end warning chains.
