CLIMATEAGENT: Multi-Agent Orchestration for Complex Climate Data Science Workflows
On the map: LLM agents and tool use → Multimodal and embodied agents
Abstract (arXiv)
Climate science demands automated workflows to transform comprehensive questions into data-driven statements across massive, heterogeneous datasets. However, generic LLM agents and static scripting pipelines lack climate-specific context and flexibility and thus perform poorly in practice. We present ClimateAgent, an autonomous multi-agent framework that orchestrates end-to-end climate data analytic workflows. ClimateAgent decomposes user questions into executable subtasks coordinated by an Orchestrate-Agent and a Plan-Agent; acquires data via specialized Data-Agents that dynamically introspect APIs to synthesize robust download scripts; and completes analysis and reporting with a Coding-Agent that generates Python code, visualizations, and a final report with a built-in self-correction loop. To enable systematic evaluation, we introduce Climate-Agent-Bench-85, a benchmark of 85 real-world tasks spanning atmospheric rivers, drought, extreme precipitation, heat waves, sea surface temperature, and tropical cyclones. On Climate-Agent-Bench-85, ClimateAgent achieves 100% task completion and a report quality score of 8.32, outperforming GitHub Copilot (6.27) and a GPT-5 baseline (3.26). These results demonstrate that our multi-agent orchestration with dynamic API awareness and self-correcting execution substantially advances reliable, end-to-end automation for climate science analytic tasks. The source code of ClimateAgent is available at https://github.com/Relaxed-System-Lab/ClimateAgent.
Key facts. Cited by 6 papers in the map (data through 7 Oct 2026). Placed in Multimodal and embodied agents, one of 16 directions in LLM agents and tool use. Builds on 19 of its 42 references that are in the map. First posted on arXiv 25 Nov 2025.
Builds on
19 of 42 references.
References · 19
- 2020Language Models are Few-Shot Learnerscited by 32,199
- 2022Chain-of-Thought Prompting Elicits Reasoning in Large Language Modelscited by 12,302
- 2023Judging LLM-as-a-Judge with MT-Bench and Chatbot Arenacited by 8,393
- 2021Evaluating Large Language Models Trained on Codecited by 8,053
- 2022PaLM: Scaling Language Modeling with Pathwayscited by 5,304
- 2023Reflexion: Language Agents with Verbal Reinforcement Learningcited by 4,064
- 2021Program Synthesis with Large Language Modelscited by 3,509
- 2023Generative Agents: Interactive Simulacra of Human Behaviorcited by 3,500
- 2023A Survey on Large Language Model based Autonomous Agentscited by 2,203
- 2023ChemCrow: Augmenting large-language models with chemistry toolscited by 609
- 2023AgentVerse: Facilitating Multi-Agent Collaboration and Exploring Emergent Behaviorscited by 580
- 2020Fact or Fiction: Verifying Scientific Claimscited by 546
7 more
- 2023Large Language Models Are Zero-Shot Time Series Forecasterscited by 491
- 2024When Can LLMs Actually Correct Their Own Mistakes? A Critical Survey of Self-Correction of LLMscited by 230
- 2022PromptCast: A New Prompt-based Learning Paradigm for Time Series Forecastingcited by 170
- 2023Are Large Language Model-based Evaluators the Solution to Scaling Up Multilingual Evaluation?cited by 87
- 2025DataSciBench: An LLM Agent Benchmark for Data Sciencecited by 53
- 2023Exploring the Reliability of Large Language Models as Customized Evaluators for Diverse NLP Taskscited by 23
- 2024MASSW: A New Dataset and Benchmark Tasks for AI-Assisted Scientific Workflowscited by 19
Built on by
Citing papers per year: 2026: 6.
6 papers.
- 2026HVR-Met: A Hypothesis-Verification-Replanning Agentic System for Extreme Weather Diagnosiscited by 2
- 2026SIREN: Towards End-to-End Extreme-Weather Early Warning with Experience-Grounded LLM Agentscited by 2
- 2026GCA Framework: A GCC Countries-Grounded Dataset and Agentic Pipeline for Climate Decision Supportcited by 1
- 2026LLM Agents for Time-Series: A Surveycited by 1
- 2026S2SServiceBench: A Multimodal Benchmark for Last-Mile S2S Climate Servicescited by 0
- 2026An Agentic Interface for End-to-End Probabilistic Seismic Hazard and Risk Analysiscited by 0
- 2026LLM Agents for Time-Series: A Survey26 Aug 2026
- 2026SIREN: Towards End-to-End Extreme-Weather Early Warning with Experience-Grounded LLM Agents27 Jul 2026
- 2026An Agentic Interface for End-to-End Probabilistic Seismic Hazard and Risk Analysis27 Jun 2026
- 2026GCA Framework: A GCC Countries-Grounded Dataset and Agentic Pipeline for Climate Decision Support14 Apr 2026
- 2026HVR-Met: A Hypothesis-Verification-Replanning Agentic System for Extreme Weather Diagnosis1 Mar 2026
- 2026S2SServiceBench: A Multimodal Benchmark for Last-Mile S2S Climate Services15 Feb 2026
Similar, not cited
Close in wording, no citation either way
- 2025AutoClimDS: Climate Data Science Agentic AI -- A Knowledge Graph is All You Need
- 2026ClimAgent: LLM as Agents for Autonomous Open-ended Climate Science Analysis
- 2025Zephyrus: An Agentic Framework for Weather Science
- 2026CMIP-Forge: An Agentic System that Retrieves, Computes, and Self-Reviews Climate Science
- 2026ST-Bench: A Spatial-Temporal Benchmark for Multi-Agent System Generation on Scientific Research Tasks
- 2026Earth-Agent-Pro: Towards Real-World Full-Chain Earth Observation with Agents
- 2026TerraBench: Can Agents Reason Over Heterogeneous Earth-System Data?
- 2026KISS - Knowledge Infrastructure for Scientific Simulation: A Scaffolding for Agentic Earth Science