mlsanityData to 7 Oct 2026

CLIMATEAGENT: Multi-Agent Orchestration for Complex Climate Data Science Workflows

arXiv 2511.20109 ↗First posted 25 Nov 2025cs.LGcited by 6

On the map: LLM agents and tool use → Multimodal and embodied agents

Abstract (arXiv)

Climate science demands automated workflows to transform comprehensive questions into data-driven statements across massive, heterogeneous datasets. However, generic LLM agents and static scripting pipelines lack climate-specific context and flexibility and thus perform poorly in practice. We present ClimateAgent, an autonomous multi-agent framework that orchestrates end-to-end climate data analytic workflows. ClimateAgent decomposes user questions into executable subtasks coordinated by an Orchestrate-Agent and a Plan-Agent; acquires data via specialized Data-Agents that dynamically introspect APIs to synthesize robust download scripts; and completes analysis and reporting with a Coding-Agent that generates Python code, visualizations, and a final report with a built-in self-correction loop. To enable systematic evaluation, we introduce Climate-Agent-Bench-85, a benchmark of 85 real-world tasks spanning atmospheric rivers, drought, extreme precipitation, heat waves, sea surface temperature, and tropical cyclones. On Climate-Agent-Bench-85, ClimateAgent achieves 100% task completion and a report quality score of 8.32, outperforming GitHub Copilot (6.27) and a GPT-5 baseline (3.26). These results demonstrate that our multi-agent orchestration with dynamic API awareness and self-correcting execution substantially advances reliable, end-to-end automation for climate science analytic tasks. The source code of ClimateAgent is available at https://github.com/Relaxed-System-Lab/ClimateAgent.

Key facts. Cited by 6 papers in the map (data through 7 Oct 2026). Placed in Multimodal and embodied agents, one of 16 directions in LLM agents and tool use. Builds on 19 of its 42 references that are in the map. First posted on arXiv 25 Nov 2025.

Builds on

19 of 42 references.

References · 19

  1. 2020Language Models are Few-Shot Learnerscited by 32,199
  2. 2022Chain-of-Thought Prompting Elicits Reasoning in Large Language Modelscited by 12,302
  3. 2023Judging LLM-as-a-Judge with MT-Bench and Chatbot Arenacited by 8,393
  4. 2021Evaluating Large Language Models Trained on Codecited by 8,053
  5. 2022PaLM: Scaling Language Modeling with Pathwayscited by 5,304
  6. 2023Reflexion: Language Agents with Verbal Reinforcement Learningcited by 4,064
  7. 2021Program Synthesis with Large Language Modelscited by 3,509
  8. 2023Generative Agents: Interactive Simulacra of Human Behaviorcited by 3,500
  9. 2023A Survey on Large Language Model based Autonomous Agentscited by 2,203
  10. 2023ChemCrow: Augmenting large-language models with chemistry toolscited by 609
  11. 2023AgentVerse: Facilitating Multi-Agent Collaboration and Exploring Emergent Behaviorscited by 580
  12. 2020Fact or Fiction: Verifying Scientific Claimscited by 546
7 more
  1. 2023Large Language Models Are Zero-Shot Time Series Forecasterscited by 491
  2. 2024When Can LLMs Actually Correct Their Own Mistakes? A Critical Survey of Self-Correction of LLMscited by 230
  3. 2022PromptCast: A New Prompt-based Learning Paradigm for Time Series Forecastingcited by 170
  4. 2023Are Large Language Model-based Evaluators the Solution to Scaling Up Multilingual Evaluation?cited by 87
  5. 2025DataSciBench: An LLM Agent Benchmark for Data Sciencecited by 53
  6. 2023Exploring the Reliability of Large Language Models as Customized Evaluators for Diverse NLP Taskscited by 23
  7. 2024MASSW: A New Dataset and Benchmark Tasks for AI-Assisted Scientific Workflowscited by 19

Built on by

Cited by year (2026 to 7 Oct)

Citing papers per year: 2026: 6.

6 papers.

Similar, not cited

Close in wording, no citation either way

  1. 2025AutoClimDS: Climate Data Science Agentic AI -- A Knowledge Graph is All You Need
  2. 2026ClimAgent: LLM as Agents for Autonomous Open-ended Climate Science Analysis
  3. 2025Zephyrus: An Agentic Framework for Weather Science
  4. 2026CMIP-Forge: An Agentic System that Retrieves, Computes, and Self-Reviews Climate Science
  5. 2026ST-Bench: A Spatial-Temporal Benchmark for Multi-Agent System Generation on Scientific Research Tasks
  6. 2026Earth-Agent-Pro: Towards Real-World Full-Chain Earth Observation with Agents
  7. 2026TerraBench: Can Agents Reason Over Heterogeneous Earth-System Data?
  8. 2026KISS - Knowledge Infrastructure for Scientific Simulation: A Scaffolding for Agentic Earth Science