ClimAgent: LLM as Agents for Autonomous Open-ended Climate Science Analysis
On the map: LLM agents and tool use → Multimodal and embodied agents
Abstract (arXiv)
Climate research is pivotal for mitigating global environmental crises, yet the accelerating volume of multi-scale datasets and the complexity of analytical tools have created significant bottlenecks, constraining scientific discovery to fragmented and labor-intensive workflows. While the emergence Large Language Models (LLMs) offers a transformative paradigm to scale scientific expertise, existing explorations remain largely confined to simple Question-Answering (Q&A) tasks. These approaches often oversimplify real-world challenges, neglecting the intricate physical constraints and the data-driven nature required in professional climate science.To bridge this gap, we introduce ClimAgent, a general-purpose autonomous framework designed to execute a wide spectrum of research tasks across diverse climate sub-fields. By integrating a unified tool-use environment with rigorous reasoning protocols, ClimAgent transcends simple retrieval to perform end-to-end modeling and analysis. To foster systematic evaluation, we propose ClimaBench, the first comprehensive benchmark for real-world climate discovery. It encompasses challenging problems spanning 5 distinct task categories derived from professional scenarios between 2000 and 2025. Experiments on ClimaBench demonstrate that ClimAgent significantly outperforms state-of-the-art baselines, achieving a 40.21% improvement over original LLM solutions in solution rigorousness and practicality. Our code are available at https://github.com/usail-hkust/ClimAgent.
Key facts. Cited by 1 paper in the map (data through 7 Oct 2026). Placed in Multimodal and embodied agents, one of 16 directions in LLM agents and tool use. Builds on 14 of its 32 references that are in the map. First posted on arXiv 18 Apr 2026.
Builds on
14 of 32 references.
References · 14
- 2022ReAct: Synergizing Reasoning and Acting in Language Modelscited by 8,355
- 2023SWE-bench: Can Language Models Resolve Real-World GitHub Issues?cited by 3,193
- 2023Large Language Modelscited by 774
- 2025Agent Laboratory: Using LLM Agents as Research Assistantscited by 405
- 2025Memory in the Age of AI Agentscited by 285
- 2023Large Language Models for Automated Open-domain Scientific Hypotheses Discoverycited by 100
- 2024MOOSE-Chem: Large Language Models for Rediscovering Unseen Chemistry Scientific Hypothesescited by 68
- 2025DeepAnalyze: Agentic Large Language Models for Autonomous Data Sciencecited by 49
- 2025MM-Agent: LLM as Agents for Real-world Mathematical Modeling Problemcited by 24
- 2024Improving Physics Reasoning in Large Language Models Using Mixture of Refinement Agentscited by 22
- 2024ClimaQA: An Automated Evaluation Framework for Climate Question Answering Modelscited by 21
- 2025The Stochastic Parrot on LLM's Shoulder: A Summative Assessment of Physical Concept Understandingcited by 11
Built on by
Citing papers per year: 2026: 1.
1 paper.
Similar, not cited
Close in wording, no citation either way
- 2025AtmosSci-Bench: Evaluating the Recent Advance of Large Language Model for Atmospheric Science
- 2025AutoClimDS: Climate Data Science Agentic AI -- A Knowledge Graph is All You Need
- 2026CMIP-Forge: An Agentic System that Retrieves, Computes, and Self-Reviews Climate Science
- 2025CLIMATEAGENT: Multi-Agent Orchestration for Complex Climate Data Science Workflows
- 2026The Energy Footprint of LLM-Based Environmental Analysis: LLMs and Domain Products
- 2025Zephyrus: An Agentic Framework for Weather Science
- 2025Listen to the Context: Towards Faithful Large Language Models for Retrieval Augmented Generation on Climate Questions
- 2026MMClima: A Framework for Multimodal Climate Science Data and Evaluation