chatClimate: Grounding Conversational AI in Climate Science
Not on the map. Why?
Abstract (arXiv)
Large Language Models (LLMs) have made significant progress in recent years, achieving remarkable results in question-answering tasks (QA). However, they still face two major challenges: hallucination and outdated information after the training phase. These challenges take center stage in critical domains like climate change, where obtaining accurate and up-to-date information from reliable sources in a limited time is essential and difficult. To overcome these barriers, one potential solution is to provide LLMs with access to external, scientifically accurate, and robust sources (long-term memory) to continuously update their knowledge and prevent the propagation of inaccurate, incorrect, or outdated information. In this study, we enhanced GPT-4 by integrating the information from the Sixth Assessment Report of the Intergovernmental (IPCC AR6), the most comprehensive, up-to-date, and reliable source in this domain. We present our conversational AI prototype, available at www.chatclimate.ai and demonstrate its ability to answer challenging questions accurately in three different QA scenarios: asking from 1) GPT-4, 2) chatClimate, and 3) hybrid chatClimate. The answers and their sources were evaluated by our team of IPCC authors, who used their expert knowledge to score the accuracy of the answers from 1 (very-low) to 5 (very-high). The evaluation showed that the hybrid chatClimate provided more accurate answers, highlighting the effectiveness of our solution. This approach can be easily scaled for chatbots in specific domains, enabling the delivery of reliable and accurate information.
Key facts. Cited by 32 papers in the map (data through 14 Oct 2026). Builds on 34 of its 80 references that are in the map. First posted on arXiv 11 Apr 2023.
Builds on
34 of 80 references.
References · 34
- 2017Attention Is All You Needcited by 60,361
- 2018BERT: Pre-training of Deep Bidirectional Transformers for Language Understandingcited by 40,399
- 2020Language Models are Few-Shot Learnerscited by 32,419
- 2023GPT-4 Technical Reportcited by 18,396
- 2022Training language models to follow instructions with human feedbackcited by 15,971
- 2023LLaMA: Open and Efficient Foundation Language Modelscited by 14,132
- 2022PaLM: Scaling Language Modeling with Pathwayscited by 5,326
- 2022Large Language Models are Zero-Shot Reasonerscited by 4,374
- 2023Toolformer: Language Models Can Teach Themselves to Use Toolscited by 4,182
- 2022Survey of Hallucination in Natural Language Generationcited by 2,075
- 2021Multitask Prompted Training Enables Zero-Shot Task Generalizationcited by 1,470
- 2021Improving language models by retrieving from trillions of tokenscited by 1,293
22 more
- 2023HuggingGPT: Solving AI Tasks with ChatGPT and its Friends in Hugging Facecited by 1,190
- 2022Large Language Models Are Human-Level Prompt Engineerscited by 1,045
- 2021Ethical and social risks of harm from Language Modelscited by 966
- 2020Exploiting Cloze Questions for Few Shot Text Classification and Natural Language Inferencecited by 938
- 2023REPLUG: Retrieval-Augmented Black-Box Language Modelscited by 792
- 2020It's Not Just Size That Matters: Small Language Models Are Also Few-Shot Learnerscited by 669
- 2021Prompt Programming for Large Language Models: Beyond the Few-Shot Paradigmcited by 606
- 2020Towards a Human-like Open-Domain Chatbotcited by 470
- 2021A Survey on Automated Fact-Checkingcited by 378
- 2023How Good Are GPT Models at Machine Translation? A Comprehensive Evaluationcited by 348
- 2022Leveraging Large Language Models for Multiple Choice Question Answeringcited by 203
- 2020CLIMATE-FEVER: A Dataset for Verification of Real-World Climate Claimscited by 196
- 2021Towards Continual Knowledge Learning of Language Modelscited by 174
- 2021ClimateBert: A Pretrained Language Model for Climate-Related Textcited by 90
- 2023A Bibliometric Review of Large Language Models Research from 2017 to 2023cited by 57
- 2023DERA: Enhancing Large Language Model Completions with Dialog-Enabled Resolving Agentscited by 52
- 2020Detecting Stance in Media on Global Warmingcited by 48
- 2020Analyzing Sustainability Reports Using Natural Language Processingcited by 18
- 2023Enhancing Large Language Models with Climate Resourcescited by 18
- 2023Towards Healthy AI: Large Language Models Need Therapists Toocited by 13
- 2022Environmental Claim Detectioncited by 11
- 2021Low-Resource Adaptation of Open-Domain Generative Chatbotscited by 2
Built on by
Citing papers per year: 2023: 6; 2024: 13; 2025: 12; 2026: 1.
32 papers.
Sort:
By area:
- 2023GPT4GEO: How a Language Model Sees the World's Geographycited by 68
- 2023Foundation Models for Weather and Climate Data Understanding: A Comprehensive Surveycited by 34
- 2024AI Hallucinations: A Misnomer Worth Clarifyingcited by 34
- 2023CHATREPORT: Democratizing Sustainability Disclosure Analysis through LLM-based Toolscited by 29
- 2025Foundation Models for Spatio-Temporal Data Science: A Tutorial and Surveycited by 24
- 2024Towards Urban General Intelligence: A Review and Outlook of Urban Foundation Modelscited by 23
- 2024WeatherQA: Can Multimodal Language Models Reason about Severe Weather?cited by 22
- 2024From Text to Transformation: A Comprehensive Review of Large Language Models' Versatilitycited by 19
- 2024WildfireGPT: Tailored Large Language Model for Wildfire Analysiscited by 15
- 2025Accelerating Earth Science Discovery via Multi-Agent LLM Systemscited by 13
- 2024ClimateIQA: A New Dataset and Benchmark to Advance Vision-Language Models in Meteorology Anomalies Analysiscited by 10
- 2024Adapting While Learning: Grounding LLMs for Scientific Problems with Intelligent Tool Usage Adaptationcited by 7
20 more
- 2023Glitter or Gold? Deriving Structured Insights from Sustainability Reports via Large Language Modelscited by 6
- 2023Climate Change from Large Language Modelscited by 6
- 2024ChipAlign: Instruction Alignment in Large Language Models for Chip Design via Geodesic Interpolationcited by 6
- 2025Don't Think Twice! Over-Reasoning Impairs Confidence Calibrationcited by 6
- 2025A RAG-Based Multi-Agent LLM System for Natural Hazard Resilience and Adaptationcited by 5
- 2024Automated Fact-Checking of Climate Change Claims with Large Language Modelscited by 4
- 2024Artificial Intelligence for Collective Intelligence: A National-Scale Research Strategycited by 4
- 2024Surveying Attitudinal Alignment Between Large Language Models Vs. Humans Towards 17 Sustainable Development Goalscited by 3
- 2024AI for Extreme Event Modeling and Understanding: Methodologies and Challengescited by 3
- 2025ClimateChat: Designing Data and Methods for Instruction Tuning LLMs to Answer Climate Change Queriescited by 3
- 2026ForesightSafety Bench: A Frontier Risk Evaluation and Governance Framework towards Safe AIcited by 3
- 2025Urban Computing in the Era of Large Language Modelscited by 2
- 2025Knowledge-Grounded Agentic Large Language Models for Multi-Hazard Understanding from Reconnaissance Reportscited by 2
- 2024Advancing Large Language Models for Spatiotemporal and Semantic Association Mining of Similar Environmental Eventscited by 1
- 2025Judging It, Washing It: Scoring and Greenwashing Corporate Climate Disclosures using Large Language Modelscited by 1
- 2025GeoGrid-Bench: Can Foundation Models Understand Multimodal Gridded Geo-Spatial Data?cited by 1
- 2023ChatSOS: LLM-based knowledge Q&A system for safety engineeringcited by 0
- 2025ClimaEmpact: Domain-Aligned Small Language Models and Datasets for Extreme Weather Analyticscited by 0
- 2025CLINB: A Climate Intelligence Benchmark for Foundational Modelscited by 0
- 2025EmeraldMind: A Knowledge Graph-Augmented Framework for Greenwashing Detectioncited by 0
- 2026ForesightSafety Bench: A Frontier Risk Evaluation and Governance Framework towards Safe AI15 Feb 2026
- 2025EmeraldMind: A Knowledge Graph-Augmented Framework for Greenwashing Detection12 Dec 2025
- 2025Knowledge-Grounded Agentic Large Language Models for Multi-Hazard Understanding from Reconnaissance Reports18 Nov 2025
- 2025CLINB: A Climate Intelligence Benchmark for Foundational Models29 Oct 2025
- 2025Don't Think Twice! Over-Reasoning Impairs Confidence Calibration20 Aug 2025
- 2025ClimateChat: Designing Data and Methods for Instruction Tuning LLMs to Answer Climate Change Queries12 Jun 2025
- 2025GeoGrid-Bench: Can Foundation Models Understand Multimodal Gridded Geo-Spatial Data?15 May 2025
- 2025ClimaEmpact: Domain-Aligned Small Language Models and Datasets for Extreme Weather Analytics27 Apr 2025
- 2025A RAG-Based Multi-Agent LLM System for Natural Hazard Resilience and Adaptation24 Apr 2025
- 2025Urban Computing in the Era of Large Language Models2 Apr 2025
- 2025Foundation Models for Spatio-Temporal Data Science: A Tutorial and Survey12 Mar 2025
- 2025Accelerating Earth Science Discovery via Multi-Agent LLM Systems7 Mar 2025
20 more
- 2025Judging It, Washing It: Scoring and Greenwashing Corporate Climate Disclosures using Large Language Models20 Feb 2025
- 2024ChipAlign: Instruction Alignment in Large Language Models for Chip Design via Geodesic Interpolation15 Dec 2024
- 2024Advancing Large Language Models for Spatiotemporal and Semantic Association Mining of Similar Environmental Events19 Nov 2024
- 2024Artificial Intelligence for Collective Intelligence: A National-Scale Research Strategy9 Nov 2024
- 2024Adapting While Learning: Grounding LLMs for Scientific Problems with Intelligent Tool Usage Adaptation1 Nov 2024
- 2024AI for Extreme Event Modeling and Understanding: Methodologies and Challenges28 Jun 2024
- 2024WeatherQA: Can Multimodal Language Models Reason about Severe Weather?17 Jun 2024
- 2024ClimateIQA: A New Dataset and Benchmark to Advance Vision-Language Models in Meteorology Anomalies Analysis14 Jun 2024
- 2024Surveying Attitudinal Alignment Between Large Language Models Vs. Humans Towards 17 Sustainable Development Goals22 Apr 2024
- 2024From Text to Transformation: A Comprehensive Review of Large Language Models' Versatility25 Feb 2024
- 2024WildfireGPT: Tailored Large Language Model for Wildfire Analysis12 Feb 2024
- 2024Towards Urban General Intelligence: A Review and Outlook of Urban Foundation Models30 Jan 2024
- 2024Automated Fact-Checking of Climate Change Claims with Large Language Models23 Jan 2024
- 2024AI Hallucinations: A Misnomer Worth Clarifying9 Jan 2024
- 2023Climate Change from Large Language Models19 Dec 2023
- 2023ChatSOS: LLM-based knowledge Q&A system for safety engineering14 Dec 2023
- 2023Foundation Models for Weather and Climate Data Understanding: A Comprehensive Survey5 Dec 2023
- 2023Glitter or Gold? Deriving Structured Insights from Sustainability Reports via Large Language Models9 Oct 2023
- 2023CHATREPORT: Democratizing Sustainability Disclosure Analysis through LLM-based Tools28 Jul 2023
- 2023GPT4GEO: How a Language Model Sees the World's Geography30 May 2023
- 2023GPT4GEO: How a Language Model Sees the World's Geographycited by 68
- 2023GPT4GEO: How a Language Model Sees the World's Geography30 May 2023
- 2023Foundation Models for Weather and Climate Data Understanding: A Comprehensive Surveycited by 34
- 2024AI Hallucinations: A Misnomer Worth Clarifyingcited by 34
- 2023CHATREPORT: Democratizing Sustainability Disclosure Analysis through LLM-based Toolscited by 29
- 2025Foundation Models for Spatio-Temporal Data Science: A Tutorial and Surveycited by 24
- 2024Towards Urban General Intelligence: A Review and Outlook of Urban Foundation Modelscited by 23
- 2024WeatherQA: Can Multimodal Language Models Reason about Severe Weather?cited by 22
- 2024From Text to Transformation: A Comprehensive Review of Large Language Models' Versatilitycited by 19
- 2024WildfireGPT: Tailored Large Language Model for Wildfire Analysiscited by 15
- 2024Adapting While Learning: Grounding LLMs for Scientific Problems with Intelligent Tool Usage Adaptationcited by 7
- 2023Glitter or Gold? Deriving Structured Insights from Sustainability Reports via Large Language Modelscited by 6
- 2023Climate Change from Large Language Modelscited by 6
- 2024ChipAlign: Instruction Alignment in Large Language Models for Chip Design via Geodesic Interpolationcited by 6
12 most cited of 25 All 25 (JSON)
- 2026ForesightSafety Bench: A Frontier Risk Evaluation and Governance Framework towards Safe AI15 Feb 2026
- 2025CLINB: A Climate Intelligence Benchmark for Foundational Models29 Oct 2025
- 2025ClimateChat: Designing Data and Methods for Instruction Tuning LLMs to Answer Climate Change Queries12 Jun 2025
- 2025GeoGrid-Bench: Can Foundation Models Understand Multimodal Gridded Geo-Spatial Data?15 May 2025
- 2025ClimaEmpact: Domain-Aligned Small Language Models and Datasets for Extreme Weather Analytics27 Apr 2025
- 2025Urban Computing in the Era of Large Language Models2 Apr 2025
- 2025Foundation Models for Spatio-Temporal Data Science: A Tutorial and Survey12 Mar 2025
- 2025Judging It, Washing It: Scoring and Greenwashing Corporate Climate Disclosures using Large Language Models20 Feb 2025
- 2024ChipAlign: Instruction Alignment in Large Language Models for Chip Design via Geodesic Interpolation15 Dec 2024
- 2024Advancing Large Language Models for Spatiotemporal and Semantic Association Mining of Similar Environmental Events19 Nov 2024
- 2024Artificial Intelligence for Collective Intelligence: A National-Scale Research Strategy9 Nov 2024
- 2024Adapting While Learning: Grounding LLMs for Scientific Problems with Intelligent Tool Usage Adaptation1 Nov 2024
12 newest of 25 All 25 (JSON)