ClimateCheck 2026: Scientific Fact-Checking and Disinformation Narrative Classification of Climate-related Claims
Not on the map. Why?
Abstract (arXiv)
Automatically verifying climate-related claims against scientific literature is a challenging task, complicated by the specialised nature of scholarly evidence and the diversity of rhetorical strategies underlying climate disinformation. ClimateCheck 2026 is the second iteration of a shared task addressing this challenge, expanding on the 2025 edition with tripled training data and a new disinformation narrative classification task. Running from January to February 2026 on the CodaBench platform, the competition attracted 20 registered participants and 8 leaderboard submissions, with systems combining dense retrieval pipelines, cross-encoder ensembles, and large language models with structured hierarchical reasoning. In addition to standard evaluation metrics (Recall@K and Binary Preference), we adapt an automated framework to assess retrieval quality under incomplete annotations, exposing systematic biases in how conventional metrics rank systems. A cross-task analysis further reveals that not all climate disinformation is equally verifiable, potentially implicating how future fact-checking systems should be designed.
Key facts. No citing papers in the map yet (data through 7 Oct 2026). Builds on 27 of its 51 references that are in the map. First posted on arXiv 27 Mar 2026.
Builds on
27 of 51 references.
References · 27
- 2023GPT-4 Technical Reportcited by 18,132
- 2019RoBERTa: A Robustly Optimized BERT Pretraining Approachcited by 13,266
- 2024DeepSeekMath: Pushing the Limits of Mathematical Reasoning in Open Language Modelscited by 8,851
- 2019DistilBERT, a distilled version of BERT: smaller, faster, cheaper and lightercited by 4,243
- 2025Gemini 2.5: Pushing the Frontier with Advanced Reasoning, Multimodality, Long Context, and Next Generation Agentic Capabilitiescited by 3,655
- 2017A Broad-Coverage Challenge Corpus for Sentence Understanding through Inferencecited by 2,665
- 2020DeBERTa: Decoding-enhanced BERT with Disentangled Attentioncited by 2,157
- 2018FEVER: a large-scale dataset for Fact Extraction and VERificationcited by 1,362
- 2024M3-Embedding: Multi-Linguality, Multi-Functionality, Multi-Granularity Text Embeddings Through Self-Knowledge Distillationcited by 1,050
- 2019Adversarial NLI: A New Benchmark for Natural Language Understandingcited by 798
- 2020Fact or Fiction: Verifying Scientific Claimscited by 546
- 2024Smarter, Better, Faster, Longer: A Modern Bidirectional Encoder for Fast, Memory Efficient, and Long Context Finetuning and Inferencecited by 527
15 more
- 2021A Survey on Automated Fact-Checkingcited by 376
- 2021Get Your Vitamin C! Robust Fact Verification with Contrastive Evidencecited by 222
- 2022WANLI: Worker and AI Collaboration for Natural Language Inference Dataset Creationcited by 200
- 2020HoVer: A Dataset for Many-Hop Fact Extraction And Claim Verificationcited by 199
- 2018Combining Fact Extraction and Verification with Neural Semantic Matching Networkscited by 120
- 2018The Fact Extraction and VERification (FEVER) Shared Taskcited by 108
- 2022SciFact-Open: Towards open-domain scientific claim verificationcited by 94
- 2023Scientific Fact-Checking: A Survey of Resources and Approachescited by 53
- 2021Does Putting a Linguist in the Loop Improve NLU Data Collection?cited by 29
- 2024The Automated Verification of Textual Claims (AVeriTeC) Shared Taskcited by 29
- 2023The Intended Uses of Automated Fact-Checking Artefacts: Why, How and Whocited by 19
- 2024Ev2R: Evaluating Evidence Retrieval in Automated Fact-Checkingcited by 18
- 2021Overview and Insights from the SciVer Shared Task on Scientific Claim Verificationcited by 17
- 2025The Next Phase of Scientific Fact-Checking: Advanced Evidence Retrieval from Complex Structured Academic Paperscited by 6
- 2024Augmented CARDS: A machine learning approach to identifying triggers of climate change misinformation on Twittercited by 4
Built on by
Not cited yet.
Similar, not cited
Close in wording, no citation either way
- 2025Enhancing LLMs for Governance with Human Oversight: Evaluating and Aligning LLMs on Expert Classification of Climate Misinformation for Detecting False or Misleading Claims about Climate Change
- 2024Unlearning Climate Misinformation in Large Language Models
- 2025ClimateViz: A Benchmark for Statistical Reasoning and Fact Verification on Scientific Charts
- 2025Listen to the Context: Towards Faithful Large Language Models for Retrieval Augmented Generation on Climate Questions
- 2025CliME: Evaluating Multimodal Climate Discourse on Social Media and the Climate Alignment Quotient (CAQ)
- 2026Multimodal Climate Disinformation Detection: Integrating Vision-Language Models with External Knowledge Sources
- 2025WeatherArchive-Bench: Benchmarking Retrieval-Augmented Reasoning for Historical Weather Archives
- 2026MMClima: A Framework for Multimodal Climate Science Data and Evaluation