mlsanityData to 7 Oct 2026

ClimateCheck 2026: Scientific Fact-Checking and Disinformation Narrative Classification of Climate-related Claims

arXiv 2603.26449 ↗First posted 27 Mar 2026cs.CLcited by 0

Not on the map. Why?

Abstract (arXiv)

Automatically verifying climate-related claims against scientific literature is a challenging task, complicated by the specialised nature of scholarly evidence and the diversity of rhetorical strategies underlying climate disinformation. ClimateCheck 2026 is the second iteration of a shared task addressing this challenge, expanding on the 2025 edition with tripled training data and a new disinformation narrative classification task. Running from January to February 2026 on the CodaBench platform, the competition attracted 20 registered participants and 8 leaderboard submissions, with systems combining dense retrieval pipelines, cross-encoder ensembles, and large language models with structured hierarchical reasoning. In addition to standard evaluation metrics (Recall@K and Binary Preference), we adapt an automated framework to assess retrieval quality under incomplete annotations, exposing systematic biases in how conventional metrics rank systems. A cross-task analysis further reveals that not all climate disinformation is equally verifiable, potentially implicating how future fact-checking systems should be designed.

Key facts. No citing papers in the map yet (data through 7 Oct 2026). Builds on 27 of its 51 references that are in the map. First posted on arXiv 27 Mar 2026.

Builds on

27 of 51 references.

References · 27

  1. 2023GPT-4 Technical Reportcited by 18,132
  2. 2019RoBERTa: A Robustly Optimized BERT Pretraining Approachcited by 13,266
  3. 2024DeepSeekMath: Pushing the Limits of Mathematical Reasoning in Open Language Modelscited by 8,851
  4. 2019DistilBERT, a distilled version of BERT: smaller, faster, cheaper and lightercited by 4,243
  5. 2025Gemini 2.5: Pushing the Frontier with Advanced Reasoning, Multimodality, Long Context, and Next Generation Agentic Capabilitiescited by 3,655
  6. 2017A Broad-Coverage Challenge Corpus for Sentence Understanding through Inferencecited by 2,665
  7. 2020DeBERTa: Decoding-enhanced BERT with Disentangled Attentioncited by 2,157
  8. 2018FEVER: a large-scale dataset for Fact Extraction and VERificationcited by 1,362
  9. 2024M3-Embedding: Multi-Linguality, Multi-Functionality, Multi-Granularity Text Embeddings Through Self-Knowledge Distillationcited by 1,050
  10. 2019Adversarial NLI: A New Benchmark for Natural Language Understandingcited by 798
  11. 2020Fact or Fiction: Verifying Scientific Claimscited by 546
  12. 2024Smarter, Better, Faster, Longer: A Modern Bidirectional Encoder for Fast, Memory Efficient, and Long Context Finetuning and Inferencecited by 527
15 more
  1. 2021A Survey on Automated Fact-Checkingcited by 376
  2. 2021Get Your Vitamin C! Robust Fact Verification with Contrastive Evidencecited by 222
  3. 2022WANLI: Worker and AI Collaboration for Natural Language Inference Dataset Creationcited by 200
  4. 2020HoVer: A Dataset for Many-Hop Fact Extraction And Claim Verificationcited by 199
  5. 2018Combining Fact Extraction and Verification with Neural Semantic Matching Networkscited by 120
  6. 2018The Fact Extraction and VERification (FEVER) Shared Taskcited by 108
  7. 2022SciFact-Open: Towards open-domain scientific claim verificationcited by 94
  8. 2023Scientific Fact-Checking: A Survey of Resources and Approachescited by 53
  9. 2021Does Putting a Linguist in the Loop Improve NLU Data Collection?cited by 29
  10. 2024The Automated Verification of Textual Claims (AVeriTeC) Shared Taskcited by 29
  11. 2023The Intended Uses of Automated Fact-Checking Artefacts: Why, How and Whocited by 19
  12. 2024Ev2R: Evaluating Evidence Retrieval in Automated Fact-Checkingcited by 18
  13. 2021Overview and Insights from the SciVer Shared Task on Scientific Claim Verificationcited by 17
  14. 2025The Next Phase of Scientific Fact-Checking: Advanced Evidence Retrieval from Complex Structured Academic Paperscited by 6
  15. 2024Augmented CARDS: A machine learning approach to identifying triggers of climate change misinformation on Twittercited by 4

Built on by

Not cited yet.

Similar, not cited

Close in wording, no citation either way

  1. 2025Enhancing LLMs for Governance with Human Oversight: Evaluating and Aligning LLMs on Expert Classification of Climate Misinformation for Detecting False or Misleading Claims about Climate Change
  2. 2024Unlearning Climate Misinformation in Large Language Models
  3. 2025ClimateViz: A Benchmark for Statistical Reasoning and Fact Verification on Scientific Charts
  4. 2025Listen to the Context: Towards Faithful Large Language Models for Retrieval Augmented Generation on Climate Questions
  5. 2025CliME: Evaluating Multimodal Climate Discourse on Social Media and the Climate Alignment Quotient (CAQ)
  6. 2026Multimodal Climate Disinformation Detection: Integrating Vision-Language Models with External Knowledge Sources
  7. 2025WeatherArchive-Bench: Benchmarking Retrieval-Augmented Reasoning for Historical Weather Archives
  8. 2026MMClima: A Framework for Multimodal Climate Science Data and Evaluation