CLIMATE-FEVER: A Dataset for Verification of Real-World Climate Claims
Not on the map. Why?
Abstract (arXiv)
We introduce CLIMATE-FEVER, a new publicly available dataset for verification of climate change-related claims. By providing a dataset for the research community, we aim to facilitate and encourage work on improving algorithms for retrieving evidential support for climate-specific claims, addressing the underlying language understanding challenges, and ultimately help alleviate the impact of misinformation on climate change. We adapt the methodology of FEVER [1], the largest dataset of artificially designed claims, to real-life claims collected from the Internet. While during this process, we could rely on the expertise of renowned climate scientists, it turned out to be no easy task. We discuss the surprising, subtle complexity of modeling real-world climate-related claims within the textscfever framework, which we believe provides a valuable challenge for general natural language understanding. We hope that our work will mark the beginning of a new exciting long-term joint effort by the climate science and AI community.
Key facts. Cited by 196 papers in the map (data through 14 Oct 2026). First posted on arXiv 1 Dec 2020.
Builds on
No reference list yet.
Built on by
Citing papers per year: 2021: 19; 2022: 24; 2023: 33; 2024: 46; 2025: 42; 2026: 32.
196 papers.
Sort:
By area:
- 2022Rethinking the Role of Demonstrations: What Makes In-Context Learning Work?cited by 1,434
- 2022Text Embeddings by Weakly-Supervised Contrastive Pre-trainingcited by 1,253
- 2021BEIR: A Heterogenous Benchmark for Zero-shot Evaluation of Information Retrieval Modelscited by 1,252
- 2021Datasets: A Community Library for Natural Language Processingcited by 530
- 2022Precise Zero-Shot Dense Retrieval without Relevance Labelscited by 517
- 2021ColBERTv2: Effective and Efficient Retrieval via Lightweight Late Interactioncited by 476
- 2021MetaICL: Learning to Learn In Contextcited by 454
- 2021A Survey on Automated Fact-Checkingcited by 378
- 2022Delta Tuning: A Comprehensive Study of Parameter Efficient Methods for Pre-trained Language Modelscited by 180
- 2024GME: Improving Universal Multimodal Retrieval by Multimodal LLMscited by 170
- 2021FEVEROUS: Fact Extraction and VERification Over Unstructured and Structured informationcited by 167
- 2024BRIGHT: A Realistic and Challenging Benchmark for Reasoning-Intensive Retrievalcited by 158
38 more
- 2023AVeriTeC: A Dataset for Real-world Claim Verification with Evidence from the Webcited by 144
- 2021MultiVerS: Improving scientific claim verification with weak supervision and full-document contextcited by 143
- 2021CrossFit: A Few-shot Learning Challenge for Cross-task Generalization in NLPcited by 142
- 2022Task-aware Retrieval with Instructionscited by 107
- 2021COVID-Fact: Fact Extraction and Verification of Real-World Claims on COVID-19 Pandemiccited by 100
- 2022SciFact-Open: Towards open-domain scientific claim verificationcited by 94
- 2021ClimateBert: A Pretrained Language Model for Climate-Related Textcited by 90
- 2024BM25S: Orders of magnitude faster lexical search via eager sparse scoringcited by 88
- 2023Factcheck-Bench: Fine-Grained Evaluation Benchmark for Automatic Fact-checkerscited by 87
- 2021Automated Fact-Checking: A Surveycited by 55
- 2023Active Learning Principles for In-Context Learning with Large Language Modelscited by 54
- 2023Scientific Fact-Checking: A Survey of Resources and Approachescited by 54
- 2023SCITAB: A Challenging Benchmark for Compositional Reasoning and Claim Verification on Scientific Tablescited by 51
- 2022Missing Counter-Evidence Renders NLP Fact-Checking Unrealistic for Misinformationcited by 45
- 2024Attention in Large Language Models Yields Efficient Zero-Shot Re-Rankerscited by 43
- 2021AmbiFC: Fact-Checking Ambiguous Claims with Evidencecited by 38
- 2023Language Models Hallucinate, but May Excel at Fact Verificationcited by 37
- 2023Reading and Reasoning over Chart Images for Evidence-based Automated Fact-Checkingcited by 35
- 2023Foundation Models for Weather and Climate Data Understanding: A Comprehensive Surveycited by 34
- 2023SAIL: Search-Augmented Instruction Learningcited by 33
- 2021Misinfo Reaction Frames: Reasoning about Readers' Reactions to News Headlinescited by 32
- 2023chatClimate: Grounding Conversational AI in Climate Sciencecited by 32
- 2023CHATREPORT: Democratizing Sustainability Disclosure Analysis through LLM-based Toolscited by 29
- 2023FactCHD: Benchmarking Fact-Conflicting Hallucination Detectioncited by 29
- 2021Simplified Data Wrangling with ir_datasetscited by 27
- 2021Zero-Shot Dense Retrieval with Momentum Adversarial Domain Invariant Representationscited by 27
- 2023Interpretable Unified Language Checkingcited by 26
- 2021Exploring Universal Intrinsic Task Subspace via Prompt Tuningcited by 25
- 2022LaPraDoR: Unsupervised Pretrained Dense Retriever for Zero-Shot Text Retrievalcited by 24
- 2024Claim Verification in the Age of Large Language Models: A Surveycited by 24
- 2025MLZero: A Multi-Agent System for End-to-end Machine Learning Automationcited by 24
- 2023Assessing Large Language Models on Climate Informationcited by 23
- 2024WeatherQA: Can Multimodal Language Models Reason about Severe Weather?cited by 22
- 2024ClimaQA: An Automated Evaluation Framework for Climate Question Answering Modelscited by 21
- 2022COCO-DR: Combating Distribution Shifts in Zero-Shot Dense Retrieval with Contrastive and Distributionally Robust Learningcited by 20
- 2024INTERS: Unlocking the Power of Large Language Models in Search with Instruction Tuningcited by 20
- 2022CITADEL: Conditional Token Interaction via Dynamic Lexical Routing for Efficient and Effective Multi-Vector Retrievalcited by 19
- 2024Generative Large Language Models in Automated Fact-Checking: A Surveycited by 19
50 most cited of 196 All 196 (JSON)
- 2026SuperAI: Merging Capabilities Across Heterogeneous Foundation Models11 Oct 2026
- 2026OpenFC: Learning Verification Policies towards Open-Search Fact Checking27 Sep 2026
- 2026Evidence-Grounded Auditing of Identification Assumptions in Climate-Policy Causal Evaluations25 Sep 2026
- 2026Message capacity and claim wording set the transition points of collective truth-finding in language-model networks15 Sep 2026
- 2026Climate-ModernBERT: Revisiting Corpus Composition for Domain-Adaptive Continued Pretraining7 Sep 2026
- 2026Matryoshka Hash Representations for Model-Aware Compact Semantic Retrieval7 Sep 2026
- 2026Shadow Queries for Private Retrieval in Vector Databases4 Sep 2026
- 2026Spruce: Scalable Private Outsourced Retrieval Using Compact Embeddings3 Sep 2026
- 2026How Robust Are Automated Fact-Checking Systems? A Cross-Benchmark Evaluation26 Aug 2026
- 2026Pointing the Way, Hiding the Destination: Practical Private Dense Retrieval at Scale26 Aug 2026
- 2026Can Scientific Claims Be Removed from Large Language Models? A Systematic Evaluation of Claim-Level Unlearning21 Aug 2026
- 2026Denoising-Aware Inversion: Revealing Privacy Risks in Noise-Protected Text Embeddings19 Aug 2026
38 more
- 2026CEDAR-GRPO: Process-Aware Reinforcement Learning for General Abductive Reasoning in LLMs14 Aug 2026
- 2026Evidence-Ledger Adjudication for Claim-Evidence Traceability29 Jul 2026
- 2026Robust for the Wrong Reasons: The Representational Geometry of LLM Robustness to Science Skepticism2 Jul 2026
- 2026MMClima: A Framework for Multimodal Climate Science Data and Evaluation8 Jun 2026
- 2026Do Neural Retrievers Prefer Certain Documents? Evidence of Learned Relevance Priors1 Jun 2026
- 2026No More K-means: Single-Stage Sparse Coding for Efficient Multi-Vector Retrieval28 May 2026
- 2026MATCHA: Matching Text via Contrastive Semantic Alignment26 May 2026
- 2026Five Queries Are Enough: Query-Efficient and Surrogate-Free Membership Inference Attacks on RAG via Entailment23 May 2026
- 2026To MRL or not to MRL: Text Embeddings are Robust to Truncation Without Matryoshka Learning, Except In Heavy Truncation Scenarios15 May 2026
- 2026Earth Science Foundation Models: From Perception to Reasoning and Discovery9 May 2026
- 2026Hypencoder Revisited: Reproducibility and Analysis of Non-Linear Scoring for First-Stage Retrieval29 Apr 2026
- 2026Learning to Route Queries to Heads for Attention-based Re-ranking with Large Language Models27 Apr 2026
- 2026Trust but Verify: Introducing DAVinCI -- A Framework for Dual Attribution and Verification in Claim Inference for Language Models23 Apr 2026
- 2026Uncertainty-Aware Web-Conditioned Scientific Fact-Checking13 Apr 2026
- 2026M2-Verify: A Large-Scale Multidomain Benchmark for Checking Multimodal Claim Consistency1 Apr 2026
- 2026Towards Empowering Consumers through Sentence-level Readability Scoring in German ESG Reports31 Mar 2026
- 2026LLM Benchmark-User Need Misalignment for Climate Change27 Mar 2026
- 2026ReAttn: Improving Attention-based Re-ranking via Attention Re-weighting23 Feb 2026
- 2026UniComp: A Unified Evaluation of Large Language Model Compression via Pruning, Quantization, and Distillation9 Feb 2026
- 2026Unifying Adversarial Robustness and Training Across Text Scoring Models31 Jan 2026
- 2025From Topology to Retrieval: Decoding Embedding Spaces with Unified Signatures27 Nov 2025
- 2025BiCA: Effective Biomedical Dense Retrieval with Citation-Aware Hard Negatives11 Nov 2025
- 2025COMMUNITYNOTES: A Dataset for Exploring the Helpfulness of Fact-Checking Explanations28 Oct 2025
- 2025A Benchmark for Open-Domain Numerical Fact-Checking Enhanced by Claim Decomposition24 Oct 2025
- 2025Tailored untruths: How personalisation challenges LLM safeguards14 Oct 2025
- 2025ADMIT: Few-shot Knowledge Poisoning Attacks on RAG-based Fact Checking11 Oct 2025
- 2025Think Right, Not More: Test-Time Scaling for Numerical Claim Verification26 Sep 2025
- 2025Evaluating the Effectiveness and Scalability of LLM-Based Data Augmentation for Retrieval19 Sep 2025
- 2025Randomly Removing 50% of Dimensions in Text Embeddings has Minimal Impact on Retrieval and Classification Tasks25 Aug 2025
- 2025Retrieval Capabilities of Large Language Models Scale with Pretraining FLOPs24 Aug 2025
- 2025If We May De-Presuppose: Robustly Verifying Claims through Presupposition-Free Question Decomposition22 Aug 2025
- 2025Don't Think Twice! Over-Reasoning Impairs Confidence Calibration20 Aug 2025
- 2025Consensus or Conflict? Fine-Grained Evaluation of Conflicting Answers in Question-Answering17 Aug 2025
- 2025MeteorPred: A Meteorological Multimodal Large Model and Dataset for Severe Weather Event Prediction9 Aug 2025
- 2025Distillation versus Contrastive Learning: How to Train Your Rerankers11 Jul 2025
- 2025Rethinking the Privacy of Text Embeddings: A Reproducibility Study of "Text Embeddings Reveal (Almost) As Much As Text"10 Jul 2025
- 2025The Medium Is Not the Message: Deconfounding Document Embeddings via Linear Concept Erasure1 Jul 2025
- 2025The Next Phase of Scientific Fact-Checking: Advanced Evidence Retrieval from Complex Structured Academic Papers25 Jun 2025
50 newest of 196 All 196 (JSON)
- 2024Attention in Large Language Models Yields Efficient Zero-Shot Re-Rankerscited by 43
- 2025Training a Utility-based Retriever Through Shared Context Attribution for Retrieval-Augmented Language Modelscited by 13
- 2024ClimRetrieve: A Benchmarking Dataset for Information Retrieval from Corporate Climate Disclosurescited by 12
- 2025ADMIT: Few-shot Knowledge Poisoning Attacks on RAG-based Fact Checkingcited by 10
- 2024A Reality Check on Context Utilisation for Retrieval-Augmented Generationcited by 9
- 2025Utility-Focused LLM Annotation for Retrieval and Retrieval-Augmented Generationcited by 5
- 2026Five Queries Are Enough: Query-Efficient and Surrogate-Free Membership Inference Attacks on RAG via Entailmentcited by 4
- 2024QAEncoder: Towards Aligned Representation Learning in Question Answering Systemscited by 3
- 2026Spruce: Scalable Private Outsourced Retrieval Using Compact Embeddingscited by 2
- 2025Listen to the Context: Towards Faithful Large Language Models for Retrieval Augmented Generation on Climate Questionscited by 1
- 2026Pointing the Way, Hiding the Destination: Practical Private Dense Retrieval at Scalecited by 1
- 2026Matryoshka Hash Representations for Model-Aware Compact Semantic Retrievalcited by 1
12 most cited of 13 All 13 (JSON)
- 2026Matryoshka Hash Representations for Model-Aware Compact Semantic Retrieval7 Sep 2026
- 2026Shadow Queries for Private Retrieval in Vector Databases4 Sep 2026
- 2026Spruce: Scalable Private Outsourced Retrieval Using Compact Embeddings3 Sep 2026
- 2026Pointing the Way, Hiding the Destination: Practical Private Dense Retrieval at Scale26 Aug 2026
- 2026Five Queries Are Enough: Query-Efficient and Surrogate-Free Membership Inference Attacks on RAG via Entailment23 May 2026
- 2025ADMIT: Few-shot Knowledge Poisoning Attacks on RAG-based Fact Checking11 Oct 2025
- 2025Listen to the Context: Towards Faithful Large Language Models for Retrieval Augmented Generation on Climate Questions21 May 2025
- 2025Utility-Focused LLM Annotation for Retrieval and Retrieval-Augmented Generation7 Apr 2025
- 2025Training a Utility-based Retriever Through Shared Context Attribution for Retrieval-Augmented Language Models1 Apr 2025
- 2024A Reality Check on Context Utilisation for Retrieval-Augmented Generation22 Dec 2024
- 2024Attention in Large Language Models Yields Efficient Zero-Shot Re-Rankers3 Oct 2024
- 2024QAEncoder: Towards Aligned Representation Learning in Question Answering Systems30 Sep 2024
12 newest of 13 All 13 (JSON)
- 2022Rethinking the Role of Demonstrations: What Makes In-Context Learning Work?cited by 1,434
- 2023SCITAB: A Challenging Benchmark for Compositional Reasoning and Claim Verification on Scientific Tablescited by 51
- 2025Step-by-Step Fact Verification System for Medical Claims with Explainable Reasoningcited by 17
- 2024Assessing the Reasoning Capabilities of LLMs in the context of Evidence-based Claim Verificationcited by 9
- 2025Language Models Can Predict Their Own Behaviorcited by 8
- 2025Enhancing Logical Reasoning in Language Models via Symbolically-Guided Monte Carlo Process Supervisioncited by 6
- 2025Don't Think Twice! Over-Reasoning Impairs Confidence Calibrationcited by 6
- 2025Causal Distillation: Transferring Structured Explanations from Large to Compact Language Modelscited by 2
- 2025ClimateViz: A Benchmark for Statistical Reasoning and Fact Verification on Scientific Chartscited by 2
- 2025Think Right, Not More: Test-Time Scaling for Numerical Claim Verificationcited by 2
- 2026Robust for the Wrong Reasons: The Representational Geometry of LLM Robustness to Science Skepticismcited by 1
- 2026CEDAR-GRPO: Process-Aware Reinforcement Learning for General Abductive Reasoning in LLMscited by 0
- 2026CEDAR-GRPO: Process-Aware Reinforcement Learning for General Abductive Reasoning in LLMs14 Aug 2026
- 2026Robust for the Wrong Reasons: The Representational Geometry of LLM Robustness to Science Skepticism2 Jul 2026
- 2025Think Right, Not More: Test-Time Scaling for Numerical Claim Verification26 Sep 2025
- 2025Don't Think Twice! Over-Reasoning Impairs Confidence Calibration20 Aug 2025
- 2025ClimateViz: A Benchmark for Statistical Reasoning and Fact Verification on Scientific Charts10 Jun 2025
- 2025Enhancing Logical Reasoning in Language Models via Symbolically-Guided Monte Carlo Process Supervision26 May 2025
- 2025Causal Distillation: Transferring Structured Explanations from Large to Compact Language Models26 May 2025
- 2025Step-by-Step Fact Verification System for Medical Claims with Explainable Reasoning20 Feb 2025
- 2025Language Models Can Predict Their Own Behavior18 Feb 2025
- 2024Assessing the Reasoning Capabilities of LLMs in the context of Evidence-based Claim Verification16 Feb 2024
- 2023SCITAB: A Challenging Benchmark for Compositional Reasoning and Claim Verification on Scientific Tables22 May 2023
- 2022Rethinking the Role of Demonstrations: What Makes In-Context Learning Work?25 Feb 2022
- 2024GME: Improving Universal Multimodal Retrieval by Multimodal LLMscited by 170
- 2024State Space Models are Strong Text Rerankerscited by 10
- 2024State Space Models are Strong Text Rerankers18 Dec 2024
- 2022Text Embeddings by Weakly-Supervised Contrastive Pre-trainingcited by 1,253
- 2021BEIR: A Heterogenous Benchmark for Zero-shot Evaluation of Information Retrieval Modelscited by 1,252
- 2021Datasets: A Community Library for Natural Language Processingcited by 530
- 2022Precise Zero-Shot Dense Retrieval without Relevance Labelscited by 517
- 2021ColBERTv2: Effective and Efficient Retrieval via Lightweight Late Interactioncited by 476
- 2021MetaICL: Learning to Learn In Contextcited by 454
- 2021A Survey on Automated Fact-Checkingcited by 378
- 2022Delta Tuning: A Comprehensive Study of Parameter Efficient Methods for Pre-trained Language Modelscited by 180
- 2021FEVEROUS: Fact Extraction and VERification Over Unstructured and Structured informationcited by 167
- 2024BRIGHT: A Realistic and Challenging Benchmark for Reasoning-Intensive Retrievalcited by 158
- 2023AVeriTeC: A Dataset for Real-world Claim Verification with Evidence from the Webcited by 144
- 2021MultiVerS: Improving scientific claim verification with weak supervision and full-document contextcited by 143
12 most cited of 160 All 160 (JSON)
- 2026SuperAI: Merging Capabilities Across Heterogeneous Foundation Models11 Oct 2026
- 2026OpenFC: Learning Verification Policies towards Open-Search Fact Checking27 Sep 2026
- 2026Evidence-Grounded Auditing of Identification Assumptions in Climate-Policy Causal Evaluations25 Sep 2026
- 2026Message capacity and claim wording set the transition points of collective truth-finding in language-model networks15 Sep 2026
- 2026Climate-ModernBERT: Revisiting Corpus Composition for Domain-Adaptive Continued Pretraining7 Sep 2026
- 2026How Robust Are Automated Fact-Checking Systems? A Cross-Benchmark Evaluation26 Aug 2026
- 2026Denoising-Aware Inversion: Revealing Privacy Risks in Noise-Protected Text Embeddings19 Aug 2026
- 2026Evidence-Ledger Adjudication for Claim-Evidence Traceability29 Jul 2026
- 2026MMClima: A Framework for Multimodal Climate Science Data and Evaluation8 Jun 2026
- 2026Do Neural Retrievers Prefer Certain Documents? Evidence of Learned Relevance Priors1 Jun 2026
- 2026No More K-means: Single-Stage Sparse Coding for Efficient Multi-Vector Retrieval28 May 2026
- 2026MATCHA: Matching Text via Contrastive Semantic Alignment26 May 2026
12 newest of 160 All 160 (JSON)