The Fact Extraction and VERification (FEVER) Shared Task
Not on the map. Why?
Abstract (arXiv)
We present the results of the first Fact Extraction and VERification (FEVER) Shared Task. The task challenged participants to classify whether human-written factoid claims could be Supported or Refuted using evidence retrieved from Wikipedia. We received entries from 23 competing teams, 19 of which scored higher than the previously published baseline. The best performing system achieved a FEVER score of 64.21%. In this paper, we present the results of the shared task and a summary of the systems, highlighting commonalities and innovations among participating systems.
Key facts. Cited by 108 papers in the map (data through 14 Oct 2026). First posted on arXiv 27 Nov 2018.
Builds on
No reference list yet.
Built on by
Citing papers per year: 2021: 21; 2022: 19; 2023: 22; 2024: 24; 2025: 13; 2026: 9.
108 papers.
Sort:
By area:
- 2023SelfCheckGPT: Zero-Resource Black-Box Hallucination Detection for Generative Large Language Modelscited by 810
- 2021A Survey on Automated Fact-Checkingcited by 378
- 2023LM vs LM: Detecting Factual Errors via Cross Examinationcited by 156
- 2021Automated Fact-Checking for Assisting Human Fact-Checkerscited by 144
- 2022Re2G: Retrieve, Rerank, Generatecited by 102
- 2023ExpertQA: Expert-Curated Questions and Attributed Answerscited by 97
- 2024The Dawn After the Dark: An Empirical Study on Factuality Hallucination in Large Language Modelscited by 88
- 2024Factual Confidence of LLMs: on Reliability and Robustness of Current Estimatorscited by 61
- 2021Automated Fact-Checking: A Surveycited by 55
- 2023Scientific Fact-Checking: A Survey of Resources and Approachescited by 54
- 2021ProoFVer: Natural Logic Theorem Proving for Fact Verificationcited by 53
- 2023Multimodal Automated Fact-Checking: A Surveycited by 53
38 more
- 2022GERE: Generative Evidence Retrieval for Fact Verificationcited by 38
- 2021FaVIQ: FAct Verification from Information-seeking Questionscited by 36
- 2023HealthFC: Verifying Health Claims with Evidence-Based Medical Fact-Checkingcited by 35
- 2022Zoom Out and Observe: News Environment Perception for Fake News Detectioncited by 34
- 2023The Perils & Promises of Fact-checking with Large Language Modelscited by 31
- 2022CoVERT: A Corpus of Fact-checked Biomedical COVID-19 Tweetscited by 29
- 2024The Automated Verification of Textual Claims (AVeriTeC) Shared Taskcited by 29
- 2024I Don't Know: Explicit Modeling of Uncertainty with an [IDK] Tokencited by 26
- 2021Integrating Pattern- and Fact-based Fake News Detection via Model Preference Learningcited by 25
- 2024Peering into the Mind of Language Models: An Approach for Attribution in Contextual Question Answeringcited by 25
- 2024Claim Verification in the Age of Large Language Models: A Surveycited by 24
- 2023Fast and Accurate Factual Inconsistency Detection Over Long Documentscited by 23
- 2024Ev2R: Evaluating Evidence Retrieval in Automated Fact-Checkingcited by 18
- 2023"Why is this misleading?": Detecting News Headline Hallucinations with Explanationscited by 17
- 2021Article Reranking by Memory-Enhanced Key Sentence Matching for Detecting Previously Fact-Checked Claimscited by 16
- 2022Crowdsourced Fact-Checking at Twitter: How Does the Crowd Compare With Experts?cited by 16
- 2024Do We Need Language-Specific Fact-Checking Models? The Case of Chinesecited by 15
- 2024A synthetic data approach for domain generalization of NLI modelscited by 15
- 2021Joint Models for Answer Verification in Question Answering Systemscited by 13
- 2024HerO at AVeriTeC: The Herd of Open Large Language Models for Verifying Real-World Claimscited by 12
- 2025CLAIMCHECK: How Grounded are LLM Critiques of Scientific Papers?cited by 12
- 2022Calibration of Machine Reading Systems at Scalecited by 11
- 2023Synergistic Interplay between Search and Large Language Models for Information Retrievalcited by 11
- 2025SemEval-2025 Task 7: Multilingual and Crosslingual Fact-Checked Claim Retrievalcited by 11
- 2022Challenges and Opportunities in Information Manipulation Detection: An Examination of Wartime Russian Mediacited by 10
- 2024Attacking Misinformation Detection Using Adversarial Examples Generated by Language Modelscited by 10
- 2024ERBench: An Entity-Relationship based Automatically Verifiable Hallucination Benchmark for Large Language Modelscited by 9
- 2021AraStance: A Multi-Country and Multi-Domain Dataset of Arabic Stance Detection for Fact Checkingcited by 8
- 2022TRUE: Re-evaluating Factual Consistency Evaluationcited by 8
- 2023Verifying the Robustness of Automatic Credibility Assessmentcited by 8
- 2024AIC CTU system at AVeriTeC: Re-framing automated fact-checking as a simple RAG taskcited by 8
- 2022Entity-based Claim Representation Improves Fact-Checking of Medical Content in Tweetscited by 7
- 2022A Win-win Deal: Towards Sparse and Robust Pre-trained Language Modelscited by 7
- 2024Leveraging Graph Structures to Detect Hallucinations in Large Language Modelscited by 7
- 2024Improve Dense Passage Retrieval with Entailment Tuningcited by 7
- 2024FactTest: Factuality Testing in Large Language Models with Finite-Sample and Distribution-Free Guaranteescited by 7
- 2022CsFEVER and CTKFacts: Acquiring Czech data for fact verificationcited by 6
- 2023Insights into Classifying and Mitigating LLMs' Hallucinationscited by 6
50 most cited of 108 All 108 (JSON)
- 2026From Verdict to Process: Agentic Reinforcement Learning for Multi-Stage Fact Verification11 Jun 2026
- 2026ContextClaim: A Context-Driven Paradigm for Verifiable Claim Detection31 Mar 2026
- 2026ClimateCheck 2026: Scientific Fact-Checking and Disinformation Narrative Classification of Climate-related Claims27 Mar 2026
- 2026Contradiction to Consensus: Dual Perspective, Multi Source Retrieval Based Claim Verification with Source Level Disagreement using LLM21 Feb 2026
- 2026All Leaks Count, Some Count More: Interpretable Temporal Contamination Detection and Mitigation in LLM Backtesting19 Feb 2026
- 2026TraceBack: Multi-Agent Decomposition for Fine-Grained Table Attribution13 Feb 2026
- 2026Breaking the Static Graph: Context-Aware Traversal for Robust Retrieval-Augmented Generation2 Feb 2026
- 2026DECEIVE-AFC: Adversarial Claim Attacks against Search-Enabled LLM-based Fact-Checking Systems31 Jan 2026
- 2026LLM-Based Adversarial Persuasion Attacks on Fact-Checking Systems23 Jan 2026
- 2025Detecting Corpus-Level Knowledge Inconsistencies in Wikipedia with Large Language Models27 Sep 2025
- 2025Black-Box Hallucination Detection via Consistency Under the Uncertain Expression26 Sep 2025
- 2025Adversarial Attacks Against Automated Fact-Checking: A Survey10 Sep 2025
38 more
- 2025A Cross-Modal Rumor Detection Scheme via Contrastive Learning by Exploring Text and Image internal Correlations15 Aug 2025
- 2025The Next Phase of Scientific Fact-Checking: Advanced Evidence Retrieval from Complex Structured Academic Papers25 Jun 2025
- 2025How Grounded is Wikipedia? A Study on Structured Evidential Support and Retrieval14 Jun 2025
- 2025Inter-Passage Verification for Multi-evidence Multi-answer QA31 May 2025
- 2025SemEval-2025 Task 7: Multilingual and Crosslingual Fact-Checked Claim Retrieval15 May 2025
- 2025Beyond Retrieval: Improving Evidence Quality for LLM-based Multimodal Fact-Checking6 May 2025
- 2025Bonsai: Interpretable Tree-Adaptive Grounded Reasoning4 Apr 2025
- 2025CLAIMCHECK: How Grounded are LLM Critiques of Scientific Papers?27 Mar 2025
- 2025Enhancing Multi-Hop Fact Verification with Structured Knowledge-Augmented Large Language Models11 Mar 2025
- 2025SciClaimHunt: A Large Dataset for Evidence-based Scientific Claim Verification14 Feb 2025
- 2024I Don't Know: Explicit Modeling of Uncertainty with an [IDK] Token9 Dec 2024
- 2024LLMs as Debate Partners: Utilizing Genetic Algorithms and Adversarial Search for Adaptive Arguments9 Dec 2024
- 2024Multi-hop Evidence Pursuit Meets the Web: Team Papelo at FEVER 20248 Nov 2024
- 2024Ev2R: Evaluating Evidence Retrieval in Automated Fact-Checking8 Nov 2024
- 2024FactTest: Factuality Testing in Large Language Models with Finite-Sample and Distribution-Free Guarantees4 Nov 2024
- 2024AMREx: AMR for Explainable Fact Verification2 Nov 2024
- 2024The Automated Verification of Textual Claims (AVeriTeC) Shared Task31 Oct 2024
- 2024Attacking Misinformation Detection Using Adversarial Examples Generated by Language Models28 Oct 2024
- 2024Improve Dense Passage Retrieval with Entailment Tuning21 Oct 2024
- 2024HerO at AVeriTeC: The Herd of Open Large Language Models for Verifying Real-World Claims16 Oct 2024
- 2024AIC CTU system at AVeriTeC: Re-framing automated fact-checking as a simple RAG task15 Oct 2024
- 2024Claim Verification in the Age of Large Language Models: A Survey26 Aug 2024
- 2024Leveraging Graph Structures to Detect Hallucinations in Large Language Models5 Jul 2024
- 2024Factual Confidence of LLMs: on Reliability and Robustness of Current Estimators19 Jun 2024
- 2024Multi-Layer Ranking with Large Language Models for News Source Recommendation17 Jun 2024
- 2024Peering into the Mind of Language Models: An Approach for Attribution in Contextual Question Answering28 May 2024
- 2024Multi-Evidence based Fact Verification via A Confidential Graph Neural Network17 May 2024
- 2024Hoaxpedia: A Unified Wikipedia Hoax Articles Dataset3 May 2024
- 2024Pretraining Language Models Using Translationese20 Mar 2024
- 2024ERBench: An Entity-Relationship based Automatically Verifiable Hallucination Benchmark for Large Language Models8 Mar 2024
- 2024A synthetic data approach for domain generalization of NLI models19 Feb 2024
- 2024Do We Need Language-Specific Fact-Checking Models? The Case of Chinese27 Jan 2024
- 2024Generating Zero-shot Abstractive Explanations for Rumour Verification23 Jan 2024
- 2024The Dawn After the Dark: An Empirical Study on Factuality Hallucination in Large Language Models6 Jan 2024
- 2023Pipeline and Dataset Generation for Automated Fact-checking in Almost Any Language15 Dec 2023
- 2023Unlocking Anticipatory Text Generation: A Constrained Approach for Large Language Models Decoding11 Dec 2023
- 2023Formal Proofs as Structured Explanations: Proposing Several Tasks on Explainable Natural Language Inference15 Nov 2023
- 2023Insights into Classifying and Mitigating LLMs' Hallucinations14 Nov 2023
50 newest of 108 All 108 (JSON)
- 2024AIC CTU system at AVeriTeC: Re-framing automated fact-checking as a simple RAG taskcited by 8
- 2024Improve Dense Passage Retrieval with Entailment Tuningcited by 7
- 2025Detecting Corpus-Level Knowledge Inconsistencies in Wikipedia with Large Language Modelscited by 4
- 2026Breaking the Static Graph: Context-Aware Traversal for Robust Retrieval-Augmented Generationcited by 4
- 2025Inter-Passage Verification for Multi-evidence Multi-answer QAcited by 1
- 2026Breaking the Static Graph: Context-Aware Traversal for Robust Retrieval-Augmented Generation2 Feb 2026
- 2025Detecting Corpus-Level Knowledge Inconsistencies in Wikipedia with Large Language Models27 Sep 2025
- 2025Inter-Passage Verification for Multi-evidence Multi-answer QA31 May 2025
- 2024Improve Dense Passage Retrieval with Entailment Tuning21 Oct 2024
- 2024AIC CTU system at AVeriTeC: Re-framing automated fact-checking as a simple RAG task15 Oct 2024
- 2023SelfCheckGPT: Zero-Resource Black-Box Hallucination Detection for Generative Large Language Modelscited by 810
- 2021A Survey on Automated Fact-Checkingcited by 378
- 2023LM vs LM: Detecting Factual Errors via Cross Examinationcited by 156
- 2021Automated Fact-Checking for Assisting Human Fact-Checkerscited by 144
- 2022Re2G: Retrieve, Rerank, Generatecited by 102
- 2023ExpertQA: Expert-Curated Questions and Attributed Answerscited by 97
- 2024The Dawn After the Dark: An Empirical Study on Factuality Hallucination in Large Language Modelscited by 88
- 2024Factual Confidence of LLMs: on Reliability and Robustness of Current Estimatorscited by 61
- 2021Automated Fact-Checking: A Surveycited by 55
- 2023Scientific Fact-Checking: A Survey of Resources and Approachescited by 54
- 2021ProoFVer: Natural Logic Theorem Proving for Fact Verificationcited by 53
- 2023Multimodal Automated Fact-Checking: A Surveycited by 53
12 most cited of 100 All 100 (JSON)
- 2026ContextClaim: A Context-Driven Paradigm for Verifiable Claim Detection31 Mar 2026
- 2026ClimateCheck 2026: Scientific Fact-Checking and Disinformation Narrative Classification of Climate-related Claims27 Mar 2026
- 2026Contradiction to Consensus: Dual Perspective, Multi Source Retrieval Based Claim Verification with Source Level Disagreement using LLM21 Feb 2026
- 2026All Leaks Count, Some Count More: Interpretable Temporal Contamination Detection and Mitigation in LLM Backtesting19 Feb 2026
- 2026TraceBack: Multi-Agent Decomposition for Fine-Grained Table Attribution13 Feb 2026
- 2026DECEIVE-AFC: Adversarial Claim Attacks against Search-Enabled LLM-based Fact-Checking Systems31 Jan 2026
- 2026LLM-Based Adversarial Persuasion Attacks on Fact-Checking Systems23 Jan 2026
- 2025Black-Box Hallucination Detection via Consistency Under the Uncertain Expression26 Sep 2025
- 2025Adversarial Attacks Against Automated Fact-Checking: A Survey10 Sep 2025
- 2025A Cross-Modal Rumor Detection Scheme via Contrastive Learning by Exploring Text and Image internal Correlations15 Aug 2025
- 2025The Next Phase of Scientific Fact-Checking: Advanced Evidence Retrieval from Complex Structured Academic Papers25 Jun 2025
- 2025How Grounded is Wikipedia? A Study on Structured Evidential Support and Retrieval14 Jun 2025
12 newest of 100 All 100 (JSON)