mlsanityData to 7 Oct 2026

The Automated Verification of Textual Claims (AVeriTeC) Shared Task

arXiv 2410.23850 ↗First posted 31 Oct 2024cs.CLcited by 29

Not on the map. Why?

Abstract (arXiv)

The Automated Verification of Textual Claims (AVeriTeC) shared task asks participants to retrieve evidence and predict veracity for real-world claims checked by fact-checkers. Evidence can be found either via a search engine, or via a knowledge store provided by the organisers. Submissions are evaluated using AVeriTeC score, which considers a claim to be accurately verified if and only if both the verdict is correct and retrieved evidence is considered to meet a certain quality threshold. The shared task received 21 submissions, 18 of which surpassed our baseline. The winning team was TUDA_MAI with an AVeriTeC score of 63%. In this paper we describe the shared task, present the full results, and highlight key takeaways from the shared task.

Key facts. Cited by 29 papers in the map (data through 7 Oct 2026). Builds on 21 of its 50 references that are in the map. First posted on arXiv 31 Oct 2024.

Builds on

21 of 50 references.

References · 21

  1. 2020Dense Passage Retrieval for Open-Domain Question Answeringcited by 3,779
  2. 2020DeBERTa: Decoding-enhanced BERT with Disentangled Attentioncited by 2,157
  3. 2018FEVER: a large-scale dataset for Fact Extraction and VERificationcited by 1,362
  4. 2023FActScore: Fine-grained Atomic Evaluation of Factual Precision in Long Form Text Generationcited by 1,259
  5. 2023Towards General Text Embeddings with Multi-stage Contrastive Learningcited by 705
  6. 2020Fact or Fiction: Verifying Scientific Claimscited by 546
  7. 2017"Liar, Liar Pants on Fire": A New Benchmark Dataset for Fake News Detectioncited by 361
  8. 2024mGTE: Generalized Long-Context Text Representation and Reranking Models for Multilingual Text Retrievalcited by 233
  9. 2021Get Your Vitamin C! Robust Fact Verification with Contrastive Evidencecited by 222
  10. 2020Generation-Augmented Retrieval for Open-domain Question Answeringcited by 186
  11. 2019MultiFC: A Real-World Multi-Domain Dataset for Evidence-Based Fact Checking of Claimscited by 169
  12. 2021Automated Fact-Checking for Assisting Human Fact-Checkerscited by 144
9 more
  1. 2023AVeriTeC: A Dataset for Real-world Claim Verification with Evidence from the Webcited by 144
  2. 2018The Fact Extraction and VERification (FEVER) Shared Taskcited by 108
  3. 2022Missing Counter-Evidence Renders NLP Fact-Checking Unrealistic for Misinformationcited by 45
  4. 2022Varifocal Question Generation for Fact-checkingcited by 27
  5. 2024Evidence-backed Fact Checking using RAG and Few-Shot In-Context Learning with LLMscited by 23
  6. 2023The Intended Uses of Automated Fact-Checking Artefacts: Why, How and Whocited by 19
  7. 2019Automated Fact Checking in the News Roomcited by 13
  8. 2024AIC CTU system at AVeriTeC: Re-framing automated fact-checking as a simple RAG taskcited by 8
  9. 2024Zero-Shot Learning and Key Points Are All You Need for Automated Fact-Checkingcited by 3

Built on by

Cited by year (2026 to 7 Oct)

Citing papers per year: 2024: 3; 2025: 14; 2026: 12.

29 papers.

Sort:

By area:

  1. 2024DEFAME: Dynamic Evidence-based FAct-checking with Multimodal Expertscited by 42
  2. 2024Ev2R: Evaluating Evidence Retrieval in Automated Fact-Checkingcited by 18
  3. 2025SemEval-2025 Task 7: Multilingual and Crosslingual Fact-Checked Claim Retrievalcited by 11
  4. 2024FactLens: Benchmarking Fine-Grained Fact Verificationcited by 10
  5. 2025The Next Phase of Scientific Fact-Checking: Advanced Evidence Retrieval from Complex Structured Academic Paperscited by 6
  6. 2025Debating Truth: Debate-driven Claim Verification with Multiple Large Language Model Agentscited by 6
  7. 2026The Impact of AI-Generated Text on the Internetcited by 6
  8. 2026VeriTaS: The First Dynamic Benchmark for Multimodal Automated Fact-Checkingcited by 5
  9. 2025Team HUMANE at AVeriTeC 2025: HerO 2 for Efficient Fact Verificationcited by 4
  10. 2025Fact2Fiction: Targeted Poisoning Attack to Agentic Fact-checking Systemcited by 4
  11. 2025Detecting Corpus-Level Knowledge Inconsistencies in Wikipedia with Large Language Modelscited by 4
  12. 2025Attacks by Content: Automated Fact-checking is an AI Security Issuecited by 4
17 more
  1. 2025AIC CTU@FEVER 8: On-premise fact checking through long context RAGcited by 3
  2. 2026The CLEF-2026 CheckThat! Lab: Advancing Multilingual Fact-Checkingcited by 3
  3. 2025Efficiency and Effectiveness of LLM-Based Summarization of Evidence in Crowdsourced Fact-Checkingcited by 2
  4. 2025Fact-checking AI-generated news reports: Can LLMs catch their own lies?cited by 2
  5. 2025PASS-FC: Progressive and Adaptive Search Scheme for Fact Checking of Comprehensive Claimscited by 2
  6. 2026The Automatic Verification of Image-Text Claims (AVerImaTeC) Shared Taskcited by 2
  7. 2025ConspirED: A Dataset for Cognitive Traits of Conspiracy Theories and Large Language Model Safetycited by 1
  8. 2026LLM-Based Adversarial Persuasion Attacks on Fact-Checking Systemscited by 1
  9. 2025PledgeTracker: A System for Monitoring the Fulfilment of Pledgescited by 0
  10. 2025ClaimCheck: Real-Time Fact-Checking with Small Language Modelscited by 0
  11. 2026Frame-Guided Synthetic Claim Generation for Automatic Fact-Checking Using High-Volume Tabular Datacited by 0
  12. 2026VILLAIN at AVerImaTeC: Verifying Image-Text Claims via Multi-Agent Collaborationcited by 0
  13. 2026AIC CTU@AVerImaTeC: dual-retriever RAG for image-text fact checkingcited by 0
  14. 2026ClimateCheck 2026: Scientific Fact-Checking and Disinformation Narrative Classification of Climate-related Claimscited by 0
  15. 2026CAAFC: Chronological Actionable Automated Fact-Checker for misinformation / non-factual hallucination detection and correctioncited by 0
  16. 2026Cherry-pick Override: LLM Judges Under-use the Non-Directional Verdicts Their Contract Authorizescited by 0
  17. 2026MEDIAREF: A Public Knowledge Store for Media Background Checkscited by 0