The Automatic Verification of Image-Text Claims (AVerImaTeC) Shared Task
Not on the map. Why?
Abstract (arXiv)
The Automatic Verification of Image-Text Claims (AVerImaTeC) shared task aims to advance system development for retrieving evidence and verifying real-world image-text claims. Participants were allowed to either employ external knowledge sources, such as web search engines, or leverage the curated knowledge store provided by the organizers. System performance was evaluated using the AVerImaTeC score, defined as a conditional verdict accuracy in which a verdict is considered correct only when the associated evidence score exceeds a predefined threshold. The shared task attracted 14 submissions during the development phase and 6 submissions during the testing phase. All participating systems in the testing phase outperformed the baseline provided. The winning team, HUMANE, achieved an AVerImaTeC score of 0.5455. This paper provides a detailed description of the shared task, presents the complete evaluation results, and discusses key insights and lessons learned.
Key facts. Cited by 2 papers in the map (data through 7 Oct 2026). Builds on 22 of its 36 references that are in the map. First posted on arXiv 11 Feb 2026.
Builds on
22 of 36 references.
References · 22
- 2021Learning Transferable Visual Models From Natural Language Supervisioncited by 33,456
- 2023Sigmoid Loss for Language Image Pre-Trainingcited by 3,048
- 2025Gemma 3 Technical Reportcited by 1,686
- 2018FEVER: a large-scale dataset for Fact Extraction and VERificationcited by 1,362
- 2025SigLIP 2: Multilingual Vision-Language Encoders with Improved Semantic Understanding, Localization, and Dense Featurescited by 1,127
- 2024ColPali: Efficient Document Retrieval with Vision Language Modelscited by 190
- 2021FEVEROUS: Fact Extraction and VERification Over Unstructured and Structured informationcited by 166
- 2023AVeriTeC: A Dataset for Real-world Claim Verification with Evidence from the Webcited by 144
- 2023Complex Claim Verification with Evidence Retrieved in the Wildcited by 110
- 2021NewsCLIPpings: Automatic Generation of Out-of-Context Multimodal Mediacited by 106
- 2022End-to-End Multimodal Fact-Checking and Explanation Generation: A Challenging Dataset and Modelscited by 105
- 2023AutoSplice: A Text-prompt Manipulated Image Dataset for Media Forensicscited by 46
10 more
- 2023VERITE: A Robust Benchmark for Multimodal Misinformation Detection Accounting for Unimodal Biascited by 37
- 2024The Automated Verification of Textual Claims (AVeriTeC) Shared Taskcited by 29
- 2022Varifocal Question Generation for Fact-checkingcited by 27
- 2024AMMeBa: A Large-Scale Survey and Dataset of Media-Based Misinformation In-The-Wildcited by 26
- 2024Open Domain Question Answering with Conflicting Contextscited by 18
- 2024Ev2R: Evaluating Evidence Retrieval in Automated Fact-Checkingcited by 18
- 2025AVerImaTeC: A Dataset for Automatic Verification of Image-Text Claims with Evidence from the Webcited by 17
- 2025Resolving Conflicting Evidence in Automated Fact-Checking: A Study on Retrieval-Augmented LLMscited by 16
- 2024HerO at AVeriTeC: The Herd of Open Large Language Models for Verifying Real-World Claimscited by 12
- 2024Similarity over Factuality: Are we making progress on multimodal out-of-context misinformation detection?cited by 11
Built on by
Citing papers per year: 2026: 2.
2 papers.