mlsanityData to 14 Oct 2026

HerO at AVeriTeC: The Herd of Open Large Language Models for Verifying Real-World Claims

arXiv 2410.12377 ↗First posted 16 Oct 2024cs.CL cs.CYcited by 12

Not on the map. Why?

Abstract (arXiv)

To tackle the AVeriTeC shared task hosted by the FEVER-24, we introduce a system that only employs publicly available large language models (LLMs) for each step of automated fact-checking, dubbed the Herd of Open LLMs for verifying real-world claims (HerO). For evidence retrieval, a language model is used to enhance a query by generating hypothetical fact-checking documents. We prompt pretrained and fine-tuned LLMs for question generation and veracity prediction by crafting prompts with retrieved in-context samples. HerO achieved 2nd place on the leaderboard with the AVeriTeC score of 0.57, suggesting the potential of open LLMs for verifying real-world claims. For future research, we make our code publicly available at https://github.com/ssu-humane/HerO.

Key facts. Cited by 12 papers in the map (data through 14 Oct 2026). Builds on 14 of its 23 references that are in the map. First posted on arXiv 16 Oct 2024.

Builds on

14 of 23 references.

References · 14

  1. 2020Language Models are Few-Shot Learnerscited by 32,419
  2. 2023GPT-4 Technical Reportcited by 18,396
  3. 2024The Llama 3 Herd of Modelscited by 14,715
  4. 2021LoRA: Low-Rank Adaptation of Large Language Modelscited by 14,380
  5. 2022OPT: Open Pre-trained Transformer Language Modelscited by 3,512
  6. 2022BLOOM: A 176B-Parameter Open-Access Multilingual Language Modelcited by 1,984
  7. 2022LaMDA: Language Models for Dialog Applicationscited by 1,220
  8. 2022Precise Zero-Shot Dense Retrieval without Relevance Labelscited by 517
  9. 2021A Survey on Automated Fact-Checkingcited by 378
  10. 2017"Liar, Liar Pants on Fire": A New Benchmark Dataset for Fake News Detectioncited by 363
  11. 2019MultiFC: A Real-World Multi-Domain Dataset for Evidence-Based Fact Checking of Claimscited by 169
  12. 2021FEVEROUS: Fact Extraction and VERification Over Unstructured and Structured informationcited by 167
2 more
  1. 2023AVeriTeC: A Dataset for Real-world Claim Verification with Evidence from the Webcited by 144
  2. 2018The Fact Extraction and VERification (FEVER) Shared Taskcited by 108

Built on by

Cited by year (2026 to 14 Oct)

Citing papers per year: 2025: 7; 2026: 5.

12 papers.

  1. 2025Debating Truth: Debate-driven Claim Verification with Multiple Large Language Model Agentscited by 6
  2. 2025Team HUMANE at AVeriTeC 2025: HerO 2 for Efficient Fact Verificationcited by 4
  3. 2025Fact2Fiction: Targeted Poisoning Attack to Agentic Fact-checking Systemcited by 4
  4. 2025Attacks by Content: Automated Fact-checking is an AI Security Issuecited by 4
  5. 2025AIC CTU@FEVER 8: On-premise fact checking through long context RAGcited by 3
  6. 2026Multi-Sourced, Multi-Agent Evidence Retrieval for Fact-Checkingcited by 3
  7. 2026The Automatic Verification of Image-Text Claims (AVerImaTeC) Shared Taskcited by 2
  8. 2026From Verdict to Process: Agentic Reinforcement Learning for Multi-Stage Fact Verificationcited by 1
  9. 2025PledgeTracker: A System for Monitoring the Fulfilment of Pledgescited by 0
  10. 2025ClaimCheck: Real-Time Fact-Checking with Small Language Modelscited by 0
  11. 2026VILLAIN at AVerImaTeC: Verifying Image-Text Claims via Multi-Agent Collaborationcited by 0
  12. 2026CAAFC: Chronological Actionable Automated Fact-Checker for misinformation / non-factual hallucination detection and correctioncited by 0