HoVer: A Dataset for Many-Hop Fact Extraction And Claim Verification
Not on the map. Why?
Cited by 21 in LLM agents and tool use, but placed by its own abstract, which didn’t fit.
Abstract (arXiv)
We introduce HoVer (HOppy VERification), a dataset for many-hop evidence extraction and fact verification. It challenges models to extract facts from several Wikipedia articles that are relevant to a claim and classify whether the claim is Supported or Not-Supported by the facts. In HoVer, the claims require evidence to be extracted from as many as four English Wikipedia articles and embody reasoning graphs of diverse shapes. Moreover, most of the 3/4-hop claims are written in multiple sentences, which adds to the complexity of understanding long-range dependency relations such as coreference. We show that the performance of an existing state-of-the-art semantic-matching model degrades significantly on our dataset as the number of reasoning hops increases, hence demonstrating the necessity of many-hop reasoning to achieve strong results. We hope that the introduction of this challenging dataset and the accompanying evaluation task will encourage research in many-hop fact retrieval and information verification. We make the HoVer dataset publicly available at https://hover-nlp.github.io
Key facts. Cited by 199 papers in the map (data through 7 Oct 2026). First posted on arXiv 5 Nov 2020.
Builds on
No reference list yet.
Built on by
Citing papers per year: 2021: 17; 2022: 16; 2023: 26; 2024: 41; 2025: 43; 2026: 56.
199 papers.
Sort:
By area:
- 2021MuSiQue: Multihop Questions via Single-hop Question Compositioncited by 893
- 2024NV-Embed: Improved Techniques for Training LLMs as Generalist Embedding Modelscited by 466
- 2021ColBERTv2: Effective and Efficient Retrieval via Lightweight Late Interactioncited by 464
- 2021A Survey on Automated Fact-Checkingcited by 376
- 2022Demonstrate-Search-Predict: Composing retrieval and language models for knowledge-intensive NLPcited by 316
- 2024Optimizing Instructions and Demonstrations for Multi-Stage Language Model Programscited by 270
- 2024MultiHop-RAG: Benchmarking Retrieval-Augmented Generation for Multi-Hop Queriescited by 253
- 2021Get Your Vitamin C! Robust Fact Verification with Contrastive Evidencecited by 222
- 2023Survey on Factuality in Large Language Models: Knowledge, Retrieval and Domain-Specificitycited by 204
- 2021FEVEROUS: Fact Extraction and VERification Over Unstructured and Structured informationcited by 166
- 2023Fact-Checking Complex Claims with Program-Guided Reasoningcited by 146
- 2021ContractNLI: A Dataset for Document-level Natural Language Inference for Contractscited by 145
38 more
- 2023Complex Claim Verification with Evidence Retrieved in the Wildcited by 110
- 2021COVID-Fact: Fact Extraction and Verification of Real-World Claims on COVID-19 Pandemiccited by 100
- 2022Generating Literal and Implied Subquestions to Fact-check Complex Claimscited by 66
- 2021Baleen: Robust Multi-Hop Reasoning at Scale via Condensed Retrievalcited by 63
- 2021DialFact: A Benchmark for Fact-Checking in Dialoguecited by 62
- 2025A Systematic Survey of Automatic Prompt Optimization Techniquescited by 61
- 2022MuMiN: A Large-Scale Multilingual Multimodal Fact-Checked Misinformation Social Network Datasetcited by 59
- 2025A Survey of LLM-based Deep Search Agents: Paradigm, Optimization, Evaluation, and Challengescited by 58
- 2023FactKG: Fact Verification via Reasoning on Knowledge Graphscited by 57
- 2023Scientific Fact-Checking: A Survey of Resources and Approachescited by 53
- 2022Generating Natural Language Proofs with Verifier-Guided Searchcited by 52
- 2023SCITAB: A Challenging Benchmark for Compositional Reasoning and Claim Verification on Scientific Tablescited by 51
- 2021Fool Me Twice: Entailment from Wikipedia Gamificationcited by 50
- 2025Llama-Embed-Nemotron-8B: A Universal Text Embedding Model for Multilingual and Cross-Lingual Taskscited by 46
- 2022Missing Counter-Evidence Renders NLP Fact-Checking Unrealistic for Misinformationcited by 45
- 2022Stretching Sentence-pair NLI Models to Reason over Long Documents and Clusterscited by 44
- 2021Mention Memory: incorporating textual knowledge into Transformers through entity mention attentioncited by 42
- 2025Feedback Descent: Open-Ended Text Optimization via Pairwise Comparisoncited by 42
- 2021AmbiFC: Fact-Checking Ambiguous Claims with Evidencecited by 38
- 2022CHEF: A Pilot Chinese Dataset for Evidence-Based Fact-Checkingcited by 37
- 2023Explainable Claim Verification via Knowledge-Grounded Reasoning with Large Language Modelscited by 37
- 2021FaVIQ: FAct Verification from Information-seeking Questionscited by 36
- 2023EX-FEVER: A Dataset for Multi-hop Explainable Fact Verificationcited by 36
- 2023FactCHD: Benchmarking Fact-Conflicting Hallucination Detectioncited by 29
- 2025Show Me the Work: Fact-Checkers' Requirements for Explainable Automated Fact-Checkingcited by 29
- 2024A Survey of Useful LLM Evaluationcited by 28
- 2025Single-agent or Multi-agent Systems? Why Not Both?cited by 28
- 2023QACHECK: A Demonstration System for Question-Guided Multi-Hop Fact-Checkingcited by 26
- 2023FACTIFY-5WQA: 5W Aspect-based Fact Verification through Question Answeringcited by 24
- 2024Claim Verification in the Age of Large Language Models: A Surveycited by 23
- 2021ReasonBERT: Pre-trained to Reason with Distant Supervisioncited by 22
- 2024QuanTemp: A real-world open-domain benchmark for fact-checking numerical claimscited by 22
- 2023Self-prompted Chain-of-Thought on Large Language Models for Open-domain Multi-hop Reasoningcited by 21
- 2025A Comprehensive Survey on Reinforcement Learning-based Agentic Search: Foundations, Roles, Optimizations, Evaluations, and Applicationscited by 21
- 2024Generative Large Language Models in Automated Fact-Checking: A Surveycited by 19
- 2024FinDVer: Explainable Claim Verification over Long and Hybrid-Content Financial Documentscited by 19
- 2025FACT-AUDIT: An Adaptive Multi-Agent Framework for Dynamic Fact-Checking Evaluation of Large Language Modelscited by 19
- 2024Ev2R: Evaluating Evidence Retrieval in Automated Fact-Checkingcited by 18
50 most cited of 199 All 199 (JSON)
- 2026AdaGEPA: Adaptive Feedback Allocation for Reflective Prompt Optimization30 Sep 2026
- 2026Multi-Channel Mitigation of Source-Trust Shortcuts in Fact-Checking RL Agents29 Sep 2026
- 2026VEX-Bench: Benchmarking Verification Complexity of LLM-Generated Misinformation28 Sep 2026
- 2026OpenFC: Learning Verification Policies towards Open-Search Fact Checking27 Sep 2026
- 2026NLPG: Natural-Language Policy Gradients for Self-Evolving Language Agents27 Sep 2026
- 2026Counterfactual Self-Evolving Agents for Evidence-Grounded Reasoning26 Sep 2026
- 2026To Trust or Not to Trust: Retrieval-Augmented Fact Checking in Speech24 Sep 2026
- 2026SoK: Formal Methods for Fact-Checking and Information Integrity19 Sep 2026
- 2026Predictable Failure in Multi-Hop Retrieval: Score-Distributional Confidence Scoring and Abstention18 Sep 2026
- 2026Failure-Guided Co-Evolution of Prompts and Training Data14 Sep 2026
- 2026AgentGrad: Intervention-guided Prompt Optimization for Multi Agent Systems8 Sep 2026
- 2026How Robust Are Automated Fact-Checking Systems? A Cross-Benchmark Evaluation26 Aug 2026
38 more
- 2026Exploit More, Explore Smarter for Budget-Constrained Agentic Search24 Aug 2026
- 2026Policy Iteration with Human Feedback: Bringing Post-Training RL to In-context Learning17 Aug 2026
- 2026EvoMem: Memory-Augmented Evolution for Code Optimization11 Aug 2026
- 2026TriQua: Reconciling Granularity and Context in Factuality Evaluation5 Aug 2026
- 2026Reward-Free Evolving Agents via Pairwise Validator15 Jul 2026
- 2026MEDIAREF: A Public Knowledge Store for Media Background Checks2 Jul 2026
- 2026An Empirical Analysis of Factual Errors in Human-Written Text and Its Application to Factual Error Detection26 Jun 2026
- 2026ElementCheck: Complexity-Aware Long-Form Text Factuality Evaluation via Sentence Elements17 Jun 2026
- 2026FAPO: Fully Automated Prompt Optimization of Multi-Step LLM Pipelines17 Jun 2026
- 2026AbstRAG: Learning to Abstract for Retrieval Problems8 Jun 2026
- 2026Prompt Codebooks: Discrete Compositional Optimization for Language Model Instruction Refinement27 May 2026
- 2026Evidence Absence Is Not Evidence Insufficiency: Diagnosing NEI Construction Artifacts in Fact Verification26 May 2026
- 2026MOCHA: Multi-Objective Chebyshev Annealing for Agent Skill Optimization19 May 2026
- 2026Learning, Fast and Slow: Towards LLMs That Adapt Continually12 May 2026
- 2026Shepherd: Enabling Programmable Meta-Agents via Reversible Agentic Execution Traces11 May 2026
- 2026RW-Post: Auditable Evidence-Grounded Multimodal Fact-Checking in the Wild11 May 2026
- 2026LEVI: Stronger Search Architectures Can Substitute for Larger LLMs in Evolutionary Search10 May 2026
- 2026FlashEvolve: Accelerating Agent Self-Evolution with Asynchronous Stage Orchestration8 May 2026
- 2026Efficient Serving for Dynamic Agent Workflows with Prediction-based KV-Cache Management7 May 2026
- 2026OBLIQ-Bench: Exposing Overlooked Bottlenecks in Modern Retrievers with Latent and Implicit Queries7 May 2026
- 2026CECOR: Correction-oriented synthetic data construction for factual error correction4 May 2026
- 2026Grounding Multi-Hop Reasoning in Structural Causal Models via Group Relative Policy Optimization2 May 2026
- 2026FlowBot: Inducing LLM Workflows with Bilevel Optimization and Textual Gradients29 Apr 2026
- 2026M3-VQA: A Benchmark for Multimodal, Multi-Entity, Multi-Hop Visual Question Answering28 Apr 2026
- 2026When Misinformation Speaks and Converses: Rethinking Fact-Checking in Audio Platforms18 Apr 2026
- 2026Semantic Feature Analysis: Improving Agents Without Searching Over Rollouts12 Apr 2026
- 2026LiveFact: A Dynamic, Time-Aware Benchmark for LLM-Driven Fake News Detection6 Apr 2026
- 2026Unlocking Prompt Infilling Capability for Diffusion Language Models4 Apr 2026
- 2026Experience as a Compass: Multi-agent RAG with Evolving Orchestration and Agent Prompts1 Apr 2026
- 2026ClimateCheck 2026: Scientific Fact-Checking and Disinformation Narrative Classification of Climate-related Claims27 Mar 2026
- 2026DeepFact: Co-Evolving Benchmarks and Agents for Deep Research Factuality6 Mar 2026
- 2026Multi-Sourced, Multi-Agent Evidence Retrieval for Fact-Checking27 Feb 2026
- 2026Contradiction to Consensus: Dual Perspective, Multi Source Retrieval Based Claim Verification with Source Level Disagreement using LLM21 Feb 2026
- 2026Context Shapes LLMs Retrieval-Augmented Fact-Checking Effectiveness15 Feb 2026
- 2026The Energy of Falsehood: Detecting Hallucinations via Diffusion Model Likelihoods11 Feb 2026
- 2026SciClaimEval: Cross-modal Claim Verification in Scientific Papers7 Feb 2026
- 2026Breaking the Static Graph: Context-Aware Traversal for Robust Retrieval-Augmented Generation2 Feb 2026
- 2026Why Your Deep Research Agent Fails? On Hallucination Evaluation in Full Research Trajectory30 Jan 2026
50 newest of 199 All 199 (JSON)
- 2023Fact-Checking Complex Claims with Program-Guided Reasoningcited by 146
- 2023SCITAB: A Challenging Benchmark for Compositional Reasoning and Claim Verification on Scientific Tablescited by 51
- 2023Explainable Claim Verification via Knowledge-Grounded Reasoning with Large Language Modelscited by 37
- 2023Self-prompted Chain-of-Thought on Large Language Models for Open-domain Multi-hop Reasoningcited by 21
- 2024CHECKWHY: Causal Fact Verification via Argument Structurecited by 9
- 2023Implicit Temporal Reasoning for Evidence-Based Fact-Checkingcited by 7
- 2025LocalSearchBench: Benchmarking Agentic Search in Real-World Local Life Servicescited by 7
- 2024Information Re-Organization Improves Reasoning in Large Language Modelscited by 5
- 2025Reasoning-CV: Fine-tuning Powerful Reasoning LLMs for Knowledge-Assisted Claim Verificationcited by 5
- 2025Veri-R1: Toward Precise and Faithful Claim Verification via Online Reinforcement Learningcited by 5
- 2025Composing Policy Gradients and Prompt Optimization for Language Model Programscited by 4
- 2025STRIVE: Structured Reasoning for Self-Improvement in Claim Verificationcited by 3
12 most cited of 21 All 21 (JSON)
- 2026Grounding Multi-Hop Reasoning in Structural Causal Models via Group Relative Policy Optimization2 May 2026
- 2026M3-VQA: A Benchmark for Multimodal, Multi-Entity, Multi-Hop Visual Question Answering28 Apr 2026
- 2026Context Shapes LLMs Retrieval-Augmented Fact-Checking Effectiveness15 Feb 2026
- 2026MERMAID: Memory-Enhanced Retrieval and Reasoning with Multi-Agent Iterative Knowledge Grounding for Veracity Assessment29 Jan 2026
- 2025LocalSearchBench: Benchmarking Agentic Search in Real-World Local Life Services8 Dec 2025
- 2025Veri-R1: Toward Precise and Faithful Claim Verification via Online Reinforcement Learning2 Oct 2025
- 2025Composing Policy Gradients and Prompt Optimization for Language Model Programs6 Aug 2025
- 2025Reasoning Paths as Signals: Augmenting Multi-hop Fact Verification through Structural Reasoning Progression8 Jun 2025
- 2025ClaimPKG: Enhancing Claim Verification via Pseudo-Subgraph Generation with Lightweight Specialized LLM28 May 2025
- 2025Reasoning-CV: Fine-tuning Powerful Reasoning LLMs for Knowledge-Assisted Claim Verification18 May 2025
- 2025CRAVE: A Conflicting Reasoning Approach for Explainable Claim Verification Using LLMs21 Apr 2025
- 2025STRIVE: Structured Reasoning for Self-Improvement in Claim Verification17 Feb 2025
12 newest of 21 All 21 (JSON)
- 2025A Survey of LLM-based Deep Search Agents: Paradigm, Optimization, Evaluation, and Challengescited by 58
- 2025Single-agent or Multi-agent Systems? Why Not Both?cited by 28
- 2025FACT-AUDIT: An Adaptive Multi-Agent Framework for Dynamic Fact-Checking Evaluation of Large Language Modelscited by 19
- 2026DeepFact: Co-Evolving Benchmarks and Agents for Deep Research Factualitycited by 10
- 2026Shepherd: Enabling Programmable Meta-Agents via Reversible Agentic Execution Tracescited by 8
- 2026Why Your Deep Research Agent Fails? On Hallucination Evaluation in Full Research Trajectorycited by 5
- 2026Efficient Serving for Dynamic Agent Workflows with Prediction-based KV-Cache Managementcited by 4
- 2026Multi-Sourced, Multi-Agent Evidence Retrieval for Fact-Checkingcited by 3
- 2025Safety Degradation in AI Agentscited by 2
- 2025Recon, Answer, Verify: Agents in Search of Truthcited by 2
- 2025Hybrid Fact-Checking that Integrates Knowledge Graphs, Large Language Models, and Search-Based Retrieval Agents Improves Interpretable Claim Verificationcited by 2
- 2026FlashEvolve: Accelerating Agent Self-Evolution with Asynchronous Stage Orchestrationcited by 2
12 most cited of 18 All 18 (JSON)
- 2026NLPG: Natural-Language Policy Gradients for Self-Evolving Language Agents27 Sep 2026
- 2026AgentGrad: Intervention-guided Prompt Optimization for Multi Agent Systems8 Sep 2026
- 2026Exploit More, Explore Smarter for Budget-Constrained Agentic Search24 Aug 2026
- 2026Reward-Free Evolving Agents via Pairwise Validator15 Jul 2026
- 2026Prompt Codebooks: Discrete Compositional Optimization for Language Model Instruction Refinement27 May 2026
- 2026MOCHA: Multi-Objective Chebyshev Annealing for Agent Skill Optimization19 May 2026
- 2026Shepherd: Enabling Programmable Meta-Agents via Reversible Agentic Execution Traces11 May 2026
- 2026FlashEvolve: Accelerating Agent Self-Evolution with Asynchronous Stage Orchestration8 May 2026
- 2026Efficient Serving for Dynamic Agent Workflows with Prediction-based KV-Cache Management7 May 2026
- 2026DeepFact: Co-Evolving Benchmarks and Agents for Deep Research Factuality6 Mar 2026
- 2026Multi-Sourced, Multi-Agent Evidence Retrieval for Fact-Checking27 Feb 2026
- 2026Why Your Deep Research Agent Fails? On Hallucination Evaluation in Full Research Trajectory30 Jan 2026
12 newest of 18 All 18 (JSON)
- 2022Demonstrate-Search-Predict: Composing retrieval and language models for knowledge-intensive NLPcited by 316
- 2024MultiHop-RAG: Benchmarking Retrieval-Augmented Generation for Multi-Hop Queriescited by 253
- 2025A Comprehensive Survey on Reinforcement Learning-based Agentic Search: Foundations, Roles, Optimizations, Evaluations, and Applicationscited by 21
- 2023Enhancing LLM Intelligence with ARM-RAG: Auxiliary Rationale Memory for Retrieval Augmented Generationcited by 14
- 2024Reinforcement Retrieval Leveraging Fine-grained Feedback for Fact Checking News Claims with Black-Box LLMcited by 14
- 2025Hallucination to Truth: A Review of Fact-Checking and Factuality Evaluation in Large Language Modelscited by 13
- 2024A Reality Check on Context Utilisation for Retrieval-Augmented Generationcited by 9
- 2025Detecting Corpus-Level Knowledge Inconsistencies in Wikipedia with Large Language Modelscited by 4
- 2026Breaking the Static Graph: Context-Aware Traversal for Robust Retrieval-Augmented Generationcited by 4
- 2025Test-time Corpus Feedback: From Retrieval to RAGcited by 3
- 2025FaithLens: Detecting and Explaining Faithfulness Hallucinationcited by 3
- 2026Experience as a Compass: Multi-agent RAG with Evolving Orchestration and Agent Promptscited by 2
12 most cited of 16 All 16 (JSON)
- 2026Multi-Channel Mitigation of Source-Trust Shortcuts in Fact-Checking RL Agents29 Sep 2026
- 2026To Trust or Not to Trust: Retrieval-Augmented Fact Checking in Speech24 Sep 2026
- 2026MEDIAREF: A Public Knowledge Store for Media Background Checks2 Jul 2026
- 2026AbstRAG: Learning to Abstract for Retrieval Problems8 Jun 2026
- 2026Experience as a Compass: Multi-agent RAG with Evolving Orchestration and Agent Prompts1 Apr 2026
- 2026Breaking the Static Graph: Context-Aware Traversal for Robust Retrieval-Augmented Generation2 Feb 2026
- 2025FaithLens: Detecting and Explaining Faithfulness Hallucination23 Dec 2025
- 2025A Comprehensive Survey on Reinforcement Learning-based Agentic Search: Foundations, Roles, Optimizations, Evaluations, and Applications19 Oct 2025
- 2025Detecting Corpus-Level Knowledge Inconsistencies in Wikipedia with Large Language Models27 Sep 2025
- 2025Test-time Corpus Feedback: From Retrieval to RAG21 Aug 2025
- 2025Hallucination to Truth: A Review of Fact-Checking and Factuality Evaluation in Large Language Models5 Aug 2025
- 2024A Reality Check on Context Utilisation for Retrieval-Augmented Generation22 Dec 2024
12 newest of 16 All 16 (JSON)
- 2021MuSiQue: Multihop Questions via Single-hop Question Compositioncited by 893
- 2024NV-Embed: Improved Techniques for Training LLMs as Generalist Embedding Modelscited by 466
- 2021ColBERTv2: Effective and Efficient Retrieval via Lightweight Late Interactioncited by 464
- 2021A Survey on Automated Fact-Checkingcited by 376
- 2024Optimizing Instructions and Demonstrations for Multi-Stage Language Model Programscited by 270
- 2021Get Your Vitamin C! Robust Fact Verification with Contrastive Evidencecited by 222
- 2023Survey on Factuality in Large Language Models: Knowledge, Retrieval and Domain-Specificitycited by 204
- 2021FEVEROUS: Fact Extraction and VERification Over Unstructured and Structured informationcited by 166
- 2021ContractNLI: A Dataset for Document-level Natural Language Inference for Contractscited by 145
- 2023Complex Claim Verification with Evidence Retrieved in the Wildcited by 110
- 2021COVID-Fact: Fact Extraction and Verification of Real-World Claims on COVID-19 Pandemiccited by 100
- 2022Generating Literal and Implied Subquestions to Fact-check Complex Claimscited by 66
12 most cited of 139 All 139 (JSON)
- 2026AdaGEPA: Adaptive Feedback Allocation for Reflective Prompt Optimization30 Sep 2026
- 2026VEX-Bench: Benchmarking Verification Complexity of LLM-Generated Misinformation28 Sep 2026
- 2026OpenFC: Learning Verification Policies towards Open-Search Fact Checking27 Sep 2026
- 2026Counterfactual Self-Evolving Agents for Evidence-Grounded Reasoning26 Sep 2026
- 2026SoK: Formal Methods for Fact-Checking and Information Integrity19 Sep 2026
- 2026Predictable Failure in Multi-Hop Retrieval: Score-Distributional Confidence Scoring and Abstention18 Sep 2026
- 2026Failure-Guided Co-Evolution of Prompts and Training Data14 Sep 2026
- 2026How Robust Are Automated Fact-Checking Systems? A Cross-Benchmark Evaluation26 Aug 2026
- 2026EvoMem: Memory-Augmented Evolution for Code Optimization11 Aug 2026
- 2026TriQua: Reconciling Granularity and Context in Factuality Evaluation5 Aug 2026
- 2026An Empirical Analysis of Factual Errors in Human-Written Text and Its Application to Factual Error Detection26 Jun 2026
- 2026ElementCheck: Complexity-Aware Long-Form Text Factuality Evaluation via Sentence Elements17 Jun 2026
12 newest of 139 All 139 (JSON)