mlsanityData to 14 Oct 2026

Multi-hop Question Answering

arXiv 2204.09140 ↗First posted 19 Apr 2022cs.CL cs.AI cs.IRcited by 64

Not on the map. Why?

Abstract (arXiv)

The task of Question Answering (QA) has attracted significant research interest for long. Its relevance to language understanding and knowledge retrieval tasks, along with the simple setting makes the task of QA crucial for strong AI systems. Recent success on simple QA tasks has shifted the focus to more complex settings. Among these, Multi-Hop QA (MHQA) is one of the most researched tasks over the recent years. In broad terms, MHQA is the task of answering natural language questions that involve extracting and combining multiple pieces of information and doing multiple steps of reasoning. An example of a multi-hop question would be "The Argentine PGA Championship record holder has won how many tournaments worldwide?". Answering the question would need two pieces of information: "Who is the record holder for Argentine PGA Championship tournaments?" and "How many tournaments did [Answer of Sub Q1] win?". The ability to answer multi-hop questions and perform multi step reasoning can significantly improve the utility of NLP systems. Consequently, the field has seen a surge with high quality datasets, models and evaluation strategies. The notion of 'multiple hops' is somewhat abstract which results in a large variety of tasks that require multi-hop reasoning. This leads to different datasets and models that differ significantly from each other and makes the field challenging to generalize and survey. We aim to provide a general and formal definition of the MHQA task, and organize and summarize existing MHQA frameworks. We also outline some best practices for building MHQA datasets. This book provides a systematic and thorough introduction as well as the structuring of the existing attempts to this highly interesting, yet quite challenging task.

Key facts. Cited by 64 papers in the map (data through 14 Oct 2026). First posted on arXiv 19 Apr 2022.

Builds on

0 of 0 references.

No references here yet.

Built on by

Cited by year (2026 to 14 Oct)

Citing papers per year: 2022: 3; 2023: 12; 2024: 15; 2025: 19; 2026: 15.

64 papers.

Sort:

By area:

  1. 2023A Multitask, Multilingual, Multimodal Evaluation of ChatGPT on Reasoning, Hallucination, and Interactivitycited by 894
  2. 2024Replacing Judges with Juries: Evaluating LLM Generations with a Panel of Diverse Modelscited by 326
  3. 2023Query Rewriting for Retrieval-Augmented Large Language Modelscited by 213
  4. 2023Knowledge-Augmented Language Model Prompting for Zero-Shot Knowledge Graph Question Answeringcited by 119
  5. 2023Why Does ChatGPT Fall Short in Providing Truthful Answers?cited by 54
  6. 2024Retrieve, Summarize, Plan: Advancing Multi-hop Question Answering with an Iterative Approachcited by 40
  7. 2024Multi-LogiEval: Towards Evaluating Multi-Step Logical Reasoning Ability of Large Language Modelscited by 39
  8. 2023Explainable Claim Verification via Knowledge-Grounded Reasoning with Large Language Modelscited by 37
  9. 2023WaterBench: Towards Holistic Evaluation of Watermarks for Large Language Modelscited by 32
  10. 2024TurkishMMLU: Measuring Massive Multitask Language Understanding in Turkishcited by 32
  11. 2023Self-prompted Chain-of-Thought on Large Language Models for Open-domain Multi-hop Reasoningcited by 21
  12. 2024REAPER: Reasoning based Retrieval Planning for Complex RAG Systemscited by 16
38 more
  1. 2024Lost in the Middle, and In-Between: Enhancing Language Models' Ability to Reason Over Long Contexts in Multi-Hop QAcited by 13
  2. 2024Leveraging Logical Rules in Knowledge Editing: A Cherry on the Topcited by 12
  3. 2025Credible Plan-Driven RAG Method for Multi-Hop Question Answeringcited by 12
  4. 2024OmniQuery: Contextually Augmenting Captured Multimodal Memory to Enable Personal Question Answeringcited by 10
  5. 2026DeepResearch-9K: A Challenging Benchmark Dataset of Deep-Research Agentcited by 10
  6. 2025A Fano-Style Accuracy Upper Bound for LLM Single-Pass Reasoning in Multi-Hop QAcited by 9
  7. 2024RAG-based Question Answering over Heterogeneous Data and Textcited by 7
  8. 2026GRACE: Reinforcement Learning for Grounded Response and Abstention under Contextual Evidencecited by 7
  9. 2023EpiK-Eval: Evaluation for Language Models as Epistemic Modelscited by 6
  10. 2023Disentangling Extraction and Reasoning in Multi-hop Spatial Reasoningcited by 6
  11. 2025Self-Evaluating LLMs for Multi-Step Tasks: Stepwise Confidence Estimation for Failure Detectioncited by 6
  12. 2025Wrong Answers Can Also Be Useful: PlausibleQA -- A Large-Scale QA Dataset with Answer Plausibility Scorescited by 5
  13. 2025On Generalization across Measurement Systems: LLMs Entail More Test-Time Compute for Underrepresented Culturescited by 5
  14. 2025Safeguarding RAG Pipelines with GMTP: A Gradient-based Masked Token Probability Method for Poisoned Document Detectioncited by 5
  15. 2025Who's Asking? Evaluating LLM Robustness to Inquiry Personas in Factual Question Answeringcited by 5
  16. 2022Rethinking Label Smoothing on Multi-hop Question Answeringcited by 4
  17. 2023Performance Prediction for Multi-hop Questionscited by 4
  18. 2024Dr3: Ask Large Language Models Not to Give Off-Topic Answers in Open Domain Multi-Hop Question Answeringcited by 4
  19. 2024WikiHint: A Human-Annotated Dataset for Hint Ranking and Generationcited by 4
  20. 2025EpidemIQs: Prompt-to-Paper LLM Agents for Epidemic Modeling and Analysiscited by 4
  21. 2022Reasoning Circuits: Few-shot Multihop Question Generation with Structured Rationalescited by 3
  22. 2025Evaluating Multi-Hop Reasoning in Large Language Models: A Chemistry-Centric Case Studycited by 3
  23. 2025BELLE: A Bi-Level Multi-Agent Reasoning Framework for Multi-Hop Question Answeringcited by 3
  24. 2025MDBench: A Synthetic Multi-Document Reasoning Benchmark Generated with Knowledge Guidancecited by 3
  25. 2026S3-R1: Learning to Retrieve and Answer Step-by-Step with Synthetic Datacited by 3
  26. 2023Furthest Reasoning with Plan Assessment: Stable Reasoning Path with Retrieval-Augmented Large Language Modelscited by 2
  27. 2023Uncertainty Guided Global Memory Improves Multi-Hop Question Answeringcited by 2
  28. 2025QuOTE: Question-Oriented Text Embeddingscited by 2
  29. 2025Bridging Dual Knowledge Graphs for Multi-Hop Question Answering in Construction Safetycited by 2
  30. 2024AS-ES Learning: Towards Efficient CoT Learning in Small Modelscited by 1
  31. 2024Measuring text summarization factuality using atomic facts entailment metrics in the context of retrieval augmented generationcited by 1
  32. 2024Large Language Models Still Face Challenges in Multi-Hop Reasoning with External Knowledgecited by 1
  33. 2024Review-Then-Refine: A Dynamic Framework for Multi-Hop Question Answering with Temporal Adaptabilitycited by 1
  34. 2025CaresAI at BioCreative IX Track 1 -- LLM for Biomedical QAcited by 1
  35. 2025Equipping Retrieval-Augmented Large Language Models with Document Structure Awarenesscited by 1
  36. 2025MGA-VQA: Secure and Interpretable Graph-Augmented Visual Question Answering with Memory-Guided Protection Against Unauthorized Knowledge Usecited by 1
  37. 2025Leveraging Spreading Activation for Improved Document Retrieval in Knowledge-Graph-Based RAG Systemscited by 1
  38. 2026Two Pathways to Truthfulness: On the Intrinsic Encoding of LLM Hallucinationscited by 1

50 most cited of 64 All 64 (JSON)

Similar, not cited

Close in wording, no citation either way

  1. 2022Semantic Sentence Composition Reasoning for Multi-Hop Question Answering
  2. 2022From Easy to Hard: Two-stage Selector and Reader for Multi-hop Question Answering
  3. 2023Analyzing the Effectiveness of the Underlying Reasoning Tasks in Multi-hop Question Answering
  4. 2026Overview of the MedHopQA track at BioCreative IX: track description, participation and evaluation of systems for multi-hop medical question answering
  5. 2024MoreHopQA: More Than Multi-hop Reasoning
  6. 2023Answering Questions by Meta-Reasoning over Multiple Chains of Thought
  7. 2022Better Retrieval May Not Lead to Better Question Answering
  8. 2024MINTQA: A Multi-Hop Question Answering Benchmark for Evaluating LLMs on New and Tail Knowledge