Multi-hop Reading Comprehension through Question Decomposition and Rescoring
Not on the map. Why?
Cited by 33 in LLM reasoning, but placed by its own abstract, which didn’t fit.
Abstract (arXiv)
Multi-hop Reading Comprehension (RC) requires reasoning and aggregation across several paragraphs. We propose a system for multi-hop RC that decomposes a compositional question into simpler sub-questions that can be answered by off-the-shelf single-hop RC models. Since annotations for such decomposition are expensive, we recast sub-question generation as a span prediction problem and show that our method, trained using only 400 labeled examples, generates sub-questions that are as effective as human-authored sub-questions. We also introduce a new global rescoring approach that considers each decomposition (i.e. the sub-questions and their answers) to select the best final answer, greatly improving overall performance. Our experiments on HotpotQA show that this approach achieves the state-of-the-art results, while providing explainable evidence for its decision making in the form of sub-questions.
Key facts. Cited by 119 papers in the map (data through 14 Oct 2026). First posted on arXiv 7 Jun 2019.
Builds on
No reference list yet.
Built on by
Citing papers per year: 2021: 23; 2022: 30; 2023: 30; 2024: 15; 2025: 12; 2026: 9.
119 papers.
Sort:
By area:
- 2023Language Models Don't Always Say What They Think: Unfaithful Explanations in Chain-of-Thought Promptingcited by 1,122
- 2022Measuring and Narrowing the Compositionality Gap in Language Modelscited by 1,075
- 2021MuSiQue: Multihop Questions via Single-hop Question Compositioncited by 916
- 2021Did Aristotle Use a Laptop? A Question Answering Benchmark with Implicit Reasoning Strategiescited by 743
- 2022Towards Reasoning in Large Language Models: A Surveycited by 596
- 2022Decomposed Prompting: A Modular Approach for Solving Complex Taskscited by 558
- 2023Augmented Language Models: a Surveycited by 403
- 2022Demonstrate-Search-Predict: Composing retrieval and language models for knowledge-intensive NLPcited by 318
- 2023ADaPT: As-Needed Decomposition and Planning with Language Modelscited by 177
- 2022Internet-augmented language models through few-shot prompting for open-domain question answeringcited by 131
- 2023Complex Claim Verification with Evidence Retrieved in the Wildcited by 110
- 2023Question Decomposition Improves the Faithfulness of Model-Generated Reasoningcited by 108
38 more
- 2021Case-based Reasoning for Natural Language Queries over Knowledge Basescited by 107
- 2024Approaching Human-Level Forecasting with Language Modelscited by 107
- 2021Improving Multi-hop Knowledge Base Question Answering by Learning Intermediate Supervision Signalscited by 101
- 2023Knowledge-Driven CoT: Exploring Faithful Reasoning in LLMs for Knowledge-intensive Question Answeringcited by 97
- 2023Exploring Chain-of-Thought Style Prompting for Text-to-SQLcited by 69
- 2023Natural Language Reasoning, A Surveycited by 61
- 2022Generating Natural Language Proofs with Verifier-Guided Searchcited by 52
- 2022Is a Question Decomposition Unit All We Need?cited by 37
- 2023Explainable Claim Verification via Knowledge-Grounded Reasoning with Large Language Modelscited by 37
- 2024MoreHopQA: More Than Multi-hop Reasoningcited by 37
- 2021FaVIQ: FAct Verification from Information-seeking Questionscited by 36
- 2021Decomposing Complex Questions Makes Multi-Hop QA Easier and More Interpretablecited by 35
- 2022Natural Language Deduction through Search over Statement Compositionscited by 35
- 2021Guiding the Growth: Difficulty-Controllable Question Generation through Step-by-Step Rewritingcited by 30
- 2023The ART of LLM Refinement: Ask, Refine, and Trustcited by 29
- 2024Cofca: A Step-Wise Counterfactual Multi-hop QA benchmarkcited by 27
- 2025HopRAG: Multi-Hop Reasoning for Logic-Aware Retrieval-Augmented Generationcited by 24
- 2023Causal Reasoning of Entities and Events in Procedural Textscited by 23
- 2021Rissanen Data Analysis: Examining Dataset Characteristics via Description Lengthcited by 22
- 2023The Art of SOCRATIC QUESTIONING: Recursive Thinking with Large Language Modelscited by 22
- 2022Reasoning over Public and Private Data in Retrieval-Based Systemscited by 21
- 2021Database Reasoning Over Textcited by 20
- 2021MuMuQA: Multimedia Multi-Hop News Question Answering via Cross-Media Knowledge Extraction and Groundingcited by 19
- 2022Learning to Decompose: Hypothetical Question Decomposition Based on Comparable Textscited by 18
- 2024Chain of Logic: Rule-Based Reasoning with Large Language Modelscited by 18
- 2024Divide-or-Conquer? Which Part Should You Distill Your LLM?cited by 17
- 2024Metasql: A Generate-then-Rank Framework for Natural Language to SQL Translationcited by 17
- 2024LLMs Know What They Need: Leveraging a Missing Information Guided Framework to Empower Retrieval-Augmented Generationcited by 17
- 2023SCREWS: A Modular Framework for Reasoning with Revisionscited by 16
- 2022Measuring Compositional Consistency for Video Question Answeringcited by 15
- 2023Question Decomposition Tree for Answering Complex Questions over Knowledge Basescited by 15
- 2025MemoTime: Memory-Augmented Temporal Knowledge Graph Enhanced Large Language Model Reasoningcited by 15
- 2021Complex Factoid Question Answering with a Free-Text Knowledge Graphcited by 14
- 2023Semantic Decomposition of Question and SQL for Text-to-SQL Parsingcited by 14
- 2021Graph-free Multi-hop Reading Comprehension: A Select-to-Guide Strategycited by 13
- 2021Hey AI, Can You Solve Complex Tasks by Talking to Agents?cited by 13
- 2022From Easy to Hard: Two-stage Selector and Reader for Multi-hop Question Answeringcited by 12
- 2022Interpretable AMR-Based Question Decomposition for Multi-hop Question Answeringcited by 12
50 most cited of 119 All 119 (JSON)
- 2026Lost in Conversation or Lost in Translation? Diagnosing Multi-Turn Degradation in RAG29 Sep 2026
- 2026Clarify User Expertise: Towards Proactive Conversational Agents Tailoring Responses to User Proficiency23 Aug 2026
- 2026Towards Query-Agnostic RAG Evaluation via Query Coverage and Claim Verifiability31 Jul 2026
- 2026SANA: What Matters for QA Agents over Massive Data Lakes?11 Jun 2026
- 2026Explanation Quality Assessment as Ranking with Listwise Rewards27 Apr 2026
- 2026Towards Proactive Information Probing: Customer Service Chatbots Harvesting Value from Conversation13 Apr 2026
- 2026SoK: Agentic Retrieval-Augmented Generation (RAG): Taxonomy, Architectures, Evaluation, and Research Directions7 Mar 2026
- 2026Decomposed Prompting Does Not Fix Knowledge Gaps, But Helps Models Say "I Don't Know"4 Feb 2026
- 2026DF-RAG: Query-Aware Diversity for Retrieval-Augmented Generation23 Jan 2026
- 2025How Prompts Move Language Model Behavior: Frames, Salience, and Construal as Semantic Control14 Dec 2025
- 2025RAGSmith: A Framework for Finding the Optimal Composition of Retrieval-Augmented Generation Methods Across Datasets3 Nov 2025
- 2025PRISM: Agentic Retrieval with LLMs for Multi-Hop Question Answering16 Oct 2025
38 more
- 2025MemoTime: Memory-Augmented Temporal Knowledge Graph Enhanced Large Language Model Reasoning15 Oct 2025
- 2025StepChain GraphRAG: Reasoning Over Knowledge Graphs for Multi-Hop Question Answering3 Oct 2025
- 2025Research on Multi-hop Inference Optimization of LLM Based on MQUAKE Framework5 Sep 2025
- 2025Question Decomposition for Retrieval-Augmented Generation1 Jul 2025
- 2025SkewRoute: Training-Free LLM Routing for Knowledge Graph Retrieval-Augmented Generation via Score Skewness of Retrieved Context28 May 2025
- 2025Neuro-Symbolic Query Compiler17 May 2025
- 2025Knowledge-Aware Iterative Retrieval for Multi-Agent Systems17 Mar 2025
- 2025HopRAG: Multi-Hop Reasoning for Logic-Aware Retrieval-Augmented Generation18 Feb 2025
- 2025FRAG: A Flexible Modular Framework for Retrieval-Augmented Generation based on Knowledge Graphs17 Jan 2025
- 2024Automatic High-quality Verilog Assertion Generation through Subtask-Focused Fine-Tuned LLMs and Iterative Prompting23 Nov 2024
- 2024LEGO-GraphRAG: Modularizing Graph-based Retrieval-Augmented Generation for Design Space Exploration6 Nov 2024
- 2024Diversify-verify-adapt: Efficient and Robust Retrieval-Augmented Ambiguous Question Answering4 Sep 2024
- 2024Retrieval-Enhanced Machine Learning: Synthesis and Opportunities17 Jul 2024
- 2024DEXTER: A Benchmark for open-domain Complex Question Answering using LLMs24 Jun 2024
- 2024MoreHopQA: More Than Multi-hop Reasoning19 Jun 2024
- 2024LLMs Know What They Need: Leveraging a Missing Information Guided Framework to Empower Retrieval-Augmented Generation22 Apr 2024
- 2024Empowering Air Travelers: A Chatbot for Canadian Air Passenger Rights19 Mar 2024
- 2024Span-Oriented Information Extraction -- A Unifying Perspective on Information Extraction18 Mar 2024
- 2024Prompting Explicit and Implicit Knowledge for Multi-hop Question Answering Based on Human Reading Process29 Feb 2024
- 2024Approaching Human-Level Forecasting with Language Models28 Feb 2024
- 2024Metasql: A Generate-then-Rank Framework for Natural Language to SQL Translation27 Feb 2024
- 2024Divide-or-Conquer? Which Part Should You Distill Your LLM?22 Feb 2024
- 2024Cofca: A Step-Wise Counterfactual Multi-hop QA benchmark19 Feb 2024
- 2024Chain of Logic: Rule-Based Reasoning with Large Language Models16 Feb 2024
- 2023The ART of LLM Refinement: Ask, Refine, and Trust14 Nov 2023
- 2023On the Robustness of Question Rewriting Systems to Questions of Varying Hardness12 Nov 2023
- 2023ADaPT: As-Needed Decomposition and Planning with Language Models8 Nov 2023
- 2023Divide & Conquer for Entailment-aware Multi-hop Evidence Retrieval5 Nov 2023
- 2023Perturbation-based Active Learning for Question Answering4 Nov 2023
- 2023In-Context Ability Transfer for Question Decomposition in Complex QA26 Oct 2023
- 2023A Communication Theory Perspective on Prompting Engineering Methods for Large Language Models24 Oct 2023
- 2023Semantic Decomposition of Question and SQL for Text-to-SQL Parsing20 Oct 2023
- 2023Explainable Claim Verification via Knowledge-Grounded Reasoning with Large Language Models8 Oct 2023
- 2023SCREWS: A Modular Framework for Reasoning with Revisions20 Sep 2023
- 2023Knowledge-Driven CoT: Exploring Faithful Reasoning in LLMs for Knowledge-intensive Question Answering25 Aug 2023
- 2023Exploring Equation as a Better Intermediate Meaning Representation for Numerical Reasoning21 Aug 2023
- 2023Question Decomposition Improves the Faithfulness of Model-Generated Reasoning17 Jul 2023
- 2023DecompEval: Evaluating Generated Texts as Unsupervised Decomposed Question Answering13 Jul 2023
50 newest of 119 All 119 (JSON)
- 2023Language Models Don't Always Say What They Think: Unfaithful Explanations in Chain-of-Thought Promptingcited by 1,122
- 2022Measuring and Narrowing the Compositionality Gap in Language Modelscited by 1,075
- 2022Towards Reasoning in Large Language Models: A Surveycited by 596
- 2023Augmented Language Models: a Surveycited by 403
- 2023ADaPT: As-Needed Decomposition and Planning with Language Modelscited by 177
- 2023Question Decomposition Improves the Faithfulness of Model-Generated Reasoningcited by 108
- 2023Knowledge-Driven CoT: Exploring Faithful Reasoning in LLMs for Knowledge-intensive Question Answeringcited by 97
- 2023Exploring Chain-of-Thought Style Prompting for Text-to-SQLcited by 69
- 2023Natural Language Reasoning, A Surveycited by 61
- 2023Explainable Claim Verification via Knowledge-Grounded Reasoning with Large Language Modelscited by 37
- 2024MoreHopQA: More Than Multi-hop Reasoningcited by 37
- 2024Cofca: A Step-Wise Counterfactual Multi-hop QA benchmarkcited by 27
12 most cited of 33 All 33 (JSON)
- 2026SoK: Agentic Retrieval-Augmented Generation (RAG): Taxonomy, Architectures, Evaluation, and Research Directions7 Mar 2026
- 2025MemoTime: Memory-Augmented Temporal Knowledge Graph Enhanced Large Language Model Reasoning15 Oct 2025
- 2025StepChain GraphRAG: Reasoning Over Knowledge Graphs for Multi-Hop Question Answering3 Oct 2025
- 2025HopRAG: Multi-Hop Reasoning for Logic-Aware Retrieval-Augmented Generation18 Feb 2025
- 2025FRAG: A Flexible Modular Framework for Retrieval-Augmented Generation based on Knowledge Graphs17 Jan 2025
- 2024LEGO-GraphRAG: Modularizing Graph-based Retrieval-Augmented Generation for Design Space Exploration6 Nov 2024
- 2024MoreHopQA: More Than Multi-hop Reasoning19 Jun 2024
- 2024Divide-or-Conquer? Which Part Should You Distill Your LLM?22 Feb 2024
- 2024Cofca: A Step-Wise Counterfactual Multi-hop QA benchmark19 Feb 2024
- 2024Chain of Logic: Rule-Based Reasoning with Large Language Models16 Feb 2024
- 2023ADaPT: As-Needed Decomposition and Planning with Language Models8 Nov 2023
- 2023Explainable Claim Verification via Knowledge-Grounded Reasoning with Large Language Models8 Oct 2023
12 newest of 33 All 33 (JSON)
- 2022Demonstrate-Search-Predict: Composing retrieval and language models for knowledge-intensive NLPcited by 318
- 2024LLMs Know What They Need: Leveraging a Missing Information Guided Framework to Empower Retrieval-Augmented Generationcited by 17
- 2025Question Decomposition for Retrieval-Augmented Generationcited by 11
- 2024Diversify-verify-adapt: Efficient and Robust Retrieval-Augmented Ambiguous Question Answeringcited by 10
- 2025RAGSmith: A Framework for Finding the Optimal Composition of Retrieval-Augmented Generation Methods Across Datasetscited by 5
- 2026DF-RAG: Query-Aware Diversity for Retrieval-Augmented Generationcited by 5
- 2025Neuro-Symbolic Query Compilercited by 4
- 2025SkewRoute: Training-Free LLM Routing for Knowledge Graph Retrieval-Augmented Generation via Score Skewness of Retrieved Contextcited by 1
- 2026Towards Query-Agnostic RAG Evaluation via Query Coverage and Claim Verifiabilitycited by 1
- 2026Lost in Conversation or Lost in Translation? Diagnosing Multi-Turn Degradation in RAGcited by 0
- 2026Lost in Conversation or Lost in Translation? Diagnosing Multi-Turn Degradation in RAG29 Sep 2026
- 2026Towards Query-Agnostic RAG Evaluation via Query Coverage and Claim Verifiability31 Jul 2026
- 2026DF-RAG: Query-Aware Diversity for Retrieval-Augmented Generation23 Jan 2026
- 2025RAGSmith: A Framework for Finding the Optimal Composition of Retrieval-Augmented Generation Methods Across Datasets3 Nov 2025
- 2025Question Decomposition for Retrieval-Augmented Generation1 Jul 2025
- 2025SkewRoute: Training-Free LLM Routing for Knowledge Graph Retrieval-Augmented Generation via Score Skewness of Retrieved Context28 May 2025
- 2025Neuro-Symbolic Query Compiler17 May 2025
- 2024Diversify-verify-adapt: Efficient and Robust Retrieval-Augmented Ambiguous Question Answering4 Sep 2024
- 2024LLMs Know What They Need: Leveraging a Missing Information Guided Framework to Empower Retrieval-Augmented Generation22 Apr 2024
- 2022Demonstrate-Search-Predict: Composing retrieval and language models for knowledge-intensive NLP28 Dec 2022
- 2025PRISM: Agentic Retrieval with LLMs for Multi-Hop Question Answeringcited by 8
- 2025Knowledge-Aware Iterative Retrieval for Multi-Agent Systemscited by 1
- 2026SANA: What Matters for QA Agents over Massive Data Lakes?cited by 0
- 2026Clarify User Expertise: Towards Proactive Conversational Agents Tailoring Responses to User Proficiencycited by 0
- 2026Clarify User Expertise: Towards Proactive Conversational Agents Tailoring Responses to User Proficiency23 Aug 2026
- 2026SANA: What Matters for QA Agents over Massive Data Lakes?11 Jun 2026
- 2025PRISM: Agentic Retrieval with LLMs for Multi-Hop Question Answering16 Oct 2025
- 2025Knowledge-Aware Iterative Retrieval for Multi-Agent Systems17 Mar 2025
- 2021MuSiQue: Multihop Questions via Single-hop Question Compositioncited by 916
- 2021Did Aristotle Use a Laptop? A Question Answering Benchmark with Implicit Reasoning Strategiescited by 743
- 2022Decomposed Prompting: A Modular Approach for Solving Complex Taskscited by 558
- 2022Internet-augmented language models through few-shot prompting for open-domain question answeringcited by 131
- 2023Complex Claim Verification with Evidence Retrieved in the Wildcited by 110
- 2021Case-based Reasoning for Natural Language Queries over Knowledge Basescited by 107
- 2024Approaching Human-Level Forecasting with Language Modelscited by 107
- 2021Improving Multi-hop Knowledge Base Question Answering by Learning Intermediate Supervision Signalscited by 101
- 2022Generating Natural Language Proofs with Verifier-Guided Searchcited by 52
- 2022Is a Question Decomposition Unit All We Need?cited by 37
- 2021FaVIQ: FAct Verification from Information-seeking Questionscited by 36
- 2021Decomposing Complex Questions Makes Multi-Hop QA Easier and More Interpretablecited by 35
12 most cited of 71 All 71 (JSON)
- 2026Towards Proactive Information Probing: Customer Service Chatbots Harvesting Value from Conversation13 Apr 2026
- 2026Decomposed Prompting Does Not Fix Knowledge Gaps, But Helps Models Say "I Don't Know"4 Feb 2026
- 2025How Prompts Move Language Model Behavior: Frames, Salience, and Construal as Semantic Control14 Dec 2025
- 2025Research on Multi-hop Inference Optimization of LLM Based on MQUAKE Framework5 Sep 2025
- 2024Automatic High-quality Verilog Assertion Generation through Subtask-Focused Fine-Tuned LLMs and Iterative Prompting23 Nov 2024
- 2024Retrieval-Enhanced Machine Learning: Synthesis and Opportunities17 Jul 2024
- 2024DEXTER: A Benchmark for open-domain Complex Question Answering using LLMs24 Jun 2024
- 2024Empowering Air Travelers: A Chatbot for Canadian Air Passenger Rights19 Mar 2024
- 2024Span-Oriented Information Extraction -- A Unifying Perspective on Information Extraction18 Mar 2024
- 2024Prompting Explicit and Implicit Knowledge for Multi-hop Question Answering Based on Human Reading Process29 Feb 2024
- 2024Approaching Human-Level Forecasting with Language Models28 Feb 2024
- 2024Metasql: A Generate-then-Rank Framework for Natural Language to SQL Translation27 Feb 2024
12 newest of 71 All 71 (JSON)