Hierarchical Graph Network for Multi-hop Question Answering
Not on the map. Why?
Abstract (arXiv)
In this paper, we present Hierarchical Graph Network (HGN) for multi-hop question answering. To aggregate clues from scattered texts across multiple paragraphs, a hierarchical graph is created by constructing nodes on different levels of granularity (questions, paragraphs, sentences, entities), the representations of which are initialized with pre-trained contextual encoders. Given this hierarchical graph, the initial node representations are updated through graph propagation, and multi-hop reasoning is performed via traversing through the graph edges for each subsequent sub-task (e.g., paragraph selection, supporting facts extraction, answer prediction). By weaving heterogeneous nodes into an integral unified graph, this hierarchical differentiation of node granularity enables HGN to support different question answering sub-tasks simultaneously. Experiments on the HotpotQA benchmark demonstrate that the proposed model achieves new state of the art, outperforming existing multi-hop QA approaches.
Key facts. Cited by 83 papers in the map (data through 14 Oct 2026). First posted on arXiv 9 Nov 2019.
Builds on
No reference list yet.
Built on by
Citing papers per year: 2021: 22; 2022: 21; 2023: 17; 2024: 9; 2025: 7; 2026: 7.
83 papers.
Sort:
By area:
- 2024HippoRAG: Neurobiologically Inspired Long-Term Memory for Large Language Modelscited by 281
- 2024Retrieval-Augmented Generation with Graphs (GraphRAG)cited by 172
- 2024LongRAG: Enhancing Retrieval-Augmented Generation with Long-context LLMscited by 108
- 2023Graphix-T5: Mixing Pre-Trained Transformers with Graph-Aware Layers for Text-to-SQL Parsingcited by 93
- 2021TransferNet: An Effective and Transparent Framework for Multi-hop Question Answering over Relation Graphcited by 60
- 2021Logic-Driven Context Extension and Data Augmentation for Logical Reasoning of Textcited by 46
- 2022Reasoning Like Program Executorscited by 45
- 2021JointLK: Joint Reasoning with Language Models and Knowledge Graphs for Commonsense Question Answeringcited by 40
- 2023End-to-End Beam Retrieval for Multi-Hop Question Answeringcited by 35
- 2024HOLMES: Hyper-Relational Knowledge Graphs for Multi-hop Question Answering using LLMscited by 24
- 2023Causal Reasoning of Entities and Events in Procedural Textscited by 23
- 2023Edgeformers: Graph-Empowered Transformers for Representation Learning on Textual-Edge Networkscited by 23
38 more
- 2021ReasonBERT: Pre-trained to Reason with Distant Supervisioncited by 22
- 2021Data-QuestEval: A Referenceless Metric for Data-to-Text Semantic Evaluationcited by 21
- 2023Chain-of-Skills: A Configurable Model for Open-domain Question Answeringcited by 19
- 2025PIKE-RAG: sPecIalized KnowledgE and Rationale Augmented Generationcited by 18
- 2021Efficient Graph Deep Learning in TensorFlow with tf_geometriccited by 17
- 2021Exploiting Reasoning Chains for Multi-hop Science Question Answeringcited by 15
- 2021Robustifying Multi-hop QA through Pseudo-Evidentiality Trainingcited by 13
- 2021Graph-free Multi-hop Reading Comprehension: A Select-to-Guide Strategycited by 13
- 2022From Easy to Hard: Two-stage Selector and Reader for Multi-hop Question Answeringcited by 12
- 2022Interpretable AMR-Based Question Decomposition for Multi-hop Question Answeringcited by 12
- 2021Mitigating False-Negative Contexts in Multi-document Question Answering with Retrieval Marginalizationcited by 10
- 2021Iterative Hierarchical Attention for Answering Complex Questions over Long Documentscited by 10
- 2022Reasoning over Hybrid Chain for Table-and-Text Open Domain QAcited by 10
- 2022Group is better than individual: Exploiting Label Topologies and Label Relations for Joint Multiple Intent Detection and Slot Fillingcited by 10
- 2021Box Embeddings: An open-source library for representation learning using geometric structurescited by 9
- 2023Learning Representations of Bi-level Knowledge Graphs for Reasoning beyond Link Predictioncited by 9
- 2024Lost-in-Distance: Impact of Contextual Proximity on LLM Performance in Graph Taskscited by 8
- 2022Counterfactual Multihop QA: A Cause-Effect Approach for Reducing Disconnected Reasoningcited by 7
- 2025Hierarchical Lexical Graph for Enhanced Multi-Hop Retrievalcited by 7
- 2021REPT: Bridging Language Models and Machine Reading Comprehension via Retrieval-Based Pre-trainingcited by 6
- 2022Question-Answer Sentence Graph for Joint Modeling Answer Selectioncited by 6
- 2022Locate Then Ask: Interpretable Stepwise Reasoning for Multi-hop Question Answeringcited by 6
- 2024FSM: A Finite State Machine Based Zero-Shot Prompting Paradigm for Multi-Hop Question Answeringcited by 6
- 2021Coarse-grained decomposition and fine-grained interaction for multi-hop question answeringcited by 5
- 2023HOP, UNION, GENERATE: Explainable Multi-hop Reasoning without Rationale Supervisioncited by 5
- 2024Next Level Message-Passing with Hierarchical Support Graphscited by 5
- 2026DF-RAG: Query-Aware Diversity for Retrieval-Augmented Generationcited by 5
- 2021A Simple Approach to Jointly Rank Passages and Select Relevant Sentences in the OBQA Contextcited by 4
- 2021Reasoning Chain Based Adversarial Attack for Multi-hop Question Answeringcited by 4
- 2022Dynamic Relevance Graph Network for Knowledge-Aware Question Answeringcited by 4
- 2022Rethinking Label Smoothing on Multi-hop Question Answeringcited by 4
- 2024Prompting Explicit and Implicit Knowledge for Multi-hop Question Answering Based on Human Reading Processcited by 4
- 2021Weakly Supervised Pre-Training for Multi-Hop Retrievercited by 3
- 2021Towards Interpretable and Reliable Reading Comprehension: A Pipeline Model with Unanswerability Predictioncited by 3
- 2022QA4QG: Using Question Answering to Constrain Multi-Hop Question Generationcited by 3
- 2022Prompt-based Conservation Learning for Multi-hop Question Answeringcited by 3
- 2023DepWiGNN: A Depth-wise Graph Neural Network for Multi-hop Spatial Reasoning in Textcited by 3
- 2025StepChain GraphRAG: Reasoning Over Knowledge Graphs for Multi-Hop Question Answeringcited by 3
50 most cited of 83 All 83 (JSON)
- 2026TRACE: Trajectory Selection for Parallel Scaling of Search Agents30 Sep 2026
- 2026Geometric Inductive Biases for Semi-Supervised Equalization: The Constellation-Aware Transformer27 Sep 2026
- 2026Dissecting Agentic RAG: A Component Ablation for Multi-Hop QA with a Local 7B Model19 Jun 2026
- 2026STRIDE: Strategic Iterative Decision-Making for Retrieval-Augmented Multi-Hop Question Answering19 Apr 2026
- 2026Failure is Feedback: History-Aware Backtracking for Agentic Traversal in Multimodal Graphs3 Feb 2026
- 2026Can David Beat Goliath? On Multi-Hop Reasoning with Resource-Constrained Agents29 Jan 2026
- 2026DF-RAG: Query-Aware Diversity for Retrieval-Augmented Generation23 Jan 2026
- 2025How Prompts Move Language Model Behavior: Frames, Salience, and Construal as Semantic Control14 Dec 2025
- 2025Question-Adaptive Graph Learning for Multi-hop Retrieval Augmented Generation13 Oct 2025
- 2025StepChain GraphRAG: Reasoning Over Knowledge Graphs for Multi-Hop Question Answering3 Oct 2025
- 2025Hierarchical Lexical Graph for Enhanced Multi-Hop Retrieval9 Jun 2025
- 2025On Synthesizing Data for Context Attribution in Question Answering21 Feb 2025
38 more
- 2025PIKE-RAG: sPecIalized KnowledgE and Rationale Augmented Generation20 Jan 2025
- 2025Bactrainus: Optimizing Large Language Models for Multi-hop Complex Question Answering Tasks10 Jan 2025
- 2024Retrieval-Augmented Generation with Graphs (GraphRAG)31 Dec 2024
- 2024SG-FSM: A Self-Guiding Zero-Shot Prompting Paradigm for Multi-Hop Question Answering Based on Finite State Machine22 Oct 2024
- 2024Lost-in-Distance: Impact of Contextual Proximity on LLM Performance in Graph Tasks2 Oct 2024
- 2024FSM: A Finite State Machine Based Zero-Shot Prompting Paradigm for Multi-Hop Question Answering3 Jul 2024
- 2024Next Level Message-Passing with Hierarchical Support Graphs22 Jun 2024
- 2024LongRAG: Enhancing Retrieval-Augmented Generation with Long-context LLMs21 Jun 2024
- 2024HOLMES: Hyper-Relational Knowledge Graphs for Multi-hop Question Answering using LLMs10 Jun 2024
- 2024HippoRAG: Neurobiologically Inspired Long-Term Memory for Large Language Models23 May 2024
- 2024Prompting Explicit and Implicit Knowledge for Multi-hop Question Answering Based on Human Reading Process29 Feb 2024
- 2023Explainable Product Classification for Customs18 Nov 2023
- 2023Perturbation-based Active Learning for Question Answering4 Nov 2023
- 2023DepWiGNN: A Depth-wise Graph Neural Network for Multi-hop Spatial Reasoning in Text19 Oct 2023
- 2023End-to-End Beam Retrieval for Multi-Hop Question Answering17 Aug 2023
- 2023Structural Embeddings of Tools for Large Language Models1 Aug 2023
- 2023Question Answering with Deep Neural Networks for Semi-Structured Heterogeneous Genealogical Knowledge Graphs30 Jul 2023
- 2023Modeling Hierarchical Reasoning Chains by Linking Discourse Units and Key Phrases for Reading Comprehension21 Jun 2023
- 2023Hybrid Graph: A Unified Graph Representation with Datasets and Benchmarks for Complex Graphs8 Jun 2023
- 2023HOP, UNION, GENERATE: Explainable Multi-hop Reasoning without Rationale Supervision23 May 2023
- 2023From Parse-Execute to Parse-Execute-Refine: Improving Semantic Parser for Complex Question Answering over Knowledge Base5 May 2023
- 2023Chain-of-Skills: A Configurable Model for Open-domain Question Answering4 May 2023
- 2023Edgeformers: Graph-Empowered Transformers for Representation Learning on Textual-Edge Networks21 Feb 2023
- 2023Analyzing the Effectiveness of the Underlying Reasoning Tasks in Multi-hop Question Answering12 Feb 2023
- 2023Learning Representations of Bi-level Knowledge Graphs for Reasoning beyond Link Prediction6 Feb 2023
- 2023Graph Attention with Hierarchies for Multi-hop Question Answering27 Jan 2023
- 2023Causal Reasoning of Entities and Events in Procedural Texts26 Jan 2023
- 2023Graphix-T5: Mixing Pre-Trained Transformers with Graph-Aware Layers for Text-to-SQL Parsing18 Jan 2023
- 2022Rethinking Label Smoothing on Multi-hop Question Answering19 Dec 2022
- 2022A Comprehensive Survey on Multi-hop Machine Reading Comprehension Approaches8 Dec 2022
- 2022A Comprehensive Survey on Multi-hop Machine Reading Comprehension Datasets and Metrics8 Dec 2022
- 2022IRRGN: An Implicit Relational Reasoning Graph Network for Multi-turn Response Selection1 Dec 2022
- 2022Question-Interlocutor Scope Realized Graph Modeling over Key Utterances for Dialogue Reading Comprehension26 Oct 2022
- 2022Group is better than individual: Exploiting Label Topologies and Label Relations for Joint Multiple Intent Detection and Slot Filling19 Oct 2022
- 2022Counterfactual Multihop QA: A Cause-Effect Approach for Reducing Disconnected Reasoning13 Oct 2022
- 2022Challenges in Explanation Quality Evaluation13 Oct 2022
- 2022Relational Graph Convolutional Neural Networks for Multihop Reasoning: A Comparative Study12 Oct 2022
- 2022How Well Do Multi-hop Reading Comprehension Models Understand Date Information?11 Oct 2022
50 newest of 83 All 83 (JSON)
- 2022Reasoning Like Program Executorscited by 45
- 2023Causal Reasoning of Entities and Events in Procedural Textscited by 23
- 2022Reasoning over Hybrid Chain for Table-and-Text Open Domain QAcited by 10
- 2022Counterfactual Multihop QA: A Cause-Effect Approach for Reducing Disconnected Reasoningcited by 7
- 2022Locate Then Ask: Interpretable Stepwise Reasoning for Multi-hop Question Answeringcited by 6
- 2024FSM: A Finite State Machine Based Zero-Shot Prompting Paradigm for Multi-Hop Question Answeringcited by 6
- 2023HOP, UNION, GENERATE: Explainable Multi-hop Reasoning without Rationale Supervisioncited by 5
- 2023DepWiGNN: A Depth-wise Graph Neural Network for Multi-hop Spatial Reasoning in Textcited by 3
- 2025StepChain GraphRAG: Reasoning Over Knowledge Graphs for Multi-Hop Question Answeringcited by 3
- 2022Discourse-Aware Graph Networks for Textual Logical Reasoningcited by 2
- 2022IRRGN: An Implicit Relational Reasoning Graph Network for Multi-turn Response Selectioncited by 2
- 2023Analyzing the Effectiveness of the Underlying Reasoning Tasks in Multi-hop Question Answeringcited by 2
12 most cited of 18 All 18 (JSON)
- 2026Can David Beat Goliath? On Multi-Hop Reasoning with Resource-Constrained Agents29 Jan 2026
- 2025StepChain GraphRAG: Reasoning Over Knowledge Graphs for Multi-Hop Question Answering3 Oct 2025
- 2024SG-FSM: A Self-Guiding Zero-Shot Prompting Paradigm for Multi-Hop Question Answering Based on Finite State Machine22 Oct 2024
- 2024FSM: A Finite State Machine Based Zero-Shot Prompting Paradigm for Multi-Hop Question Answering3 Jul 2024
- 2023DepWiGNN: A Depth-wise Graph Neural Network for Multi-hop Spatial Reasoning in Text19 Oct 2023
- 2023Modeling Hierarchical Reasoning Chains by Linking Discourse Units and Key Phrases for Reading Comprehension21 Jun 2023
- 2023HOP, UNION, GENERATE: Explainable Multi-hop Reasoning without Rationale Supervision23 May 2023
- 2023From Parse-Execute to Parse-Execute-Refine: Improving Semantic Parser for Complex Question Answering over Knowledge Base5 May 2023
- 2023Analyzing the Effectiveness of the Underlying Reasoning Tasks in Multi-hop Question Answering12 Feb 2023
- 2023Causal Reasoning of Entities and Events in Procedural Texts26 Jan 2023
- 2022IRRGN: An Implicit Relational Reasoning Graph Network for Multi-turn Response Selection1 Dec 2022
- 2022Counterfactual Multihop QA: A Cause-Effect Approach for Reducing Disconnected Reasoning13 Oct 2022
12 newest of 18 All 18 (JSON)
- 2024HippoRAG: Neurobiologically Inspired Long-Term Memory for Large Language Modelscited by 281
- 2024Retrieval-Augmented Generation with Graphs (GraphRAG)cited by 172
- 2024LongRAG: Enhancing Retrieval-Augmented Generation with Long-context LLMscited by 108
- 2025PIKE-RAG: sPecIalized KnowledgE and Rationale Augmented Generationcited by 18
- 2025Hierarchical Lexical Graph for Enhanced Multi-Hop Retrievalcited by 7
- 2026DF-RAG: Query-Aware Diversity for Retrieval-Augmented Generationcited by 5
- 2025Question-Adaptive Graph Learning for Multi-hop Retrieval Augmented Generationcited by 2
- 2026STRIDE: Strategic Iterative Decision-Making for Retrieval-Augmented Multi-Hop Question Answeringcited by 1
- 2026Dissecting Agentic RAG: A Component Ablation for Multi-Hop QA with a Local 7B Modelcited by 0
- 2026Dissecting Agentic RAG: A Component Ablation for Multi-Hop QA with a Local 7B Model19 Jun 2026
- 2026STRIDE: Strategic Iterative Decision-Making for Retrieval-Augmented Multi-Hop Question Answering19 Apr 2026
- 2026DF-RAG: Query-Aware Diversity for Retrieval-Augmented Generation23 Jan 2026
- 2025Question-Adaptive Graph Learning for Multi-hop Retrieval Augmented Generation13 Oct 2025
- 2025Hierarchical Lexical Graph for Enhanced Multi-Hop Retrieval9 Jun 2025
- 2025PIKE-RAG: sPecIalized KnowledgE and Rationale Augmented Generation20 Jan 2025
- 2024Retrieval-Augmented Generation with Graphs (GraphRAG)31 Dec 2024
- 2024LongRAG: Enhancing Retrieval-Augmented Generation with Long-context LLMs21 Jun 2024
- 2024HippoRAG: Neurobiologically Inspired Long-Term Memory for Large Language Models23 May 2024
- 2023Graphix-T5: Mixing Pre-Trained Transformers with Graph-Aware Layers for Text-to-SQL Parsingcited by 93
- 2021TransferNet: An Effective and Transparent Framework for Multi-hop Question Answering over Relation Graphcited by 60
- 2021Logic-Driven Context Extension and Data Augmentation for Logical Reasoning of Textcited by 46
- 2021JointLK: Joint Reasoning with Language Models and Knowledge Graphs for Commonsense Question Answeringcited by 40
- 2023End-to-End Beam Retrieval for Multi-Hop Question Answeringcited by 35
- 2024HOLMES: Hyper-Relational Knowledge Graphs for Multi-hop Question Answering using LLMscited by 24
- 2023Edgeformers: Graph-Empowered Transformers for Representation Learning on Textual-Edge Networkscited by 23
- 2021ReasonBERT: Pre-trained to Reason with Distant Supervisioncited by 22
- 2021Data-QuestEval: A Referenceless Metric for Data-to-Text Semantic Evaluationcited by 21
- 2023Chain-of-Skills: A Configurable Model for Open-domain Question Answeringcited by 19
- 2021Efficient Graph Deep Learning in TensorFlow with tf_geometriccited by 17
- 2021Exploiting Reasoning Chains for Multi-hop Science Question Answeringcited by 15
12 most cited of 54 All 54 (JSON)
- 2026TRACE: Trajectory Selection for Parallel Scaling of Search Agents30 Sep 2026
- 2026Geometric Inductive Biases for Semi-Supervised Equalization: The Constellation-Aware Transformer27 Sep 2026
- 2025How Prompts Move Language Model Behavior: Frames, Salience, and Construal as Semantic Control14 Dec 2025
- 2025Bactrainus: Optimizing Large Language Models for Multi-hop Complex Question Answering Tasks10 Jan 2025
- 2024Lost-in-Distance: Impact of Contextual Proximity on LLM Performance in Graph Tasks2 Oct 2024
- 2024Next Level Message-Passing with Hierarchical Support Graphs22 Jun 2024
- 2024HOLMES: Hyper-Relational Knowledge Graphs for Multi-hop Question Answering using LLMs10 Jun 2024
- 2024Prompting Explicit and Implicit Knowledge for Multi-hop Question Answering Based on Human Reading Process29 Feb 2024
- 2023Explainable Product Classification for Customs18 Nov 2023
- 2023Perturbation-based Active Learning for Question Answering4 Nov 2023
- 2023End-to-End Beam Retrieval for Multi-Hop Question Answering17 Aug 2023
- 2023Structural Embeddings of Tools for Large Language Models1 Aug 2023
12 newest of 54 All 54 (JSON)