Multi-hop Reading Comprehension across Multiple Documents by Reasoning over Heterogeneous Graphs
Not on the map. Why?
Abstract (arXiv)
Multi-hop reading comprehension (RC) across documents poses new challenge over single-document RC because it requires reasoning over multiple documents to reach the final answer. In this paper, we propose a new model to tackle the multi-hop RC problem. We introduce a heterogeneous graph with different types of nodes and edges, which is named as Heterogeneous Document-Entity (HDE) graph. The advantage of HDE graph is that it contains different granularity levels of information including candidates, documents and entities in specific document contexts. Our proposed model can do reasoning over the HDE graph with nodes representation initialized with co-attention and self-attention based context encoders. We employ Graph Neural Networks (GNN) based message passing algorithms to accumulate evidences on the proposed HDE graph. Evaluated on the blind test set of the Qangaroo WikiHop data set, our HDE graph based single model delivers competitive result, and the ensemble model achieves the state-of-the-art performance.
Key facts. Cited by 53 papers in the map (data through 7 Oct 2026). First posted on arXiv 17 May 2019.
Builds on
No reference list yet.
Built on by
Citing papers per year: 2021: 14; 2022: 23; 2023: 6; 2024: 4; 2025: 1; 2026: 5.
53 papers.
Sort:
By area:
- 2022A General Survey on Attention Mechanisms in Deep Learningcited by 64
- 2022A Survey of Multi-task Learning in Natural Language Processing: Regarding Task Relatedness and Training Methodscited by 42
- 2021Decomposing Complex Questions Makes Multi-Hop QA Easier and More Interpretablecited by 35
- 2023CRAB: Assessing the Strength of Causal Relationships Between Real-world Eventscited by 27
- 2025PropRAG: Guiding Retrieval with Beam Search over Proposition Pathscited by 22
- 2022HeterMPC: A Heterogeneous Graph Neural Network for Response Generation in Multi-Party Conversationscited by 16
- 2021Heterogeneous Graph Neural Networks for Keyphrase Generationcited by 15
- 2022InducT-GCN: Inductive Graph Convolutional Networks for Text Classificationcited by 15
- 2021Complex Factoid Question Answering with a Free-Text Knowledge Graphcited by 14
- 2021Graph-free Multi-hop Reading Comprehension: A Select-to-Guide Strategycited by 13
- 2022From Easy to Hard: Two-stage Selector and Reader for Multi-hop Question Answeringcited by 12
- 2021Learning Reasoning Paths over Semantic Graphs for Video-grounded Dialoguescited by 11
38 more
- 2022ME-GCN: Multi-dimensional Edge-Embedded Graph Convolutional Networks for Semi-supervised Text Classificationcited by 10
- 2022ReSel: N-ary Relation Extraction from Scientific Text and Tables by Learning to Retrieve and Selectcited by 10
- 2024MDCure: A Scalable Pipeline for Multi-Document Instruction-Followingcited by 10
- 2021Graph-Based Tri-Attention Network for Answer Ranking in CQAcited by 8
- 2021Topological Regularization for Graph Neural Networks Augmentationcited by 8
- 2024SEAM: A Stochastic Benchmark for Multi-Document Taskscited by 8
- 2022Beyond the Granularity: Multi-Perspective Dialogue Collaborative Selection for Dialogue State Trackingcited by 6
- 2022Locate Then Ask: Interpretable Stepwise Reasoning for Multi-hop Question Answeringcited by 6
- 2024FSM: A Finite State Machine Based Zero-Shot Prompting Paradigm for Multi-Hop Question Answeringcited by 6
- 2021Coarse-grained decomposition and fine-grained interaction for multi-hop question answeringcited by 5
- 2022Graph Neural Networks: a bibliometrics overviewcited by 5
- 2023HOP, UNION, GENERATE: Explainable Multi-hop Reasoning without Rationale Supervisioncited by 5
- 2021Memory Augmented Sequential Paragraph Retrieval for Multi-hop Question Answeringcited by 4
- 2021Reasoning Chain Based Adversarial Attack for Multi-hop Question Answeringcited by 4
- 2022Understanding Graph Convolutional Networks for Text Classificationcited by 4
- 2022IMCI: Integrate Multi-view Contextual Information for Fact Extraction and Verificationcited by 3
- 2022Context-Aware Query Rewriting for Improving Users' Search Experience on E-commerce Websitescited by 3
- 2023LUKE-Graph: A Transformer-based Approach with Gated Relational Graph Attention for Cloze-style Reading Comprehensioncited by 3
- 2021Ensemble Learning-Based Approach for Improving Generalization Capability of Machine Reading Comprehension Systemscited by 2
- 2022Ask to Understand: Question Generation for Multi-hop Question Answeringcited by 2
- 2022Discourse-Aware Graph Networks for Textual Logical Reasoningcited by 2
- 2022Getting the Most out of Simile Recognitioncited by 2
- 2022IRRGN: An Implicit Relational Reasoning Graph Network for Multi-turn Response Selectioncited by 2
- 2023Analyzing the Effectiveness of the Underlying Reasoning Tasks in Multi-hop Question Answeringcited by 2
- 2024SG-FSM: A Self-Guiding Zero-Shot Prompting Paradigm for Multi-Hop Question Answering Based on Finite State Machinecited by 2
- 2021ClueReader: Heterogeneous Graph Attention Network for Multi-hop Machine Reading Comprehensioncited by 1
- 2022How Well Do Multi-hop Reading Comprehension Models Understand Date Information?cited by 1
- 2022Relational Graph Convolutional Neural Networks for Multihop Reasoning: A Comparative Studycited by 1
- 2022A Comprehensive Survey on Multi-hop Machine Reading Comprehension Approachescited by 1
- 2022Medical Knowledge Graph QA for Drug-Drug Interaction Prediction based on Multi-hop Machine Reading Comprehensioncited by 1
- 2023Graph Attention with Hierarchies for Multi-hop Question Answeringcited by 1
- 2023Integrating a Heterogeneous Graph with Entity-aware Self-attention using Relative Position Labels for Reading Comprehension Modelcited by 1
- 2026KEPo: Knowledge Evolution Poison on Graph-based Retrieval-Augmented Generationcited by 1
- 2021Deep Neural Networks for Relation Extractioncited by 0
- 2021Does Structure Matter? Leveraging Data-to-Text Generation for Answering Complex Information Needscited by 0
- 2022elBERto: Self-supervised Commonsense Learning for Question Answeringcited by 0
- 2022Syntax-informed Question Answering with Heterogeneous Graph Transformercited by 0
- 2026SemEval-2026 Task 12: Abductive Event Reasoning: Towards Real-World Event Causal Inference for Large Language Modelscited by 0
50 most cited of 53 All 53 (JSON)
- 2026KAP: Bridging the Knowledge Selection-Runtime Consumption Gap in LLM Systems27 Jul 2026
- 2026RED-PIM: Reducing Data Movement for Transformers using Processing-in-Memory23 Jul 2026
- 2026When Verification Fails: How Compositionally Infeasible Claims Escape Rejection13 Apr 2026
- 2026SemEval-2026 Task 12: Abductive Event Reasoning: Towards Real-World Event Causal Inference for Large Language Models23 Mar 2026
- 2026KEPo: Knowledge Evolution Poison on Graph-based Retrieval-Augmented Generation12 Mar 2026
- 2025PropRAG: Guiding Retrieval with Beam Search over Proposition Paths25 Apr 2025
- 2024MDCure: A Scalable Pipeline for Multi-Document Instruction-Following30 Oct 2024
- 2024SG-FSM: A Self-Guiding Zero-Shot Prompting Paradigm for Multi-Hop Question Answering Based on Finite State Machine22 Oct 2024
- 2024FSM: A Finite State Machine Based Zero-Shot Prompting Paradigm for Multi-Hop Question Answering3 Jul 2024
- 2024SEAM: A Stochastic Benchmark for Multi-Document Tasks23 Jun 2024
- 2023CRAB: Assessing the Strength of Causal Relationships Between Real-world Events7 Nov 2023
- 2023Integrating a Heterogeneous Graph with Entity-aware Self-attention using Relative Position Labels for Reading Comprehension Model19 Jul 2023
38 more
- 2023HOP, UNION, GENERATE: Explainable Multi-hop Reasoning without Rationale Supervision23 May 2023
- 2023LUKE-Graph: A Transformer-based Approach with Gated Relational Graph Attention for Cloze-style Reading Comprehension12 Mar 2023
- 2023Analyzing the Effectiveness of the Underlying Reasoning Tasks in Multi-hop Question Answering12 Feb 2023
- 2023Graph Attention with Hierarchies for Multi-hop Question Answering27 Jan 2023
- 2022Medical Knowledge Graph QA for Drug-Drug Interaction Prediction based on Multi-hop Machine Reading Comprehension19 Dec 2022
- 2022A Comprehensive Survey on Multi-hop Machine Reading Comprehension Approaches8 Dec 2022
- 2022IRRGN: An Implicit Relational Reasoning Graph Network for Multi-turn Response Selection1 Dec 2022
- 2022Getting the Most out of Simile Recognition11 Nov 2022
- 2022ReSel: N-ary Relation Extraction from Scientific Text and Tables by Learning to Retrieve and Select26 Oct 2022
- 2022Relational Graph Convolutional Neural Networks for Multihop Reasoning: A Comparative Study12 Oct 2022
- 2022How Well Do Multi-hop Reading Comprehension Models Understand Date Information?11 Oct 2022
- 2022Context-Aware Query Rewriting for Improving Users' Search Experience on E-commerce Websites15 Sep 2022
- 2022IMCI: Integrate Multi-view Contextual Information for Fact Extraction and Verification30 Aug 2022
- 2022Locate Then Ask: Interpretable Stepwise Reasoning for Multi-hop Question Answering22 Aug 2022
- 2022Discourse-Aware Graph Networks for Textual Logical Reasoning4 Jul 2022
- 2022InducT-GCN: Inductive Graph Convolutional Networks for Text Classification1 Jun 2022
- 2022From Easy to Hard: Two-stage Selector and Reader for Multi-hop Question Answering24 May 2022
- 2022Beyond the Granularity: Multi-Perspective Dialogue Collaborative Selection for Dialogue State Tracking20 May 2022
- 2022ME-GCN: Multi-dimensional Edge-Embedded Graph Convolutional Networks for Semi-supervised Text Classification10 Apr 2022
- 2022A Survey of Multi-task Learning in Natural Language Processing: Regarding Task Relatedness and Training Methods7 Apr 2022
- 2022Syntax-informed Question Answering with Heterogeneous Graph Transformer1 Apr 2022
- 2022Understanding Graph Convolutional Networks for Text Classification30 Mar 2022
- 2022A General Survey on Attention Mechanisms in Deep Learning27 Mar 2022
- 2022elBERto: Self-supervised Commonsense Learning for Question Answering17 Mar 2022
- 2022Ask to Understand: Question Generation for Multi-hop Question Answering17 Mar 2022
- 2022HeterMPC: A Heterogeneous Graph Neural Network for Response Generation in Multi-Party Conversations16 Mar 2022
- 2022Graph Neural Networks: a bibliometrics overview3 Jan 2022
- 2021Reasoning Chain Based Adversarial Attack for Multi-hop Question Answering17 Dec 2021
- 2021Does Structure Matter? Leveraging Data-to-Text Generation for Answering Complex Information Needs8 Dec 2021
- 2021Decomposing Complex Questions Makes Multi-Hop QA Easier and More Interpretable26 Oct 2021
- 2021Heterogeneous Graph Neural Networks for Keyphrase Generation10 Sep 2021
- 2021Graph-free Multi-hop Reading Comprehension: A Select-to-Guide Strategy25 Jul 2021
- 2021ClueReader: Heterogeneous Graph Attention Network for Multi-hop Machine Reading Comprehension2 Jul 2021
- 2021Ensemble Learning-Based Approach for Improving Generalization Capability of Machine Reading Comprehension Systems1 Jul 2021
- 2021Deep Neural Networks for Relation Extraction5 Apr 2021
- 2021Topological Regularization for Graph Neural Networks Augmentation3 Apr 2021
- 2021Complex Factoid Question Answering with a Free-Text Knowledge Graph23 Mar 2021
- 2021Graph-Based Tri-Attention Network for Answer Ranking in CQA5 Mar 2021
50 newest of 53 All 53 (JSON)
- 2022Locate Then Ask: Interpretable Stepwise Reasoning for Multi-hop Question Answeringcited by 6
- 2024FSM: A Finite State Machine Based Zero-Shot Prompting Paradigm for Multi-Hop Question Answeringcited by 6
- 2023HOP, UNION, GENERATE: Explainable Multi-hop Reasoning without Rationale Supervisioncited by 5
- 2022Discourse-Aware Graph Networks for Textual Logical Reasoningcited by 2
- 2022IRRGN: An Implicit Relational Reasoning Graph Network for Multi-turn Response Selectioncited by 2
- 2023Analyzing the Effectiveness of the Underlying Reasoning Tasks in Multi-hop Question Answeringcited by 2
- 2024SG-FSM: A Self-Guiding Zero-Shot Prompting Paradigm for Multi-Hop Question Answering Based on Finite State Machinecited by 2
- 2022How Well Do Multi-hop Reading Comprehension Models Understand Date Information?cited by 1
- 2022Relational Graph Convolutional Neural Networks for Multihop Reasoning: A Comparative Studycited by 1
- 2024SG-FSM: A Self-Guiding Zero-Shot Prompting Paradigm for Multi-Hop Question Answering Based on Finite State Machine22 Oct 2024
- 2024FSM: A Finite State Machine Based Zero-Shot Prompting Paradigm for Multi-Hop Question Answering3 Jul 2024
- 2023HOP, UNION, GENERATE: Explainable Multi-hop Reasoning without Rationale Supervision23 May 2023
- 2023Analyzing the Effectiveness of the Underlying Reasoning Tasks in Multi-hop Question Answering12 Feb 2023
- 2022IRRGN: An Implicit Relational Reasoning Graph Network for Multi-turn Response Selection1 Dec 2022
- 2022Relational Graph Convolutional Neural Networks for Multihop Reasoning: A Comparative Study12 Oct 2022
- 2022How Well Do Multi-hop Reading Comprehension Models Understand Date Information?11 Oct 2022
- 2022Locate Then Ask: Interpretable Stepwise Reasoning for Multi-hop Question Answering22 Aug 2022
- 2022Discourse-Aware Graph Networks for Textual Logical Reasoning4 Jul 2022
- 2022A General Survey on Attention Mechanisms in Deep Learningcited by 64
- 2022A Survey of Multi-task Learning in Natural Language Processing: Regarding Task Relatedness and Training Methodscited by 42
- 2021Decomposing Complex Questions Makes Multi-Hop QA Easier and More Interpretablecited by 35
- 2023CRAB: Assessing the Strength of Causal Relationships Between Real-world Eventscited by 27
- 2022HeterMPC: A Heterogeneous Graph Neural Network for Response Generation in Multi-Party Conversationscited by 16
- 2021Heterogeneous Graph Neural Networks for Keyphrase Generationcited by 15
- 2022InducT-GCN: Inductive Graph Convolutional Networks for Text Classificationcited by 15
- 2021Complex Factoid Question Answering with a Free-Text Knowledge Graphcited by 14
- 2021Graph-free Multi-hop Reading Comprehension: A Select-to-Guide Strategycited by 13
- 2022From Easy to Hard: Two-stage Selector and Reader for Multi-hop Question Answeringcited by 12
- 2021Learning Reasoning Paths over Semantic Graphs for Video-grounded Dialoguescited by 11
- 2022ME-GCN: Multi-dimensional Edge-Embedded Graph Convolutional Networks for Semi-supervised Text Classificationcited by 10
12 most cited of 41 All 41 (JSON)
- 2026RED-PIM: Reducing Data Movement for Transformers using Processing-in-Memory23 Jul 2026
- 2026When Verification Fails: How Compositionally Infeasible Claims Escape Rejection13 Apr 2026
- 2026SemEval-2026 Task 12: Abductive Event Reasoning: Towards Real-World Event Causal Inference for Large Language Models23 Mar 2026
- 2024MDCure: A Scalable Pipeline for Multi-Document Instruction-Following30 Oct 2024
- 2024SEAM: A Stochastic Benchmark for Multi-Document Tasks23 Jun 2024
- 2023CRAB: Assessing the Strength of Causal Relationships Between Real-world Events7 Nov 2023
- 2023Integrating a Heterogeneous Graph with Entity-aware Self-attention using Relative Position Labels for Reading Comprehension Model19 Jul 2023
- 2023LUKE-Graph: A Transformer-based Approach with Gated Relational Graph Attention for Cloze-style Reading Comprehension12 Mar 2023
- 2023Graph Attention with Hierarchies for Multi-hop Question Answering27 Jan 2023
- 2022Medical Knowledge Graph QA for Drug-Drug Interaction Prediction based on Multi-hop Machine Reading Comprehension19 Dec 2022
- 2022A Comprehensive Survey on Multi-hop Machine Reading Comprehension Approaches8 Dec 2022
- 2022Getting the Most out of Simile Recognition11 Nov 2022
12 newest of 41 All 41 (JSON)