mlsanityData to 7 Oct 2026

Scalable Multi-Hop Relational Reasoning for Knowledge-Aware Question Answering

arXiv 2005.00646 ↗First posted 1 May 2020cs.CL cs.LGcited by 122

Not on the map. Why?

Cited by 32 in LLM reasoning, but placed by its own abstract, which didn’t fit.

Abstract (arXiv)

Existing work on augmenting question answering (QA) models with external knowledge (e.g., knowledge graphs) either struggle to model multi-hop relations efficiently, or lack transparency into the model's prediction rationale. In this paper, we propose a novel knowledge-aware approach that equips pre-trained language models (PTLMs) with a multi-hop relational reasoning module, named multi-hop graph relation network (MHGRN). It performs multi-hop, multi-relational reasoning over subgraphs extracted from external knowledge graphs. The proposed reasoning module unifies path-based reasoning methods and graph neural networks to achieve better interpretability and scalability. We also empirically show its effectiveness and scalability on CommonsenseQA and OpenbookQA datasets, and interpret its behaviors with case studies.

Key facts. Cited by 122 papers in the map (data through 7 Oct 2026). First posted on arXiv 1 May 2020.

Builds on

No reference list yet.

Built on by

Cited by year (2026 to 7 Oct)

Citing papers per year: 2021: 20; 2022: 25; 2023: 31; 2024: 28; 2025: 10; 2026: 8.

122 papers.

Sort:

By area:

  1. 2023Unifying Large Language Models and Knowledge Graphs: A Roadmapcited by 663
  2. 2021QA-GNN: Reasoning with Language Models and Knowledge Graphs for Question Answeringcited by 386
  3. 2024Graph Retrieval-Augmented Generation: A Surveycited by 320
  4. 2022Making Large Language Models Better Reasoners with Step-Aware Verifiercited by 231
  5. 2022GreaseLM: Graph REASoning Enhanced Language Models for Question Answeringcited by 170
  6. 2022Deep Bidirectional Language-Knowledge Graph Pretrainingcited by 156
  7. 2023Active Prompting with Chain-of-Thought for Large Language Modelscited by 154
  8. 2023Large Language Models as Analogical Reasonerscited by 107
  9. 2023Cumulative Reasoning with Large Language Modelscited by 94
  10. 2022Retrieval Augmented Visual Question Answering with Outside Knowledgecited by 93
  11. 2021Common Sense Beyond English: Evaluating and Improving Multilingual Language Models for Commonsense Reasoningcited by 64
  12. 2023Graph Neural Prompting with Large Language Modelscited by 64
38 more
  1. 2023Natural Language Reasoning, A Surveycited by 61
  2. 2021RiddleSense: Reasoning about Riddle Questions Featuring Linguistic Creativity and Commonsense Knowledgecited by 60
  3. 2024KAM-CoT: Knowledge Augmented Multimodal Chain-of-Thoughts Reasoningcited by 60
  4. 2022PINTO: Faithful Language Reasoning Using Prompt-Generated Rationalescited by 56
  5. 2025Uni-cot: Towards Unified Chain-of-Thought Reasoning Across Text and Visioncited by 52
  6. 2022RHO (ρ): Reducing Hallucination in Open-domain Dialogues with Knowledge Groundingcited by 47
  7. 2024Graph-constrained Reasoning: Faithful Reasoning on Knowledge Graphs with Large Language Modelscited by 47
  8. 2021JointLK: Joint Reasoning with Language Models and Knowledge Graphs for Commonsense Question Answeringcited by 40
  9. 2021Human Parity on CommonsenseQA: Augmenting Self-Attention with External Attentioncited by 40
  10. 2022A Decade of Knowledge Graphs in Natural Language Processing: A Surveycited by 40
  11. 2023Knowledge Solver: Teaching LLMs to Search for Domain Knowledge from Knowledge Graphscited by 35
  12. 2023Graph Reasoning for Question Answering with Triplet Retrievalcited by 34
  13. 2021Meta-Knowledge Transfer for Inductive Knowledge Graph Embeddingcited by 31
  14. 2023Biomedical knowledge graph-optimized prompt generation for large language modelscited by 30
  15. 2023KnowGPT: Knowledge Graph based Prompting for Large Language Modelscited by 30
  16. 2021"I'm Not Mad": Commonsense Implications of Negation and Contradictioncited by 26
  17. 2024Question Calibration and Multi-Hop Modeling for Temporal Question Answeringcited by 25
  18. 2024Knowledge-Aware Query Expansion with Large Language Models for Textual and Relational Retrievalcited by 24
  19. 2022VQA-GNN: Reasoning with Multimodal Knowledge via Graph Neural Networks for Visual Question Answeringcited by 22
  20. 2021GNN is a Counter? Revisiting GNN for Question Answeringcited by 21
  21. 2021Think about it! Improving defeasible reasoning by first modeling the question scenariocited by 20
  22. 2024Graph-Based Retriever Captures the Long Tail of Biomedical Knowledgecited by 20
  23. 2021Refined Commonsense Knowledge from Large-Scale Web Contentscited by 19
  24. 2023Balancing Specialized and General Skills in LLMs: The Impact of Modern Tuning and Data Strategycited by 18
  25. 2024Two-stage Generative Question Answering on Temporal Knowledge Graph Using Large Language Modelscited by 18
  26. 2025Graph-based Approaches and Functionalities in Retrieval-Augmented Generation: A Comprehensive Surveycited by 18
  27. 2021Dynamic Semantic Graph Construction and Reasoning for Explainable Multi-hop Science Question Answeringcited by 17
  28. 2021SMORE: Knowledge Graph Completion and Multi-hop Reasoning in Massive Knowledge Graphscited by 17
  29. 2022Neural Methods for Logical Reasoning Over Knowledge Graphscited by 17
  30. 2023GrapeQA: GRaph Augmentation and Pruning to Enhance Question-Answeringcited by 17
  31. 2025Graph4MM: Weaving Multimodal Learning with Structural Informationcited by 17
  32. 2022ReaRev: Adaptive Reasoning for Question Answering over Knowledge Graphscited by 16
  33. 2023Structure Pretraining and Prompt Tuning for Knowledge Graph Transfercited by 16
  34. 2023Meta Prompting for AI Systemscited by 16
  35. 2021Exploiting Reasoning Chains for Multi-hop Science Question Answeringcited by 15
  36. 2022BIC: Twitter Bot Detection with Text-Graph Interaction and Semantic Consistencycited by 14
  37. 2022Empowering Language Models with Knowledge Graph Reasoning for Question Answeringcited by 14
  38. 2022A Thousand Words Are Worth More Than a Picture: Natural Language-Centric Outside-Knowledge Visual Question Answeringcited by 13

50 most cited of 122 All 122 (JSON)