mlsanityData to 14 Oct 2026

Empowering Language Models with Knowledge Graph Reasoning for Question Answering

arXiv 2211.08380 ↗First posted 15 Nov 2022cs.CL cs.AIcited by 14

On the map: LLM reasoning → Knowledge- and tool-augmented reasoning

Abstract (arXiv)

Answering open-domain questions requires world knowledge about in-context entities. As pre-trained Language Models (LMs) lack the power to store all required knowledge, external knowledge sources, such as knowledge graphs, are often used to augment LMs. In this work, we propose knOwledge REasOning empowered Language Model (OREO-LM), which consists of a novel Knowledge Interaction Layer that can be flexibly plugged into existing Transformer-based LMs to interact with a differentiable Knowledge Graph Reasoning module collaboratively. In this way, LM guides KG to walk towards the desired answer, while the retrieved knowledge improves LM. By adopting OREO-LM to RoBERTa and T5, we show significant performance gain, achieving state-of-art results in the Closed-Book setting. The performance enhancement is mainly from the KG reasoning's capacity to infer missing relational facts. In addition, OREO-LM provides reasoning paths as rationales to interpret the model's decision.

Key facts. Cited by 14 papers in the map (data through 14 Oct 2026). Placed in Knowledge- and tool-augmented reasoning, one of 17 directions in LLM reasoning. Builds on 43 of its 58 references that are in the map. First posted on arXiv 15 Nov 2022.

Builds on

43 of 58 references.

Closest ancestors · 1

Same direction, newest first

  1. 2022GreaseLM: Graph REASoning Enhanced Language Models for Question Answering21 Jan

Other references · 42

  1. 2018BERT: Pre-training of Deep Bidirectional Transformers for Language Understandingcited by 40,399
  2. 2019Exploring the Limits of Transfer Learning with a Unified Text-to-Text Transformercited by 14,599
  3. 2020Dense Passage Retrieval for Open-Domain Question Answeringcited by 3,824
  4. 2018HotpotQA: A Dataset for Diverse, Explainable Multi-hop Question Answeringcited by 3,754
  5. 2017TriviaQA: A Large Scale Distantly Supervised Challenge Dataset for Reading Comprehensioncited by 2,955
  6. 2019XLNet: Generalized Autoregressive Pretraining for Language Understandingcited by 2,811
  7. 2020REALM: Retrieval-Augmented Language Model Pre-Trainingcited by 2,141
  8. 2017Reading Wikipedia to Answer Open-Domain Questionscited by 777
  9. 2020How Much Knowledge Can You Pack Into the Parameters of a Language Model?cited by 719
  10. 2019ERNIE: Enhanced Language Representation with Informative Entitiescited by 528
  11. 2018The Web as a Knowledge-base for Answering Complex Questionscited by 410
  12. 2021QA-GNN: Reasoning with Language Models and Knowledge Graphs for Question Answeringcited by 388
30 more
  1. 2019KEPLER: A Unified Model for Knowledge Embedding and Pre-trained Language Representationcited by 356
  2. 2020Autoregressive Entity Retrievalcited by 334
  3. 2022Generate rather than Retrieve: Large Language Models are Strong Context Generatorscited by 298
  4. 2017DeepPath: A Reinforcement Learning Method for Knowledge Graph Reasoningcited by 266
  5. 2019KagNet: Knowledge-Aware Graph Networks for Commonsense Reasoningcited by 216
  6. 2021PAQ: 65 Million Probably-Asked Questions and What You Can Do With Themcited by 200
  7. 2019PullNet: Open Domain Question Answering with Iterative Retrieval on Knowledge Bases and Textcited by 184
  8. 2020Query2box: Reasoning over Knowledge Graphs in Vector Space using Box Embeddingscited by 171
  9. 2017Go for a Walk and Arrive at the Answer: Reasoning Over Paths in Knowledge Bases using Reinforcement Learningcited by 161
  10. 2019Learning to Retrieve Reasoning Paths over Wikipedia Graph for Question Answeringcited by 147
  11. 2021Simple Entity-Centric Questions Challenge Dense Retrieverscited by 140
  12. 2020Question and Answer Test-Train Overlap in Open-Domain Question Answering Datasetscited by 138
  13. 2021End-to-End Training of Multi-Document Reader and Retriever for Open-Domain Question Answeringcited by 133
  14. 2020Scalable Multi-Hop Relational Reasoning for Knowledge-Aware Question Answeringcited by 122
  15. 2020A Survey of Knowledge-Enhanced Text Generationcited by 120
  16. 2021Case-based Reasoning for Natural Language Queries over Knowledge Basescited by 107
  17. 2020KG-BART: Knowledge Graph-Augmented BART for Generative Commonsense Reasoningcited by 106
  18. 2020Entities as Experts: Sparse Memory Access with Entity Supervisioncited by 100
  19. 2019E-BERT: Efficient-Yet-Effective Entity Embeddings for BERTcited by 96
  20. 2021End-to-End Training of Neural Retrievers for Open-Domain Question Answeringcited by 75
  21. 2020JAKET: Joint Pre-training of Knowledge Graph and Language Understandingcited by 73
  22. 2021KG-FiD: Infusing Knowledge Graph in Fusion-in-Decoder for Open-Domain Question Answeringcited by 67
  23. 2019Cognitive Graph for Multi-Hop Reading Comprehension at Scalecited by 65
  24. 2019Knowledge Guided Text Retrieval and Reading for Open Domain Question Answeringcited by 59
  25. 2021JointGT: Graph-Text Joint Representation Learning for Text Generation from Knowledge Graphscited by 58
  26. 2020Differentiable Reasoning over a Virtual Knowledge Basecited by 39
  27. 2022Knowledge Base Question Answering by Case-based Reasoning over Subgraphscited by 31
  28. 2020Differentiable Open-Ended Commonsense Reasoningcited by 29
  29. 2022Augmenting Pre-trained Language Models with QA-Memory for Open-Domain Question Answeringcited by 19
  30. 2021Relation-Guided Pre-Training for Open-Domain Question Answeringcited by 7

Built on by

Cited by year (2026 to 14 Oct)

Citing papers per year: 2022: 1; 2023: 7; 2024: 3; 2025: 2; 2026: 1.

14 papers.

Sort:

By area:

  1. 2023Unifying Large Language Models and Knowledge Graphs: A Roadmapcited by 668
  2. 2022REVEAL: Retrieval-Augmented Visual-Language Pre-Training with Multi-Source Multimodal Knowledge Memorycited by 123
  3. 2023Retrieving Multimodal Information for Augmented Generation: A Surveycited by 85
  4. 2023Give Us the Facts: Enhancing Large Language Models with Knowledge Graphs for Fact-aware Language Modelingcited by 56
  5. 2023An Overview on Language Models: Recent Developments and Outlookcited by 22
  6. 2025Graph-based Approaches and Functionalities in Retrieval-Augmented Generation: A Comprehensive Surveycited by 18
  7. 2024Socially Aware Synthetic Data Generation for Suicidal Ideation Detection Using Large Language Modelscited by 10
  8. 2023Pre-training Language Models for Comparative Reasoningcited by 6
  9. 2023Knowledge Graphs Queryingcited by 5
  10. 2023Construction contract risk identification based on knowledge-augmented language modelcited by 5
  11. 2025Knowledge Graph Enhanced Generative Multi-modal Models for Class-Incremental Learningcited by 1
  12. 2024A Knowledge-Injected Curriculum Pretraining Framework for Question Answeringcited by 0
2 more
  1. 2024Bridging the Gap: Representation Spaces in Neuro-Symbolic AIcited by 0
  2. 2026Structure-Token Evidence-Anchored Reasoning for Scientific Chart Understandingcited by 0

Similar, not cited

Close in wording, no citation either way

  1. 2022Structured Knowledge Grounding for Question Answering
  2. 2025ARK-V1: An LLM-Agent for Knowledge Graph Question Answering Requiring Commonsense Reasoning
  3. 2026Leveraging LLM-GNN Integration for Open-World Question Answering over Knowledge Graphs
  4. 2025The Role of Exploration Modules in Small Language Models for Knowledge Graph Question Answering
  5. 2023KnowledgeNavigator: Leveraging Large Language Models for Enhanced Reasoning over Knowledge Graph
  6. 2025KG-o1: Enhancing Multi-hop Question Answering in Large Language Models via Knowledge Graph Integration
  7. 2024KARPA: A Training-free Method of Adapting Knowledge Graph as References for Large Language Model's Reasoning Path Aggregation
  8. 2025RJE: A Retrieval-Judgment-Exploration Framework for Efficient Knowledge Graph Question Answering with LLMs