mlsanityData to 14 Oct 2026

Graph Reasoning for Question Answering with Triplet Retrieval

arXiv 2305.18742 ↗First posted 30 May 2023cs.CLcited by 34

On the map: LLM reasoning → Knowledge- and tool-augmented reasoning

Abstract (arXiv)

Answering complex questions often requires reasoning over knowledge graphs (KGs). State-of-the-art methods often utilize entities in questions to retrieve local subgraphs, which are then fed into KG encoder, e.g. graph neural networks (GNNs), to model their local structures and integrated into language models for question answering. However, this paradigm constrains retrieved knowledge in local subgraphs and discards more diverse triplets buried in KGs that are disconnected but useful for question answering. In this paper, we propose a simple yet effective method to first retrieve the most relevant triplets from KGs and then rerank them, which are then concatenated with questions to be fed into language models. Extensive results on both CommonsenseQA and OpenbookQA datasets show that our method can outperform state-of-the-art up to 4.6% absolute accuracy.

Key facts. Cited by 34 papers in the map (data through 14 Oct 2026). Placed in Knowledge- and tool-augmented reasoning, one of 17 directions in LLM reasoning. Builds on 40 of its 53 references that are in the map. First posted on arXiv 30 May 2023.

Builds on

40 of 53 references.

Closest ancestors · 1

Same direction, newest first

  1. 2022GreaseLM: Graph REASoning Enhanced Language Models for Question Answering21 Jan

Other references · 39

  1. 2018BERT: Pre-training of Deep Bidirectional Transformers for Language Understandingcited by 40,399
  2. 2019RoBERTa: A Robustly Optimized BERT Pretraining Approachcited by 13,372
  3. 2022Chain-of-Thought Prompting Elicits Reasoning in Large Language Modelscited by 12,459
  4. 2021Training Verifiers to Solve Math Word Problemscited by 10,109
  5. 2019Sentence-BERT: Sentence Embeddings using Siamese BERT-Networkscited by 9,170
  6. 2017Graph Attention Networkscited by 8,923
  7. 2020Dense Passage Retrieval for Open-Domain Question Answeringcited by 3,824
  8. 2017Billion-scale similarity search with GPUscited by 2,497
  9. 2018Can a Suit of Armor Conduct Electricity? A New Dataset for Open Book Question Answeringcited by 2,164
  10. 2022Survey of Hallucination in Natural Language Generationcited by 2,075
  11. 2019Language Models as Knowledge Bases?cited by 1,936
  12. 2017Decoupled Weight Decay Regularizationcited by 1,831
27 more
  1. 2018CommonsenseQA: A Question Answering Challenge Targeting Commonsense Knowledgecited by 1,822
  2. 2017Modeling Relational Data with Graph Convolutional Networkscited by 1,694
  3. 2016ConceptNet 5.5: An Open Multilingual Graph of General Knowledgecited by 1,067
  4. 2017SemEval-2017 Task 1: Semantic Textual Similarity - Multilingual and Cross-lingual Focused Evaluationcited by 1,001
  5. 2021FinQA: A Dataset of Numerical Reasoning over Financial Datacited by 562
  6. 2019ERNIE: Enhanced Language Representation with Informative Entitiescited by 528
  7. 2019COMET: Commonsense Transformers for Automatic Knowledge Graph Constructioncited by 450
  8. 2021QA-GNN: Reasoning with Language Models and Knowledge Graphs for Question Answeringcited by 388
  9. 2017A simple neural network module for relational reasoningcited by 346
  10. 2019KagNet: Knowledge-Aware Graph Networks for Commonsense Reasoningcited by 216
  11. 2022ConvFinQA: Exploring the Chain of Numerical Reasoning in Conversational Finance Question Answeringcited by 196
  12. 2022Deep Bidirectional Language-Knowledge Graph Pretrainingcited by 156
  13. 2020Scalable Multi-Hop Relational Reasoning for Knowledge-Aware Question Answeringcited by 122
  14. 2020JAKET: Joint Pre-training of Knowledge Graph and Language Understandingcited by 73
  15. 2020UniK-QA: Unified Representations of Structured and Unstructured Knowledge for Open-Domain Question Answeringcited by 61
  16. 2018Improving Natural Language Inference Using External Knowledge in the Science Questions Domaincited by 48
  17. 2020Connecting the Dots: A Knowledgeable Path Generator for Commonsense Question Answeringcited by 44
  18. 2021A Replication Study of Dense Passage Retrievercited by 37
  19. 2021Open Domain Question Answering with A Unified Knowledge Interfacecited by 32
  20. 2021Knowledge-Grounded Dialogue Generation with a Unified Knowledge Representationcited by 32
  21. 2021Lawyers are Dishonest? Quantifying Representational Harms in Commonsense Knowledge Resourcescited by 30
  22. 2019Align, Mask and Select: A Simple Method for Incorporating Commonsense Knowledge into Language Representation Modelscited by 28
  23. 2021Inductive Relation Prediction by BERTcited by 27
  24. 2022SKILL: Structured Knowledge Infusion for Large Language Modelscited by 27
  25. 2021GNN is a Counter? Revisiting GNN for Question Answeringcited by 21
  26. 2019Teaching Pretrained Models with Commonsense Reasoning: A Preliminary KB-Based Approachcited by 10
  27. 2022Great Truths are Always Simple: A Rather Simple Knowledge Encoder for Enhancing the Commonsense Reasoning Capacity of Pre-Trained Modelscited by 9

Built on by

Cited by year (2026 to 14 Oct)

Citing papers per year: 2023: 3; 2024: 13; 2025: 16; 2026: 2.

34 papers.

Sort:

By area:

  1. 2023Unifying Large Language Models and Knowledge Graphs: A Roadmapcited by 668
  2. 2023Reasoning on Graphs: Faithful and Interpretable Large Language Model Reasoningcited by 328
  3. 2024Graph Retrieval-Augmented Generation: A Surveycited by 324
  4. 2024Retrieval-Augmented Generation with Graphs (GraphRAG)cited by 172
  5. 2024Simple Is Effective: The Roles of Graphs and Large Language Models in Knowledge-Graph-Based Retrieval-Augmented Generationcited by 80
  6. 2024Generate-on-Graph: Treat LLM as both Agent and KG in Incomplete Knowledge Graph Question Answeringcited by 60
  7. 2024Graph-constrained Reasoning: Faithful Reasoning on Knowledge Graphs with Large Language Modelscited by 48
  8. 2025GFM-RAG: Graph Foundation Model for Retrieval Augmented Generationcited by 40
  9. 2024FiDeLiS: Faithful Reasoning in Large Language Model for Knowledge Graph Question Answeringcited by 39
  10. 2024Dual Reasoning: A GNN-LLM Collaborative Framework for Knowledge Graph Question Answeringcited by 19
  11. 2024Question-guided Knowledge Graph Re-scoring and Injection for Knowledge Graph Question Answeringcited by 13
  12. 2024RuleRAG: Rule-Guided Retrieval-Augmented Generation with Language Models for Question Answeringcited by 13
22 more
  1. 2024Large Language Models Can Better Understand Knowledge Graphs Than We Thoughtcited by 10
  2. 2024KARPA: A Training-free Method of Adapting Knowledge Graph as References for Large Language Model's Reasoning Path Aggregationcited by 7
  3. 2025Large Language Models Meet Text-Attributed Graphs: A Survey of Integration Frameworks and Applicationscited by 6
  4. 2025Learning Efficient and Generalizable Graph Retriever for Knowledge-Graph Question Answeringcited by 5
  5. 2024Combining LLMs and Knowledge Graphs to Reduce Hallucinations in Question Answeringcited by 4
  6. 2025RJE: A Retrieval-Judgment-Exploration Framework for Efficient Knowledge Graph Question Answering with LLMscited by 4
  7. 2025How to Auto-optimize Prompts for Domain Tasks? Adaptive Prompting and Reasoning through Evolutionary Domain Knowledge Adaptationcited by 4
  8. 2025ConceptFormer: Towards Efficient Use of Knowledge-Graph Embeddings in Large Language Modelscited by 3
  9. 2025GPR: Empowering Generation with Graph-Pretrained Retrievercited by 3
  10. 2023GraphextQA: A Benchmark for Evaluating Graph-Enhanced Large Language Modelscited by 2
  11. 2024Pyramid-Driven Alignment: Pyramid Principle Guided Integration of Large Language Models and Knowledge Graphscited by 2
  12. 2025ADKGD: Anomaly Detection in Knowledge Graphs with Dual-Channel Trainingcited by 2
  13. 2025Walk&Retrieve: Simple Yet Effective Zero-shot Retrieval-Augmented Generation via Knowledge Graph Walkscited by 2
  14. 2025DistRAG: Towards Distance-Based Spatial Reasoning in LLMscited by 2
  15. 2026MKG-RAG-Bench: Benchmarking Retrieval in Multimodal Knowledge Graph-Augmented Generationcited by 2
  16. 2025Guided Navigation in Knowledge-Dense Environments: Structured Semantic Exploration with Guidance Graphscited by 1
  17. 2025GRIL: Knowledge Graph Retrieval-Integrated Learning with Large Language Modelscited by 1
  18. 2025Enhancing LLM Generation with Knowledge Hypergraph for Evidence-Based Medicinecited by 0
  19. 2025KARE-RAG: Knowledge-Aware Refinement and Enhancement for RAGcited by 0
  20. 2025ARK-V1: An LLM-Agent for Knowledge Graph Question Answering Requiring Commonsense Reasoningcited by 0
  21. 2025Knowledge Graph Sparsification for GNN-based Rare Disease Diagnosiscited by 0
  22. 2026KAMR: Grounding Generation via Knowledge-Aligned Multi-hop Retrievalcited by 0

Similar, not cited

Close in wording, no citation either way

  1. 2024GNN-RAG: Graph Neural Retrieval for Large Language Model Reasoning
  2. 2023GNN2R: Weakly-Supervised Rationale-Providing Question Answering over Knowledge Graphs
  3. 2025Fusing Knowledge and Language: A Comparative Study of Knowledge Graph-Based Question Answering with LLMs
  4. 2023ReasoningLM: Enabling Structural Subgraph Reasoning in Pre-trained Language Models for Question Answering over Knowledge Graph
  5. 2024Decoding on Graphs: Faithful and Sound Reasoning on Knowledge Graphs through Generation of Well-Formed Chains
  6. 2022Subgraph Retrieval Enhanced Model for Multi-hop Knowledge Base Question Answering
  7. 2025BYOKG-RAG: Multi-Strategy Graph Retrieval for Knowledge Graph Question Answering
  8. 2024Debate on Graph: a Flexible and Reliable Reasoning Framework for Large Language Models