mlsanityData to 7 Oct 2026

Retrieve-Rewrite-Answer: A KG-to-Text Enhanced LLMs Framework for Knowledge Graph Question Answering

arXiv 2309.11206 ↗First posted 20 Sep 2023cs.CL cs.AIcited by 64

Not on the map. Why?

Cited by 24 in LLM reasoning, but placed by its own abstract, which didn’t fit.

Abstract (arXiv)

Despite their competitive performance on knowledge-intensive tasks, large language models (LLMs) still have limitations in memorizing all world knowledge especially long tail knowledge. In this paper, we study the KG-augmented language model approach for solving the knowledge graph question answering (KGQA) task that requires rich world knowledge. Existing work has shown that retrieving KG knowledge to enhance LLMs prompting can significantly improve LLMs performance in KGQA. However, their approaches lack a well-formed verbalization of KG knowledge, i.e., they ignore the gap between KG representations and textual representations. To this end, we propose an answer-sensitive KG-to-Text approach that can transform KG knowledge into well-textualized statements most informative for KGQA. Based on this approach, we propose a KG-to-Text enhanced LLMs framework for solving the KGQA task. Experiments on several KGQA benchmarks show that the proposed KG-to-Text augmented LLMs approach outperforms previous KG-augmented LLMs approaches regarding answer accuracy and usefulness of knowledge statements.

Key facts. Cited by 64 papers in the map (data through 7 Oct 2026). Builds on 36 of its 45 references that are in the map. First posted on arXiv 20 Sep 2023.

Builds on

36 of 45 references.

References · 36

  1. 2017Attention Is All You Needcited by 59,932
  2. 2019Exploring the Limits of Transfer Learning with a Unified Text-to-Text Transformercited by 14,491
  3. 2021LoRA: Low-Rank Adaptation of Large Language Modelscited by 14,084
  4. 2023LLaMA: Open and Efficient Foundation Language Modelscited by 13,958
  5. 2023Llama 2: Open Foundation and Fine-Tuned Chat Modelscited by 12,865
  6. 2017Graph Attention Networkscited by 8,854
  7. 2019BART: Denoising Sequence-to-Sequence Pre-training for Natural Language Generation, Translation, and Comprehensioncited by 5,874
  8. 2022Scaling Instruction-Finetuned Language Modelscited by 2,997
  9. 2022Survey of Hallucination in Natural Language Generationcited by 2,056
  10. 2021Multitask Prompted Training Enables Zero-Shot Task Generalizationcited by 1,462
  11. 2022When Not to Trust Language Models: Investigating Effectiveness of Parametric and Non-Parametric Memoriescited by 1,103
  12. 2018Object Hallucination in Image Captioningcited by 661
24 more
  1. 2018The Web as a Knowledge-base for Answering Complex Questionscited by 409
  2. 2021Internet-Augmented Dialogue Generationcited by 217
  3. 2017Variational Reasoning for Question Answering with Knowledge Graphcited by 170
  4. 2023HuaTuo: Tuning LLaMA Model with Chinese Medical Knowledgecited by 161
  5. 2023AugGPT: Leveraging ChatGPT for Text Data Augmentationcited by 128
  6. 2019Text Generation from Knowledge Graphs with Graph Transformerscited by 122
  7. 2020Investigating Pretrained Language Models for Graph-to-Text Generationcited by 117
  8. 2019Graph Transformer for Graph-to-Sequence Learningcited by 82
  9. 2022Sequence-to-Sequence Knowledge Graph Completion and Question Answeringcited by 75
  10. 2019Barack's Wife Hillary: Using Knowledge-Graphs for Fact-Aware Language Modelingcited by 71
  11. 2022Mintaka: A Complex, Natural, and Multilingual Dataset for End-to-End Question Answeringcited by 71
  12. 2023BBT-Fin: Comprehensive Construction of Chinese Financial Domain Pre-trained Language Model, Corpus and Benchmarkcited by 60
  13. 2021JointGT: Graph-Text Joint Representation Learning for Text Generation from Knowledge Graphscited by 58
  14. 2018An Interpretable Reasoning Network for Multi-Relation Question Answeringcited by 47
  15. 2022Rainier: Reinforced Knowledge Introspector for Commonsense Question Answeringcited by 43
  16. 2019Modeling Graph Structure in Transformer for Better AMR-to-Text Generationcited by 35
  17. 2019Densely Connected Graph Convolutional Networks for Graph-to-Sequence Learningcited by 29
  18. 2018Deep Graph Convolutional Encoders for Structured Data to Text Generationcited by 27
  19. 2015Neural Generative Question Answeringcited by 22
  20. 2023An Empirical Study of Pre-trained Language Models in Simple Knowledge Graph Question Answeringcited by 19
  21. 2022MVP: Multi-task Supervised Pre-training for Natural Language Generationcited by 16
  22. 2021End-to-End Entity Resolution and Question Answering Using Differentiable Knowledge Graphscited by 11
  23. 2022Self-supervised Graph Masking Pre-training for Graph-to-Text Generationcited by 8
  24. 2023CQSumDP: A ChatGPT-Annotated Resource for Query-Focused Abstractive Summarization Based on Debatepediacited by 7

Built on by

Cited by year (2026 to 7 Oct)

Citing papers per year: 2023: 3; 2024: 28; 2025: 28; 2026: 5.

64 papers.

Sort:

By area:

  1. 2024Retrieval-Augmented Generation for AI-Generated Content: A Surveycited by 352
  2. 2024Graph Retrieval-Augmented Generation: A Surveycited by 320
  3. 2024ResearchAgent: Iterative Research Idea Generation over Scientific Literature with Large Language Modelscited by 200
  4. 2024Retrieval-Augmented Generation with Graphs (GraphRAG)cited by 170
  5. 2024GNN-RAG: Graph Neural Retrieval for Large Language Model Reasoningcited by 128
  6. 2023Can Knowledge Graphs Reduce Hallucinations in LLMs? : A Surveycited by 92
  7. 2024Simple Is Effective: The Roles of Graphs and Large Language Models in Knowledge-Graph-Based Retrieval-Augmented Generationcited by 78
  8. 2025Knowledge Graph Retrieval-Augmented Generation for LLM-based Recommendationcited by 56
  9. 2024Multimodal Reasoning with Multimodal Knowledge Graphcited by 43
  10. 2024A Survey on Medical Large Language Models: Technology, Application, Trustworthiness, and Future Directionscited by 34
  11. 2024Graph Machine Learning in the Era of Large Language Models (LLMs)cited by 33
  12. 2024T-RAG: Lessons from the LLM Trenchescited by 23
38 more
  1. 2023KnowledgeNavigator: Leveraging Large Language Models for Enhanced Reasoning over Knowledge Graphcited by 22
  2. 2024Can Knowledge Graphs Make Large Language Models More Trustworthy? An Empirical Study Over Open-ended Question Answeringcited by 20
  3. 2024Decoding on Graphs: Faithful and Sound Reasoning on Knowledge Graphs through Generation of Well-Formed Chainscited by 20
  4. 2025Aligning Vision to Language: Annotation-Free Multimodal Knowledge Graph Construction for Enhanced LLMs Reasoningcited by 19
  5. 2024Two-stage Generative Question Answering on Temporal Knowledge Graph Using Large Language Modelscited by 18
  6. 2024GraphOTTER: Evolving LLM-based Graph Reasoning for Complex Table Question Answeringcited by 18
  7. 2025Graph-based Approaches and Functionalities in Retrieval-Augmented Generation: A Comprehensive Surveycited by 18
  8. 2025Knowledge Graph-extended Retrieval Augmented Generation for Question Answeringcited by 14
  9. 2024Mindful-RAG: A Study of Points of Failure in Retrieval Augmented Generationcited by 12
  10. 2025Graph2text or Graph2token: A Perspective of Large Language Models for Graph Learningcited by 12
  11. 2024Large Language Models Can Better Understand Knowledge Graphs Than We Thoughtcited by 10
  12. 2024Evidence-Focused Fact Summarization for Knowledge-Augmented Zero-Shot Question Answeringcited by 9
  13. 2025LightPROF: A Lightweight Reasoning Framework for Large Language Model on Knowledge Graphcited by 8
  14. 2025EPERM: An Evidence Path Enhanced Reasoning Model for Knowledge Graph Question and Answeringcited by 7
  15. 2024Way to Specialist: Closing Loop Between Specialized LLM and Evolving Domain Knowledge Graphcited by 6
  16. 2025Beyond Chunks and Graphs: Retrieval-Augmented Generation through Triplet-Driven Thinkingcited by 6
  17. 2025Foundation Models for CPS-IoT: Opportunities and Challengescited by 5
  18. 2025Dynamic-KGQA: A Scalable Framework for Generating Adaptive Question Answering Datasetscited by 5
  19. 2025Learning Efficient and Generalizable Graph Retriever for Knowledge-Graph Question Answeringcited by 5
  20. 2025Reasoning by Exploration: A Unified Approach to Retrieval and Generation over Graphscited by 5
  21. 2024Large Language Models are Skeptics: False Negative Problem of Input-conflicting Hallucinationcited by 4
  22. 2024Dynamic Few-Shot Learning for Knowledge Graph Question Answeringcited by 4
  23. 2024GRS-QA -- Graph Reasoning-Structured Question Answering Datasetcited by 4
  24. 2024CogMG: Collaborative Augmentation Between Large Language Model and Knowledge Graphcited by 3
  25. 2024Combining LLMs and Knowledge Graphs to Reduce Hallucinations in Question Answeringcited by 3
  26. 2025Ontology-Guided, Hybrid Prompt Learning for Generalization in Knowledge Graph Question Answeringcited by 3
  27. 2025Advancing Multi-Agent RAG Systems with Minimalist Reinforcement Learningcited by 3
  28. 2024Pyramid-Driven Alignment: Pyramid Principle Guided Integration of Large Language Models and Knowledge Graphscited by 2
  29. 2025Walk&Retrieve: Simple Yet Effective Zero-shot Retrieval-Augmented Generation via Knowledge Graph Walkscited by 2
  30. 2025LLM Inference Enhanced by External Knowledge: A Surveycited by 2
  31. 2025DistRAG: Towards Distance-Based Spatial Reasoning in LLMscited by 2
  32. 2025Improving Factuality for Dialogue Response Generation via Graph-Based Knowledge Augmentationcited by 2
  33. 2025Improving Factuality in LLMs via Inference-Time Knowledge Graph Constructioncited by 2
  34. 2026Mixture-of-Experts Knowledge Graph Retrieval-Augmented Generation for Multi-Agent LLM-based Recommendationcited by 2
  35. 2023Reliable Academic Conference Question Answering: A Study Based on Large Language Modelcited by 1
  36. 2024Knowledge Pyramid Construction for Multi-Level Retrieval-Augmented Generationcited by 1
  37. 2024MGSA: Multi-Granularity Graph Structure Attention for Knowledge Graph-to-Text Generationcited by 1
  38. 2024QCG-Rerank: Chunks Graph Rerank with Query Expansion in Retrieval-Augmented LLMs for Tourism Domaincited by 1

50 most cited of 64 All 64 (JSON)