The Answer Path and the Grounding Instruction in LLM Question Answering over Knowledge Graphs
On the map: Retrieval-augmented generation → Knowledge-graph and structured-knowledge RAG
Abstract (arXiv)
A graph retrieval-augmented generation pipeline chooses which triples to put in the prompt, a syntax to write them in, an order to write them in, and a sentence telling the model what to do with them. We vary all four over six large language models and two knowledge-graph question answering benchmarks. Two of the four choices move the answer and the other two are flat. The first is whether the answer path, the triples needed to reach the answer, is in the prompt at all. Holding the number of triples fixed and replacing every triple that is not on the chain with material from an unrelated entity changes answer accuracy by +0.003 F1, while removing the chain costs most of what the graph was worth. Retrieval budget belongs on recall, and precision in the range we can test buys nothing. There is no retriever here: subgraphs come from gold SPARQL, so precision describes the context we build, not a system setting. The second is the grounding instruction. With no facts in the prompt, telling a model to answer using only the provided facts drops F1 from 0.299 to 0.035, a factor of 8.63. That figure describes an evaluation with an empty context arm rather than a working pipeline, and an experiment that applies the instruction to its context arm but not to its no-context baseline manufactures a spurious finding that graph context hurts at depth. We found one in our own results and retract it. Syntax, triple order and subgraph size produce no effect we can measure at multi-hop depth. The comparison that would price the grounding instruction against correct context is not measurable with a format-sensitive scorer, because the instruction determines the response format; we report it as an open contrast rather than a number.
Key facts. No citing papers in the map yet (data through 13 Oct 2026). Placed in Knowledge-graph and structured-knowledge RAG, one of 15 directions in Retrieval-augmented generation. Builds on 21 of its 28 references that are in the map. First posted on arXiv 9 Sep 2026.
Builds on
21 of 28 references.
Closest ancestors · 2
Same direction, newest first
- 2024GNN-RAG: Graph Neural Retrieval for Large Language Model Reasoning30 May
- 2024From Local to Global: A Graph RAG Approach to Query-Focused Summarization24 Apr
Other references · 19
- 2023StructGPT: A General Framework for Large Language Model to Reason over Structured Datacited by 342
- 2023Adaptive Chameleon or Stubborn Sloth: Revealing the Behavior of Large Language Models in Knowledge Conflictscited by 337
- 2024PoisonedRAG: Knowledge Corruption Attacks to Retrieval-Augmented Generation of Large Language Modelscited by 265
- 2023Talk like a Graph: Encoding Graphs for Large Language Modelscited by 176
- 2023Table Meets LLM: Can Large Language Models Understand Structured Table Data? A Benchmark and Empirical Studycited by 116
- 2024Let Your Graph Do the Talking: Encoding Structured Data for LLMscited by 115
- 2024ClashEval: Quantifying the tug-of-war between an LLM's internal prior and external evidencecited by 112
- 2023Context-faithful Prompting for Large Language Modelscited by 79
- 2024Context-DPO: Aligning Language Models for Context-Faithfulnesscited by 50
- 2025Parameters vs. Context: Fine-Grained Control of Knowledge Reliance in Language Modelscited by 38
- 2024Direct Evaluation of Chain-of-Thought in Multi-hop Reasoning with Knowledge Graphscited by 32
- 2024To Trust or Not to Trust? Enhancing Large Language Models' Situated Faithfulness to External Contextscited by 25
7 more
- 2023Benchmarking the Abilities of Large Language Models for RDF Knowledge Graph Creation and Comprehension: How Well Do LLMs Speak Turtle?cited by 11
- 2025ParamMute: Suppressing Knowledge-Critical FFNs for Faithful Retrieval-Augmented Generationcited by 11
- 2024Large Language Models Can Better Understand Knowledge Graphs Than We Thoughtcited by 10
- 2025RAG Safety: Exploring Knowledge Poisoning Attacks to Retrieval-Augmented Generationcited by 3
- 2026Bounded Path Context: A Controlled Study of Visible Path History in LLM-Based Knowledge Graph Question Answeringcited by 1
- 2026Knowledge-Graph Grounding Helps LLMs Only for Out-of-Training Knowledge: A Controlled Study on Clinical Question Answeringcited by 1
- 2026Architecture as Capability Equalizer for Coding Agentscited by 1
Built on by
Not cited yet.
Similar, not cited
Close in wording, no citation either way
- 2025Fusing Knowledge and Language: A Comparative Study of Knowledge Graph-Based Question Answering with LLMs
- 2023Graph Elicitation for Guiding Multi-Step Reasoning in Large Language Models
- 2024Simple Is Effective: The Roles of Graphs and Large Language Models in Knowledge-Graph-Based Retrieval-Augmented Generation
- 2026A Human-in-the-Loop, LLM-Centered Architecture for Knowledge-Graph Question Answering
- 2026RPO-RAG: Aligning Small LLMs with Relation-aware Preference Optimization for Knowledge Graph Question Answering
- 2023Graph Reasoning for Question Answering with Triplet Retrieval
- 2025Learning Efficient and Generalizable Graph Retriever for Knowledge-Graph Question Answering
- 2025RJE: A Retrieval-Judgment-Exploration Framework for Efficient Knowledge Graph Question Answering with LLMs