GraphWalker: Agentic Knowledge Graph Question Answering via Synthetic Trajectory Curriculum
On the map: LLM agents and tool use → Web, search, and research agents
Abstract (arXiv)
Agentic knowledge graph question answering (KGQA) requires an agent to iteratively interact with knowledge graphs (KGs), posing challenges in both training data scarcity and reasoning generalization. Specifically, existing approaches often restrict agent exploration: prompting-based methods lack autonomous navigation training, while current training pipelines usually confine reasoning to predefined trajectories. To this end, this paper proposes GraphWalker, a novel agentic KGQA framework that addresses these challenges through Automated Trajectory Synthesis and Stage-wise Fine-tuning. GraphWalker adopts a two-stage SFT training paradigm: First, the agent is trained on structurally diverse trajectories synthesized from constrained random-walk paths, establishing a broad exploration prior over the KG; Second, the agent is further fine-tuned on a small set of expert trajectories to develop reflection and error recovery capabilities. Extensive experiments demonstrate that our stage-wise SFT paradigm unlocks a higher performance ceiling for a lightweight reinforcement learning (RL) stage, enabling GraphWalker to achieve state-of-the-art performance on CWQ and WebQSP. Additional results on GrailQA and our constructed GraphWalkerBench confirm that GraphWalker enhances generalization to out-of-distribution reasoning paths. The code is publicly available at https://github.com/XuShuwenn/GraphWalker.
Key facts. Cited by 6 papers in the map (data through 7 Oct 2026). Placed in Web, search, and research agents, one of 16 directions in LLM agents and tool use. Builds on 25 of its 43 references that are in the map. First posted on arXiv 30 Mar 2026.
Builds on
25 of 43 references.
Closest ancestors · 4
Same direction, newest first
- 2025Efficient and Transferable Agentic Knowledge Graph RAG via Reinforcement Learning30 Sep
- 2025KBQA-o1: Agentic Knowledge Base Question Answering with Monte Carlo Tree Search31 Jan
- 2024Generate-on-Graph: Treat LLM as both Agent and KG in Incomplete Knowledge Graph Question Answering23 Apr
- 2024KG-Agent: An Efficient Autonomous Agent Framework for Complex Reasoning over Knowledge Graph17 Feb
Other references · 21
- 2020Language Models are Few-Shot Learnerscited by 32,199
- 2024The Llama 3 Herd of Modelscited by 14,192
- 2022ReAct: Synergizing Reasoning and Acting in Language Modelscited by 8,355
- 2025DeepSeek-R1: Incentivizing Reasoning Capability in LLMs via Reinforcement Learningcited by 6,146
- 2024GPT-4o System Cardcited by 4,467
- 2019Language Models as Knowledge Bases?cited by 1,922
- 2024LlamaFactory: Unified Efficient Fine-Tuning of 100+ Language Modelscited by 1,442
- 2024M3-Embedding: Multi-Linguality, Multi-Functionality, Multi-Granularity Text Embeddings Through Self-Knowledge Distillationcited by 1,050
- 2018The Web as a Knowledge-base for Answering Complex Questionscited by 409
- 2023StructGPT: A General Framework for Large Language Model to Reason over Structured Datacited by 339
- 2023Reasoning on Graphs: Faithful and Interpretable Large Language Model Reasoningcited by 326
- 2023Chain-of-Knowledge: Grounding Large Language Models via Dynamic Knowledge Adapting over Heterogeneous Sourcescited by 121
9 more
- 2022Subgraph Retrieval Enhanced Model for Multi-hop Knowledge Base Question Answeringcited by 93
- 2023Few-shot In-context Learning for Knowledge Base Question Answeringcited by 74
- 2024Think-on-Graph 2.0: Deep and Faithful Large Language Model Reasoning with Knowledge-guided Retrieval Augmented Generationcited by 63
- 2023ChatKBQA: A Generate-then-Retrieve Framework for Knowledge Base Question Answering with Fine-tuned Large Language Modelscited by 44
- 2024Interactive-KBQA: Multi-Turn Interactions for Knowledge Base Question Answering with Large Language Modelscited by 25
- 2023Knowledge-Augmented Language Model Verificationcited by 21
- 2023Knowledge-Infused Prompting: Assessing and Advancing Clinical Text Data Generation with Large Language Modelscited by 20
- 2024Deliberate Reasoning in Language Models as Structure-Aware Planning with an Accurate World Modelcited by 20
- 2023Bridging the KB-Text Gap: Leveraging Structured Knowledge-aware Pre-training for KBQAcited by 17
Built on by
Citing papers per year: 2026: 6.
6 papers.
- 2026Teaching LLMs to See Graphs: Unifying Text and Structural Reasoningcited by 2
- 2026RedAct: Redacting Agent Capability Traces for Procedural Skill Protectioncited by 2
- 2026Peak-Then-Collapse and the Four Interface Channels of Knowledge-Graph Tool Usecited by 0
- 2026LongCrafter: Towards Diverse Long-Context Understanding via Evidence-Graph-Guided Instruction Synthesiscited by 0
- 2026Co-Evolving Graph and Text Memory for Training-Free Multi-Hop Question Answeringcited by 0
- 2026The Path Matters: Evaluating Small Language Models Beyond Answer Accuracy in KGQAcited by 0
- 2026The Path Matters: Evaluating Small Language Models Beyond Answer Accuracy in KGQA23 Sep 2026
- 2026Co-Evolving Graph and Text Memory for Training-Free Multi-Hop Question Answering25 Jul 2026
- 2026LongCrafter: Towards Diverse Long-Context Understanding via Evidence-Graph-Guided Instruction Synthesis7 Jul 2026
- 2026RedAct: Redacting Agent Capability Traces for Procedural Skill Protection9 Jun 2026
- 2026Peak-Then-Collapse and the Four Interface Channels of Knowledge-Graph Tool Use25 May 2026
- 2026Teaching LLMs to See Graphs: Unifying Text and Structural Reasoning11 May 2026
Similar, not cited
Close in wording, no citation either way
- 2025AgentRouter: A Knowledge-Graph-Guided LLM Router for Collaborative Multi-Agent Question Answering
- 2025KnowCoder-A1: Incentivizing Agentic Reasoning Capability with Outcome Supervision for KBQA
- 2026GraphWalk: Enabling Reasoning in Large Language Models through Tool-Based Graph Navigation
- 2026KGVoyager: Knowledge Graph Agnostic Question Answering via Agentic Navigation
- 2025GR-Agent: Adaptive Graph Reasoning Agent under Incomplete Knowledge
- 2026PathRouter: Aligning Rewards with Retrieval Quality in Agentic Graph Retrieval-Augmented Generation
- 2026GAPD: Gold-Action Policy Distillation for Agentic Reinforcement Learning in Knowledge Base Question Answering
- 2026Let the Agent Search: Autonomous Exploration Beats Rigid Workflows in Temporal Question Answering