mlsanityData to 7 Oct 2026

GraphWalker: Agentic Knowledge Graph Question Answering via Synthetic Trajectory Curriculum

arXiv 2603.28533 ↗First posted 30 Mar 2026cs.CLcited by 6

On the map: LLM agents and tool use → Web, search, and research agents

Abstract (arXiv)

Agentic knowledge graph question answering (KGQA) requires an agent to iteratively interact with knowledge graphs (KGs), posing challenges in both training data scarcity and reasoning generalization. Specifically, existing approaches often restrict agent exploration: prompting-based methods lack autonomous navigation training, while current training pipelines usually confine reasoning to predefined trajectories. To this end, this paper proposes GraphWalker, a novel agentic KGQA framework that addresses these challenges through Automated Trajectory Synthesis and Stage-wise Fine-tuning. GraphWalker adopts a two-stage SFT training paradigm: First, the agent is trained on structurally diverse trajectories synthesized from constrained random-walk paths, establishing a broad exploration prior over the KG; Second, the agent is further fine-tuned on a small set of expert trajectories to develop reflection and error recovery capabilities. Extensive experiments demonstrate that our stage-wise SFT paradigm unlocks a higher performance ceiling for a lightweight reinforcement learning (RL) stage, enabling GraphWalker to achieve state-of-the-art performance on CWQ and WebQSP. Additional results on GrailQA and our constructed GraphWalkerBench confirm that GraphWalker enhances generalization to out-of-distribution reasoning paths. The code is publicly available at https://github.com/XuShuwenn/GraphWalker.

Key facts. Cited by 6 papers in the map (data through 7 Oct 2026). Placed in Web, search, and research agents, one of 16 directions in LLM agents and tool use. Builds on 25 of its 43 references that are in the map. First posted on arXiv 30 Mar 2026.

Builds on

25 of 43 references.

Closest ancestors · 4

Same direction, newest first

  1. 2025Efficient and Transferable Agentic Knowledge Graph RAG via Reinforcement Learning30 Sep
  2. 2025KBQA-o1: Agentic Knowledge Base Question Answering with Monte Carlo Tree Search31 Jan
  3. 2024Generate-on-Graph: Treat LLM as both Agent and KG in Incomplete Knowledge Graph Question Answering23 Apr
  4. 2024KG-Agent: An Efficient Autonomous Agent Framework for Complex Reasoning over Knowledge Graph17 Feb

Other references · 21

  1. 2020Language Models are Few-Shot Learnerscited by 32,199
  2. 2024The Llama 3 Herd of Modelscited by 14,192
  3. 2022ReAct: Synergizing Reasoning and Acting in Language Modelscited by 8,355
  4. 2025DeepSeek-R1: Incentivizing Reasoning Capability in LLMs via Reinforcement Learningcited by 6,146
  5. 2024GPT-4o System Cardcited by 4,467
  6. 2019Language Models as Knowledge Bases?cited by 1,922
  7. 2024LlamaFactory: Unified Efficient Fine-Tuning of 100+ Language Modelscited by 1,442
  8. 2024M3-Embedding: Multi-Linguality, Multi-Functionality, Multi-Granularity Text Embeddings Through Self-Knowledge Distillationcited by 1,050
  9. 2018The Web as a Knowledge-base for Answering Complex Questionscited by 409
  10. 2023StructGPT: A General Framework for Large Language Model to Reason over Structured Datacited by 339
  11. 2023Reasoning on Graphs: Faithful and Interpretable Large Language Model Reasoningcited by 326
  12. 2023Chain-of-Knowledge: Grounding Large Language Models via Dynamic Knowledge Adapting over Heterogeneous Sourcescited by 121
9 more
  1. 2022Subgraph Retrieval Enhanced Model for Multi-hop Knowledge Base Question Answeringcited by 93
  2. 2023Few-shot In-context Learning for Knowledge Base Question Answeringcited by 74
  3. 2024Think-on-Graph 2.0: Deep and Faithful Large Language Model Reasoning with Knowledge-guided Retrieval Augmented Generationcited by 63
  4. 2023ChatKBQA: A Generate-then-Retrieve Framework for Knowledge Base Question Answering with Fine-tuned Large Language Modelscited by 44
  5. 2024Interactive-KBQA: Multi-Turn Interactions for Knowledge Base Question Answering with Large Language Modelscited by 25
  6. 2023Knowledge-Augmented Language Model Verificationcited by 21
  7. 2023Knowledge-Infused Prompting: Assessing and Advancing Clinical Text Data Generation with Large Language Modelscited by 20
  8. 2024Deliberate Reasoning in Language Models as Structure-Aware Planning with an Accurate World Modelcited by 20
  9. 2023Bridging the KB-Text Gap: Leveraging Structured Knowledge-aware Pre-training for KBQAcited by 17

Built on by

Cited by year (2026 to 7 Oct)

Citing papers per year: 2026: 6.

6 papers.

Similar, not cited

Close in wording, no citation either way

  1. 2025AgentRouter: A Knowledge-Graph-Guided LLM Router for Collaborative Multi-Agent Question Answering
  2. 2025KnowCoder-A1: Incentivizing Agentic Reasoning Capability with Outcome Supervision for KBQA
  3. 2026GraphWalk: Enabling Reasoning in Large Language Models through Tool-Based Graph Navigation
  4. 2026KGVoyager: Knowledge Graph Agnostic Question Answering via Agentic Navigation
  5. 2025GR-Agent: Adaptive Graph Reasoning Agent under Incomplete Knowledge
  6. 2026PathRouter: Aligning Rewards with Retrieval Quality in Agentic Graph Retrieval-Augmented Generation
  7. 2026GAPD: Gold-Action Policy Distillation for Agentic Reinforcement Learning in Knowledge Base Question Answering
  8. 2026Let the Agent Search: Autonomous Exploration Beats Rigid Workflows in Temporal Question Answering