Agentic Graph Token Reasoning
On the map: LLM reasoning → Knowledge- and tool-augmented reasoning
also in 1 more
Abstract (arXiv)
Graphs model relational data throughout science and industry, from citation networks to product co-purchase graphs. Because the nodes of many such graphs carry rich text, a growing line of work applies large language models (LLMs) to graph analysis. The most graph-native of these methods use graph tokens: a graph encoder compresses a graph view, such as a node, its k-hop neighbourhood, or a cluster, into a short block of continuous tokens that jointly encodes node attributes and topology and is read directly by the model. Existing methods, however, use graph tokens in a static single-shot manner: they encode one predefined graph view before the model has even seen the target and never revise it, leaving the model's step-by-step reasoning ability unused. We introduce agentic graph token reasoning, which recasts graph tokenization as part of the reasoning process itself. At each step, the model chooses which graph view to encode and at what granularity; a graph encoder is invoked on demand to materialise the corresponding graph tokens; and the resulting block is spliced into the running context. The model thus reasons step by step in the graph token space, and the tokens it reads are trajectory-dependent. We realise this with a three-stage training pipeline: (i) self-supervised tasks that teach the model to read heterogeneous graph tokens, (ii) a token-robust trajectory stage with a graph-token consistency regulariser, and (iii) preference optimisation that rewards trajectories in which the graph-token evidence and the node-text evidence agree. Across evaluations spanning seven graph domains, our models outperform a broad set of baselines by a large margin and transfer zero-shot to unseen domains without any per-target fine-tuning. More broadly, this work pushes LLM-based graph analysis from static graph-token encoders towards a graph-native agent paradigm.
Key facts. No citing papers in the map yet (data through 7 Oct 2026). Placed in Knowledge- and tool-augmented reasoning, one of 17 directions in LLM reasoning. Builds on 15 of its 42 references that are in the map. First posted on arXiv 1 Aug 2026.
Builds on
15 of 42 references.
Closest ancestors · 3
Same direction, newest first
- 2026GraphSearch: Agentic Search-Augmented Reasoning for Zero-Shot Graph Learning13 Jan
- 2024Similarity-based Neighbor Selection for Graph LLMs6 Feb
- 2023GraphText: Graph Reasoning in Text Space2 Oct
Other references · 12
- 2023LLaMA: Open and Efficient Foundation Language Modelscited by 13,958
- 2016Semi-Supervised Classification with Graph Convolutional Networkscited by 11,282
- 2024DeepSeekMath: Pushing the Limits of Mathematical Reasoning in Open Language Modelscited by 8,851
- 2024Qwen2.5 Technical Reportcited by 4,713
- 2023Mistral 7Bcited by 3,065
- 2024OpenAI o1 System Cardcited by 1,220
- 2018Pitfalls of Graph Neural Network Evaluationcited by 994
- 2024Training Large Language Models to Reason in a Continuous Latent Spacecited by 763
- 2024From Explicit CoT to Implicit CoT: Learning to Internalize CoT Step by Stepcited by 225
- 2023GPT4Graph: Can Large Language Models Understand Graph Structured Data ? An Empirical Evaluation and Benchmarkingcited by 209
- 2023Harnessing Explanations: LLM-to-LM Interpreter for Enhanced Text-Attributed Graph Representation Learningcited by 132
- 2023Can LLMs Effectively Leverage Graph Structural Information through Prompts, and Why?cited by 31
Built on by
Not cited yet.
Similar, not cited
Close in wording, no citation either way
- 2023Talk like a Graph: Encoding Graphs for Large Language Models
- 2024Scalable and Accurate Graph Reasoning with LLM-based Multi-Agents
- 2026GTA: Graph Theory Agent and Benchmark for Algorithmic Graph Reasoning with LLMs
- 2026GraphReAct: Reasoning and Acting for Multi-step Graph Inference
- 2024GraphInstruct: Empowering Large Language Models with Graph Understanding and Reasoning Capability
- 2026Are Large Language Models Suitable for Graph Computation? Progress and Prospects
- 2025Rethinking and Benchmarking Large Language Models for Graph Reasoning
- 2023Graph Agent: Explicit Reasoning Agent for Graphs