mlsanityData to 14 Oct 2026

Call Neighbours Yourself: Graph Walks with Destination-Conditioned On-Policy Self-Distillation

arXiv 2608.29588 ↗First posted 30 Aug 2026cs.AI cs.CLcited by 1

On the map: Knowledge distillation → On-policy and self-distillation for LLMs

Abstract (arXiv)

Reasoning over text-attributed graphs (TAGs) requires large language models (LLMs) to combine a node's text with evidence distributed across its neighbourhood. Existing methods fix the set of accessible neighbours before generation, forcing reasoning to operate over a static context and preventing the model from acquiring missing evidence during inference. We argue that neighbour selection should itself be part of the reasoning process. To this end, we propose Call Neighbours Yourself (CNY), a framework that enables LLMs to proactively explore graph neighbourhoods through topology-constrained graph-walk actions. Instead of reasoning over a pre-selected neighbour set, CNY exposes lightweight neighbour previews and learns when to expand candidate neighbours for additional evidence. To address the delayed-credit challenge of neighbour exploration, we introduce destination-conditioned on-policy self-distillation, which retrospectively evaluates a selected neighbour after its content is revealed and converts the resulting change in action preference into an action-level training signal. Experiments on standard TAG reasoning benchmarks under a unified raw-text setting show that CNY consistently outperforms fixed-context post-training baselines. Furthermore, the learned exploration policy transfers to unseen graphs and to a graph-level task not encountered during training. Code is available at https://github.com/superallen13/CNY.

Key facts. Cited by 1 paper in the map (data through 14 Oct 2026). Placed in On-policy and self-distillation for LLMs, one of 12 directions in Knowledge distillation. Builds on 32 of its 48 references that are in the map. First posted on arXiv 30 Aug 2026.

Builds on

32 of 48 references.

Closest ancestors · 1

Same direction, newest first

  1. 2026Reinforcement Learning via Self-Distillation28 Jan

Other references · 31

  1. 2017Proximal Policy Optimization Algorithmscited by 15,215
  2. 2024The Llama 3 Herd of Modelscited by 14,715
  3. 2024DeepSeekMath: Pushing the Limits of Mathematical Reasoning in Open Language Modelscited by 9,379
  4. 2023Let's Verify Step by Stepcited by 3,789
  5. 2023Lost in the Middle: How Language Models Use Long Contextscited by 3,455
  6. 2020Open Graph Benchmark: Datasets for Machine Learning on Graphscited by 2,163
  7. 2023Self-RAG: Learning to Retrieve, Generate, and Critique through Self-Reflectioncited by 1,839
  8. 2025Search-R1: Training LLMs to Reason and Leverage Search Engines with Reinforcement Learningcited by 1,444
  9. 2023LongBench: A Bilingual, Multitask Benchmark for Long Context Understandingcited by 1,417
  10. 2024RULER: What's the Real Context Size of Your Long-Context Language Models?cited by 1,346
  11. 2025Understanding R1-Zero-Like Training: A Critical Perspectivecited by 1,345
  12. 2023Math-Shepherd: Verify and Reinforce LLMs Step-by-step without Human Annotationscited by 928
19 more
  1. 2020Wiki-CS: A Wikipedia-Based Benchmark for Graph Neural Networkscited by 260
  2. 2023One for All: Towards Training One Graph Model for All Classification Taskscited by 243
  3. 2024LLaGA: Large Language and Graph Assistantcited by 181
  4. 2026OpenClaw-RL: Train Any Agent Simply by Talkingcited by 90
  5. 2024ZeroG: Investigating Cross-dataset Zero-shot Transferability in Graphscited by 85
  6. 2024UniGraph: Learning a Unified Cross-Domain Foundation Model for Text-Attributed Graphscited by 66
  7. 2024GOFA: A Generative One-For-All Model for Joint Graph Language Modelingcited by 57
  8. 2023CaT: Balanced Continual Graph Learning with Graph Condensationcited by 52
  9. 2025When Do LLMs Help With Node Classification? A Comprehensive Analysiscited by 21
  10. 2024CaseLink: Inductive Graph Learning for Legal Case Retrievalcited by 11
  11. 2023CaseGNN: Graph Neural Networks for Legal Case Retrieval with Text-Attributed Graphscited by 9
  12. 2023PUMA: Efficient Continual Graph Learning for Node Classification with Graph Condensationcited by 9
  13. 2025Graph-R1: Incentivizing the Zero-Shot Graph Learning Capability in LLMs via Explicit Reasoningcited by 6
  14. 2025NPG-Muse: Scaling Long Chain-of-Thought Reasoning with NP-Hard Graph Problemscited by 5
  15. 2025Text Meets Topology: Rethinking Out-of-distribution Detection in Text-Rich Networkscited by 3
  16. 2024LEXA: Legal Case Retrieval via Graph Contrastive Learning with Contextualised LLM Embeddingscited by 2
  17. 2026TRN-R1-Zero: Text-rich Network Reasoning via LLMs with Reinforcement Learning Onlycited by 1
  18. 2026What Information Matters? Graph Out-of-Distribution Detection via Tri-Component Information Decompositioncited by 1
  19. 2026GFMate: Empowering Graph Foundation Models with Test-time Prompt Tuningcited by 1

Built on by

Cited by year (2026 to 14 Oct)

Citing papers per year: 2026: 1.

1 paper.

Similar, not cited

Close in wording, no citation either way

  1. 2026GraphReAct: Reasoning and Acting for Multi-step Graph Inference
  2. 2025Reasoning by Exploration: A Unified Approach to Retrieval and Generation over Graphs
  3. 2026GRAIN: Bridging Name and Narrative Shifts in Real-World Graph Reasoning through Invariance-Rewarded Agentic RL
  4. 2026AgentGL: Towards Agentic Graph Learning with LLMs via Reinforcement Learning
  5. 2026GTA: Graph Theory Agent and Benchmark for Algorithmic Graph Reasoning with LLMs
  6. 2026Improving LLM Reasoning with Homophily-aware Structural and Semantic Text-Attributed Graph Compression
  7. 2026GraphSearch: Agentic Search-Augmented Reasoning for Zero-Shot Graph Learning
  8. 2025G1: Teaching LLMs to Reason on Graphs with Reinforcement Learning