Self-Exploring Language Models for Explainable Link Forecasting on Temporal Graphs via Reinforcement Learning
Not on the map. Why?
Abstract (arXiv)
Forecasting future links is a central task in temporal graph (TG) reasoning, requiring models to leverage historical interactions to predict upcoming ones. Traditional neural approaches, such as temporal graph neural networks, achieve strong performance but lack explainability and cannot be applied to unseen graphs without retraining. Recent studies have begun to explore using large language models (LLMs) for graph reasoning, but most of them are constrained to static graphs or small synthetic TGs and lack the evaluation of the quality of reasoning traces generated by LLMs. In this work, we present Reasoning-Enhanced Learning for Temporal Graphs (ReaL-TG), a reinforcement learning framework that fine-tunes LLMs to perform explainable link forecasting on real-world TGs. ReaL-TG uses outcome-based reward to encourage models to self-explore reasoning strategies from graph structure and to produce explanations that directly justify their predictions. To enable evaluation on LLM-generated reasoning traces, we propose a new evaluation protocol combining ranking metrics with an LLM-as-a-Judge system that assesses both the quality of reasoning and the impact of hallucinations. Experiments with ReaL-TG-4B, obtained by fine-tuning Qwen3-4B under our framework, show that it outperforms much larger frontier LLMs, including GPT-5 mini, on ranking metrics, while producing high-quality explanations confirmed by both the LLM judge and human evaluation.
Key facts. Cited by 1 paper in the map (data through 14 Oct 2026). Builds on 51 of its 58 references that are in the map. First posted on arXiv 31 Aug 2025.
Builds on
51 of 58 references.
References · 51
- 2017Attention Is All You Needcited by 60,361
- 2024DeepSeekMath: Pushing the Limits of Mathematical Reasoning in Open Language Modelscited by 9,379
- 2023Judging LLM-as-a-Judge with MT-Bench and Chatbot Arenacited by 8,626
- 2023Mamba: Linear-Time Sequence Modeling with Selective State Spacescited by 4,718
- 2019HuggingFace's Transformers: State-of-the-art Natural Language Processingcited by 2,218
- 2024HybridFlow: A Flexible and Efficient RLHF Frameworkcited by 2,057
- 2020Temporal Graph Networks for Deep Learning on Dynamic Graphscited by 530
- 2020Inductive Representation Learning on Temporal Graphscited by 462
- 2019Predicting Dynamic Embedding Trajectory in Temporal Interaction Networkscited by 448
- 2019Representation Learning for Dynamic Graphs: A Surveycited by 265
- 2022Defining and Characterizing Reward Hackingcited by 203
- 2024LLaGA: Large Language and Graph Assistantcited by 181
38 more
- 2023Talk like a Graph: Encoding Graphs for Large Language Modelscited by 176
- 2023Towards Better Dynamic Graph Learning: New Architecture and Unified Librarycited by 157
- 2023Temporal Graph Benchmark for Machine Learning on Temporal Graphscited by 138
- 2022ROLAND: Graph Learning Framework for Dynamic Graphscited by 132
- 2022Towards Better Evaluation for Dynamic Link Predictioncited by 122
- 2024Let Your Graph Do the Talking: Encoding Structured Data for LLMscited by 118
- 2024Large Language Models Can Learn Temporal Reasoningcited by 111
- 2023GraphLLM: Boosting Graph Reasoning Ability of Large Language Modelcited by 107
- 2024An Empirical Study of LLM-as-a-Judge for LLM Evaluation: Fine-tuned Judge Model is not a General Substitute for GPT-4cited by 94
- 2018Streaming Graph Neural Networkscited by 91
- 2024Test of Time: A Benchmark for Evaluating LLMs on Temporal Reasoningcited by 88
- 2020APAN: Asynchronous Propagation Attention Network for Real-time Temporal Graph Embeddingcited by 78
- 2021Continuous-Time Sequential Recommendation with Temporal Graph Collaborative Transformercited by 69
- 2021TCL: Transformer-based Dynamic Graph Modelling via Contrastive Learningcited by 68
- 2021Temporal Knowledge Graph Forecasting with Neural ODEcited by 61
- 2021TLogic: Temporal Logical Rules for Explainable Link Forecasting on Temporal Knowledge Graphscited by 59
- 2024Large Language Models-guided Dynamic Adaptation for Temporal Knowledge Graph Reasoningcited by 41
- 2023LLM4DyG: Can Large Language Models Solve Spatial-Temporal Problems on Dynamic Graphs?cited by 40
- 2023TimeBench: A Comprehensive Evaluation of Temporal Reasoning Abilities in Large Language Modelscited by 39
- 2023Temporal Knowledge Graph Forecasting Without Knowledge Using In-Context Learningcited by 37
- 2024TGB 2.0: A Benchmark for Learning on Temporal Knowledge Graphs and Heterogeneous Graphscited by 36
- 2025Play Favorites: A Statistical Method to Measure Self-Bias in LLM-as-a-Judgecited by 36
- 2023GenTKG: Generative Forecasting on Temporal Knowledge Graph with Large Language Modelscited by 30
- 2024Long Range Propagation on Continuous-Time Dynamic Graphscited by 28
- 2023Are Large Language Models Temporally Grounded?cited by 27
- 2025Large Language Models are Good Relational Learnerscited by 24
- 2024Efficient Neural Common Neighbor for Temporal Graph Link Predictioncited by 18
- 2025ChronoSense: Exploring Temporal Understanding in Large Language Models with Time Intervals of Eventscited by 18
- 2024DyGMamba: Efficiently Modeling Long-Term Temporal Dependency on Continuous-Time Dynamic Graphs with State Space Modelscited by 14
- 2025G1: Teaching LLMs to Reason on Graphs with Reinforcement Learningcited by 14
- 2021Neural Predicting Higher-order Patterns in Temporal Networkscited by 13
- 2023zrLLM: Zero-Shot Relational Learning on Temporal Knowledge Graphs with Large Language Modelscited by 13
- 2025Are Large Language Models In-Context Graph Learners?cited by 12
- 2024UTG: Towards a Unified View of Snapshot and Event Based Models for Temporal Graphscited by 10
- 2021A Simple But Powerful Graph Encoder for Temporal Knowledge Graph Completioncited by 8
- 2025FOReCAst: The Future Outcome Reasoning and Confidence Assessment Benchmarkcited by 8
- 2025TCP: a Benchmark for Temporal Constraint-Based Planningcited by 8
- 2025Are Large Language Models Good Temporal Graph Learners?cited by 3
50 most cited of 51 All 51 (JSON)
Built on by
Citing papers per year: 2026: 1.
1 paper.
Similar, not cited
Close in wording, no citation either way
- 2026LLM-Guided Knowledge Distillation for Temporal Knowledge Graph Reasoning
- 2025T-GRAB: A Synthetic Diagnostic Benchmark for Learning on Temporal Graphs
- 2023DREAM: Adaptive Reinforcement Learning based on Attention Mechanism for Temporal Knowledge Graph Reasoning
- 2026Reachability-Aware Pretraining for Efficient Target-Oriented Path Exploration in Temporal Knowledge Graph Reasoning
- 2024Chain-of-History Reasoning for Temporal Knowledge Graph Forecasting
- 2024Chain of History: Learning and Forecasting with LLMs for Temporal Knowledge Graph Completion
- 2026Explore-on-Graph: Incentivizing Autonomous Exploration of Large Language Models on Knowledge Graphs with Path-refined Reward Modeling
- 2025Graph-R1: Incentivizing the Zero-Shot Graph Learning Capability in LLMs via Explicit Reasoning