mlsanityData to 14 Oct 2026

DeepPath: A Reinforcement Learning Method for Knowledge Graph Reasoning

arXiv 1707.06690 ↗First posted 20 Jul 2017cs.CL cs.AIcited by 266

Not on the map. Why?

Cited by 36 in LLM reasoning, but placed by its own abstract, which didn’t fit.

Abstract (arXiv)

We study the problem of learning to reason in large scale knowledge graphs (KGs). More specifically, we describe a novel reinforcement learning framework for learning multi-hop relational paths: we use a policy-based agent with continuous states based on knowledge graph embeddings, which reasons in a KG vector space by sampling the most promising relation to extend its path. In contrast to prior work, our approach includes a reward function that takes the accuracy, diversity, and efficiency into consideration. Experimentally, we show that our proposed method outperforms a path-ranking based algorithm and knowledge graph embedding methods on Freebase and Never-Ending Language Learning datasets.

Key facts. Cited by 266 papers in the map (data through 14 Oct 2026). First posted on arXiv 20 Jul 2017.

Builds on

No reference list yet.

Built on by

Cited by year (2026 to 14 Oct)

Citing papers per year: 2021: 49; 2022: 51; 2023: 57; 2024: 46; 2025: 33; 2026: 30.

266 papers.

Sort:

By area:

  1. 2021Neural Bellman-Ford Networks: A General Graph Neural Network Framework for Link Predictioncited by 275
  2. 2022A Survey of Knowledge Graph Reasoning on Graph Types: Static, Dynamic, and Multimodalcited by 106
  3. 2021Learning Intents behind Interactions with Knowledge Graph for Recommendationcited by 94
  4. 2021Knowledge Graph Reasoning with Relational Digraphcited by 92
  5. 2023Towards Foundation Models for Knowledge Graph Reasoningcited by 86
  6. 2021ConE: Cone Embeddings for Multi-Hop Reasoning over Knowledge Graphscited by 78
  7. 2023Knowledge Graphs: Opportunities and Challengescited by 70
  8. 2021TimeTraveler: Reinforcement Learning for Temporal Knowledge Graph Forecastingcited by 67
  9. 2022Neural-Symbolic Models for Logical Queries on Knowledge Graphscited by 61
  10. 2023InGram: Inductive Knowledge Graph Embedding via Relation Graphscited by 52
  11. 2022A*Net: A Scalable Path-based Reasoning Approach for Knowledge Graphscited by 49
  12. 2021Topology-Aware Correlations Between Relations for Inductive Link Prediction in Knowledge Graphscited by 48
38 more
  1. 2022Knowledge Graph Contrastive Learning Based on Relation-Symmetrical Structurecited by 43
  2. 2023Is Stack Overflow Obsolete? An Empirical Study of the Characteristics of ChatGPT Answers to Stack Overflow Questionscited by 42
  3. 2022Knowledge Graph Embedding: A Survey from the Perspective of Representation Spacescited by 41
  4. 2021Search from History and Reason for Future: Two-stage Reasoning on Temporal Knowledge Graphscited by 39
  5. 2021A Survey on Neural-symbolic Learning Systemscited by 39
  6. 2022Mask and Reason: Pre-Training Knowledge Graph Transformers for Complex Logical Queriescited by 39
  7. 2021Reinforced Neighborhood Selection Guided Multi-Relational Graph Neural Networkscited by 38
  8. 2022On the Explainability of Natural Language Processing Deep Modelscited by 38
  9. 2023Neural Graph Reasoning: Complex Logical Query Answering Meets Graph Databasescited by 35
  10. 2021Meta-Knowledge Transfer for Inductive Knowledge Graph Embeddingcited by 32
  11. 2021Survey on reinforcement learning for language processingcited by 31
  12. 2022Knowledge Base Question Answering by Case-based Reasoning over Subgraphscited by 31
  13. 2023KnowGPT: Knowledge Graph based Prompting for Large Language Modelscited by 31
  14. 2022Challenges and Opportunities in Deep Reinforcement Learning with Graph Neural Networks: A Comprehensive review of Algorithms and Applicationscited by 30
  15. 2022Relational Message Passing for Fully Inductive Knowledge Graph Completioncited by 30
  16. 2022Answering Complex Logical Queries on Knowledge Graphs via Query Computation Tree Optimizationcited by 29
  17. 2022AdaProp: Learning Adaptive Propagation for Graph Neural Network based Knowledge Graph Reasoningcited by 28
  18. 2021Inductive Relation Prediction by BERTcited by 27
  19. 2021Neural Multi-Hop Reasoning With Logical Rules on Biomedical Knowledge Graphscited by 25
  20. 2024A Prompt-Based Knowledge Graph Foundation Model for Universal In-Context Reasoningcited by 25
  21. 2022Query2Particles: Knowledge Graph Reasoning with Particle Embeddingscited by 24
  22. 2023A Multi-Task Perspective for Link Prediction with New Relation Types and Nodescited by 24
  23. 2023Neurosymbolic Reinforcement Learning and Planning: A Surveycited by 24
  24. 2023Emerging Drug Interaction Prediction Enabled by Flow-based Graph Neural Network with Biomedical Networkcited by 24
  25. 2025TRIX: A More Expressive Model for Zero-shot Domain Transfer in Knowledge Graphscited by 24
  26. 2021Cycle Representation Learning for Inductive Relation Predictioncited by 23
  27. 2021Zero-shot and Few-shot Learning with Knowledge Graphs: A Comprehensive Surveycited by 23
  28. 2025How Expressive are Knowledge Graph Foundation Models?cited by 23
  29. 2024Understanding Reasoning Ability of Language Models From the Perspective of Reasoning Paths Aggregationcited by 22
  30. 2022GammaE: Gamma Embeddings for Logical Queries on Knowledge Graphscited by 21
  31. 2022Reinforcement learning on graphs: A surveycited by 20
  32. 2023Bias and Fairness in Chatbots: An Overviewcited by 20
  33. 2024Neural-Symbolic Reasoning over Knowledge Graphs: A Survey from a Query Perspectivecited by 20
  34. 2021Reinforcement Learning from Reformulations in Conversational Question Answering over Knowledge Graphscited by 18
  35. 2022Neural-Symbolic Entangled Framework for Complex Query Answeringcited by 18
  36. 2022Few-shot Relational Reasoning via Connection Subgraph Pretrainingcited by 18
  37. 2021Logic Embeddings for Complex Query Answeringcited by 17
  38. 2021Position Bias Mitigation: A Knowledge-Aware Graph Model for Emotion Cause Extractioncited by 17

50 most cited of 266 All 266 (JSON)