mlsanityData to 14 Oct 2026

Go for a Walk and Arrive at the Answer: Reasoning Over Paths in Knowledge Bases using Reinforcement Learning

arXiv 1711.05851 ↗First posted 15 Nov 2017cs.CL cs.AIcited by 161

Not on the map. Why?

Cited by 24 in LLM reasoning, but placed by its own abstract, which didn’t fit.

Abstract (arXiv)

Knowledge bases (KB), both automatically and manually constructed, are often incomplete --- many valid facts can be inferred from the KB by synthesizing existing information. A popular approach to KB completion is to infer new relations by combinatory reasoning over the information found along other paths connecting a pair of entities. Given the enormous size of KBs and the exponential number of paths, previous path-based models have considered only the problem of predicting a missing relation given two entities or evaluating the truth of a proposed triple. Additionally, these methods have traditionally used random paths between fixed entity pairs or more recently learned to pick paths between them. We propose a new algorithm MINERVA, which addresses the much more difficult and practical task of answering questions where the relation is known, but only one entity. Since random walks are impractical in a setting with combinatorially many destinations from a start node, we present a neural reinforcement learning approach which learns how to navigate the graph conditioned on the input query to find predictive paths. Empirically, this approach obtains state-of-the-art results on several datasets, significantly outperforming prior methods.

Key facts. Cited by 161 papers in the map (data through 14 Oct 2026). First posted on arXiv 15 Nov 2017.

Builds on

No reference list yet.

Built on by

Cited by year (2026 to 14 Oct)

Citing papers per year: 2021: 32; 2022: 34; 2023: 30; 2024: 18; 2025: 27; 2026: 20.

161 papers.

Sort:

By area:

  1. 2024Graph Retrieval-Augmented Generation: A Surveycited by 324
  2. 2021Neural Bellman-Ford Networks: A General Graph Neural Network Framework for Link Predictioncited by 275
  3. 2022A Survey of Knowledge Graph Reasoning on Graph Types: Static, Dynamic, and Multimodalcited by 106
  4. 2021Improving Multi-hop Knowledge Base Question Answering by Learning Intermediate Supervision Signalscited by 101
  5. 2021Knowledge Graph Reasoning with Relational Digraphcited by 92
  6. 2021TimeTraveler: Reinforcement Learning for Temporal Knowledge Graph Forecastingcited by 67
  7. 2021Temporal Knowledge Graph Forecasting with Neural ODEcited by 61
  8. 2022Neural-Symbolic Models for Logical Queries on Knowledge Graphscited by 61
  9. 2024Knowledge Graphs Meet Multi-Modal Learning: A Comprehensive Surveycited by 53
  10. 2022A*Net: A Scalable Path-based Reasoning Approach for Knowledge Graphscited by 49
  11. 2021Search from History and Reason for Future: Two-stage Reasoning on Temporal Knowledge Graphscited by 39
  12. 2022On the Explainability of Natural Language Processing Deep Modelscited by 38
38 more
  1. 2021Neuro-Symbolic Inductive Logic Programming with Logical Neural Networkscited by 36
  2. 2021Continual Learning of Knowledge Graph Embeddingscited by 35
  3. 2021Survey on reinforcement learning for language processingcited by 31
  4. 2022Knowledge Base Question Answering by Case-based Reasoning over Subgraphscited by 31
  5. 2022Answering Complex Logical Queries on Knowledge Graphs via Query Computation Tree Optimizationcited by 29
  6. 2022AdaProp: Learning Adaptive Propagation for Graph Neural Network based Knowledge Graph Reasoningcited by 28
  7. 2021Inductive Relation Prediction by BERTcited by 27
  8. 2021Neural Multi-Hop Reasoning With Logical Rules on Biomedical Knowledge Graphscited by 25
  9. 2023Neurosymbolic Reinforcement Learning and Planning: A Surveycited by 24
  10. 2023KnowledgeNavigator: Leveraging Large Language Models for Enhanced Reasoning over Knowledge Graphcited by 22
  11. 2024Understanding Reasoning Ability of Language Models From the Perspective of Reasoning Paths Aggregationcited by 22
  12. 2021Benchmarking the Combinatorial Generalizability of Complex Query Answering on Knowledge Graphscited by 21
  13. 2022Reinforcement learning on graphs: A surveycited by 20
  14. 2021Reinforcement Learning from Reformulations in Conversational Question Answering over Knowledge Graphscited by 18
  15. 2025Graph-based Approaches and Functionalities in Retrieval-Augmented Generation: A Comprehensive Surveycited by 18
  16. 2021Logic Embeddings for Complex Query Answeringcited by 17
  17. 2021UNIQORN: Unified Question Answering over RDF Knowledge Graphs and Natural Language Textcited by 17
  18. 2021Learning to Walk with Dual Agents for Knowledge Graph Reasoningcited by 16
  19. 2024Graph Reinforcement Learning for Combinatorial Optimization: A Survey and Unifying Perspectivecited by 16
  20. 2022Hypergraph Transformer: Weakly-supervised Multi-hop Reasoning for Knowledge-based Visual Question Answeringcited by 15
  21. 2022Empowering Language Models with Knowledge Graph Reasoning for Question Answeringcited by 14
  22. 2021Graphhopper: Multi-Hop Scene Graph Reasoning for Visual Question Answeringcited by 13
  23. 2022MMKGR: Multi-hop Multi-modal Knowledge Graph Reasoningcited by 13
  24. 2023Adapting Neural Link Predictors for Data-Efficient Complex Query Answeringcited by 13
  25. 2023Explicit Planning Helps Language Models in Logical Reasoningcited by 12
  26. 2023Bring Your Own KG: Self-Supervised Program Synthesis for Zero-Shot KGQAcited by 11
  27. 2024Non-convolutional Graph Neural Networkscited by 11
  28. 2021Is Multi-Hop Reasoning Really Explainable? Towards Benchmarking Reasoning Interpretabilitycited by 10
  29. 2021SQALER: Scaling Question Answering by Decoupling Multi-Hop and Logical Reasoningcited by 10
  30. 2022Asking for Knowledge: Training RL Agents to Query External Knowledge Using Languagecited by 10
  31. 2023Sem@K: Is my knowledge graph embedding model semantic-aware?cited by 10
  32. 2023On the Evolution of Knowledge Graphs: A Survey and Perspectivecited by 10
  33. 2021Are Missing Links Predictable? An Inferential Benchmark for Knowledge Graph Completioncited by 9
  34. 2023Learning Representations of Bi-level Knowledge Graphs for Reasoning beyond Link Predictioncited by 9
  35. 2021Self-attention Presents Low-dimensional Knowledge Graph Embeddings for Link Predictioncited by 8
  36. 2023Logical Entity Representation in Knowledge-Graphs for Differentiable Rule Learningcited by 8
  37. 2023Text-Augmented Open Knowledge Graph Completion via Pre-Trained Language Modelscited by 8
  38. 2024Enhancing Multi-Hop Knowledge Graph Reasoning through Reward Shaping Techniquescited by 8

50 most cited of 161 All 161 (JSON)