mlsanityData to 7 Oct 2026

LLM as Prompter: Low-resource Inductive Reasoning on Arbitrary Knowledge Graphs

arXiv 2402.11804 ↗First posted 19 Feb 2024cs.AI cs.CL cs.SIcited by 13

On the map: LLM reasoning → Knowledge- and tool-augmented reasoning

Abstract (arXiv)

Knowledge Graph (KG) inductive reasoning, which aims to infer missing facts from new KGs that are not seen during training, has been widely adopted in various applications. One critical challenge of KG inductive reasoning is handling low-resource scenarios with scarcity in both textual and structural aspects. In this paper, we attempt to address this challenge with Large Language Models (LLMs). Particularly, we utilize the state-of-the-art LLMs to generate a graph-structural prompt to enhance the pre-trained Graph Neural Networks (GNNs), which brings us new methodological insights into the KG inductive reasoning methods, as well as high generalizability in practice. On the methodological side, we introduce a novel pretraining and prompting framework ProLINK, designed for low-resource inductive reasoning across arbitrary KGs without requiring additional training. On the practical side, we experimentally evaluate our approach on 36 low-resource KG datasets and find that ProLINK outperforms previous methods in three-shot, one-shot, and zero-shot reasoning tasks, exhibiting average performance improvements by 20%, 45%, and 147%, respectively. Furthermore, ProLINK demonstrates strong robustness for various LLM promptings as well as full-shot scenarios.

Key facts. Cited by 13 papers in the map (data through 7 Oct 2026). Placed in Knowledge- and tool-augmented reasoning, one of 17 directions in LLM reasoning. Builds on 16 of its 62 references that are in the map. First posted on arXiv 19 Feb 2024.

Builds on

16 of 62 references.

Closest ancestors · 1

Same direction, newest first

  1. 2023LLMs for Knowledge Graph Construction and Reasoning: Recent Capabilities and Future Opportunities22 May

Other references · 15

  1. 2023GPT-4 Technical Reportcited by 18,132
  2. 2023Llama 2: Open Foundation and Fine-Tuned Chat Modelscited by 12,865
  3. 2023Sparks of Artificial General Intelligence: Early experiments with GPT-4cited by 2,579
  4. 2014Embedding Entities and Relations for Learning and Inference in Knowledge Basescited by 929
  5. 2019KEPLER: A Unified Model for Knowledge Embedding and Pre-trained Language Representationcited by 356
  6. 2023Language is All a Graph Needscited by 219
  7. 2023Towards Foundation Models for Knowledge Graph Reasoningcited by 83
  8. 2022A*Net: A Scalable Path-based Reasoning Approach for Knowledge Graphscited by 49
  9. 2023A Multi-Task Perspective for Link Prediction with New Relation Types and Nodescited by 23
  10. 2023Double Equivariance for Inductive Link Prediction for Both New Nodes and New Relation Typescited by 21
  11. 2021Understanding the Performance of Knowledge Graph Embeddings in Drug Discoverycited by 18
  12. 2023SIGMA: An Efficient Heterophilous Graph Neural Network with Fast Global Aggregationcited by 10
3 more
  1. 2020Repurpose Open Data to Discover Therapeutics for COVID-19 using Deep Learningcited by 9
  2. 2023Prompting Disentangled Embeddings for Knowledge Graph Completion with Pre-trained Language Modelcited by 3
  3. 2023River of No Return: Graph Percolation Embeddings for Efficient Knowledge Graph Reasoningcited by 2

Built on by

Cited by year (2026 to 7 Oct)

Citing papers per year: 2024: 3; 2025: 5; 2026: 5.

13 papers.

Sort:

By area:

Similar, not cited

Close in wording, no citation either way

  1. 2024An Enhanced Prompt-Based LLM Reasoning Scheme via Knowledge Graph-Integrated Collaboration
  2. 2024Dual Reasoning: A GNN-LLM Collaborative Framework for Knowledge Graph Question Answering
  3. 2023Graph Neural Prompting with Large Language Models
  4. 2024A Prompt-Based Knowledge Graph Foundation Model for Universal In-Context Reasoning
  5. 2025LightPROF: A Lightweight Reasoning Framework for Large Language Model on Knowledge Graph
  6. 2025Learn to Think: Bootstrapping LLM Reasoning Capability Through Graph Representation Learning
  7. 2025Grounding LLM Reasoning with Knowledge Graphs
  8. 2024Thinking with Knowledge Graphs: Enhancing LLM Reasoning Through Structured Data