LLM as Prompter: Low-resource Inductive Reasoning on Arbitrary Knowledge Graphs
On the map: LLM reasoning → Knowledge- and tool-augmented reasoning
Abstract (arXiv)
Knowledge Graph (KG) inductive reasoning, which aims to infer missing facts from new KGs that are not seen during training, has been widely adopted in various applications. One critical challenge of KG inductive reasoning is handling low-resource scenarios with scarcity in both textual and structural aspects. In this paper, we attempt to address this challenge with Large Language Models (LLMs). Particularly, we utilize the state-of-the-art LLMs to generate a graph-structural prompt to enhance the pre-trained Graph Neural Networks (GNNs), which brings us new methodological insights into the KG inductive reasoning methods, as well as high generalizability in practice. On the methodological side, we introduce a novel pretraining and prompting framework ProLINK, designed for low-resource inductive reasoning across arbitrary KGs without requiring additional training. On the practical side, we experimentally evaluate our approach on 36 low-resource KG datasets and find that ProLINK outperforms previous methods in three-shot, one-shot, and zero-shot reasoning tasks, exhibiting average performance improvements by 20%, 45%, and 147%, respectively. Furthermore, ProLINK demonstrates strong robustness for various LLM promptings as well as full-shot scenarios.
Key facts. Cited by 13 papers in the map (data through 7 Oct 2026). Placed in Knowledge- and tool-augmented reasoning, one of 17 directions in LLM reasoning. Builds on 16 of its 62 references that are in the map. First posted on arXiv 19 Feb 2024.
Builds on
16 of 62 references.
Closest ancestors · 1
Same direction, newest first
- 2023LLMs for Knowledge Graph Construction and Reasoning: Recent Capabilities and Future Opportunities22 May
Other references · 15
- 2023GPT-4 Technical Reportcited by 18,132
- 2023Llama 2: Open Foundation and Fine-Tuned Chat Modelscited by 12,865
- 2023Sparks of Artificial General Intelligence: Early experiments with GPT-4cited by 2,579
- 2014Embedding Entities and Relations for Learning and Inference in Knowledge Basescited by 929
- 2019KEPLER: A Unified Model for Knowledge Embedding and Pre-trained Language Representationcited by 356
- 2023Language is All a Graph Needscited by 219
- 2023Towards Foundation Models for Knowledge Graph Reasoningcited by 83
- 2022A*Net: A Scalable Path-based Reasoning Approach for Knowledge Graphscited by 49
- 2023A Multi-Task Perspective for Link Prediction with New Relation Types and Nodescited by 23
- 2023Double Equivariance for Inductive Link Prediction for Both New Nodes and New Relation Typescited by 21
- 2021Understanding the Performance of Knowledge Graph Embeddings in Drug Discoverycited by 18
- 2023SIGMA: An Efficient Heterophilous Graph Neural Network with Fast Global Aggregationcited by 10
3 more
- 2020Repurpose Open Data to Discover Therapeutics for COVID-19 using Deep Learningcited by 9
- 2023Prompting Disentangled Embeddings for Knowledge Graph Completion with Pre-trained Language Modelcited by 3
- 2023River of No Return: Graph Percolation Embeddings for Efficient Knowledge Graph Reasoningcited by 2
Built on by
Citing papers per year: 2024: 3; 2025: 5; 2026: 5.
13 papers.
Sort:
By area:
- 2024Paths-over-Graph: Knowledge Graph Empowered Large Language Model Reasoningcited by 44
- 2024SirLLM: Streaming Infinite Retentive LLMcited by 16
- 2025SEMMA: A Semantic Aware Knowledge Graph Foundation Modelcited by 7
- 2024Towards Graph Foundation Models: Training on Knowledge Graphs Enables Transferability to General Graphscited by 6
- 2025Large Language Models Meet Text-Attributed Graphs: A Survey of Integration Frameworks and Applicationscited by 5
- 2025Large Language Models for Knowledge Graph Embedding: A Surveycited by 3
- 2025Beyond Completion: A Foundation Model for General Knowledge Graph Reasoningcited by 1
- 2025Knowledge Reasoning Language Model: Unifying Knowledge and Language for Inductive Knowledge Graph Reasoningcited by 1
- 2026Bridging Graph Structure and Knowledge-Guided Editing for Interpretable Temporal Knowledge Graph Reasoningcited by 0
- 2026Knowledge Graphs Meet Graph Neural Networks: A Comprehensive Surveycited by 0
- 2026Dual-Path LLM Reasoning for Multimodal Few-Shot Knowledge Graph Completioncited by 0
- 2026Structure-Internalized Rule Language Model for Faithful Knowledge Graph Reasoningcited by 0
- 2026Reification as a Transferable Vocabulary: Zero-Shot Link Prediction with Vanilla GNNs10 Sep 2026
- 2026Structure-Internalized Rule Language Model for Faithful Knowledge Graph Reasoning18 Aug 2026
- 2026Dual-Path LLM Reasoning for Multimodal Few-Shot Knowledge Graph Completion29 Jul 2026
- 2026Knowledge Graphs Meet Graph Neural Networks: A Comprehensive Survey12 May 2026
- 2026Bridging Graph Structure and Knowledge-Guided Editing for Interpretable Temporal Knowledge Graph Reasoning29 Jan 2026
- 2025Large Language Models Meet Text-Attributed Graphs: A Survey of Integration Frameworks and Applications24 Oct 2025
- 2025Knowledge Reasoning Language Model: Unifying Knowledge and Language for Inductive Knowledge Graph Reasoning15 Oct 2025
- 2025Beyond Completion: A Foundation Model for General Knowledge Graph Reasoning28 May 2025
- 2025SEMMA: A Semantic Aware Knowledge Graph Foundation Model26 May 2025
- 2025Large Language Models for Knowledge Graph Embedding: A Survey14 Jan 2025
- 2024Paths-over-Graph: Knowledge Graph Empowered Large Language Model Reasoning18 Oct 2024
- 2024Towards Graph Foundation Models: Training on Knowledge Graphs Enables Transferability to General Graphs16 Oct 2024
1 more
- 2024SirLLM: Streaming Infinite Retentive LLM21 May 2024
- 2024Paths-over-Graph: Knowledge Graph Empowered Large Language Model Reasoningcited by 44
- 2025Knowledge Reasoning Language Model: Unifying Knowledge and Language for Inductive Knowledge Graph Reasoningcited by 1
- 2026Bridging Graph Structure and Knowledge-Guided Editing for Interpretable Temporal Knowledge Graph Reasoningcited by 0
- 2026Dual-Path LLM Reasoning for Multimodal Few-Shot Knowledge Graph Completioncited by 0
- 2026Structure-Internalized Rule Language Model for Faithful Knowledge Graph Reasoningcited by 0
- 2026Structure-Internalized Rule Language Model for Faithful Knowledge Graph Reasoning18 Aug 2026
- 2026Dual-Path LLM Reasoning for Multimodal Few-Shot Knowledge Graph Completion29 Jul 2026
- 2026Bridging Graph Structure and Knowledge-Guided Editing for Interpretable Temporal Knowledge Graph Reasoning29 Jan 2026
- 2025Knowledge Reasoning Language Model: Unifying Knowledge and Language for Inductive Knowledge Graph Reasoning15 Oct 2025
- 2024Paths-over-Graph: Knowledge Graph Empowered Large Language Model Reasoning18 Oct 2024
- 2024SirLLM: Streaming Infinite Retentive LLMcited by 16
- 2025SEMMA: A Semantic Aware Knowledge Graph Foundation Modelcited by 7
- 2024Towards Graph Foundation Models: Training on Knowledge Graphs Enables Transferability to General Graphscited by 6
- 2025Large Language Models Meet Text-Attributed Graphs: A Survey of Integration Frameworks and Applicationscited by 5
- 2025Large Language Models for Knowledge Graph Embedding: A Surveycited by 3
- 2025Beyond Completion: A Foundation Model for General Knowledge Graph Reasoningcited by 1
- 2026Knowledge Graphs Meet Graph Neural Networks: A Comprehensive Surveycited by 0
- 2026Reification as a Transferable Vocabulary: Zero-Shot Link Prediction with Vanilla GNNscited by 0
- 2026Reification as a Transferable Vocabulary: Zero-Shot Link Prediction with Vanilla GNNs10 Sep 2026
- 2026Knowledge Graphs Meet Graph Neural Networks: A Comprehensive Survey12 May 2026
- 2025Large Language Models Meet Text-Attributed Graphs: A Survey of Integration Frameworks and Applications24 Oct 2025
- 2025Beyond Completion: A Foundation Model for General Knowledge Graph Reasoning28 May 2025
- 2025SEMMA: A Semantic Aware Knowledge Graph Foundation Model26 May 2025
- 2025Large Language Models for Knowledge Graph Embedding: A Survey14 Jan 2025
- 2024Towards Graph Foundation Models: Training on Knowledge Graphs Enables Transferability to General Graphs16 Oct 2024
- 2024SirLLM: Streaming Infinite Retentive LLM21 May 2024
Similar, not cited
Close in wording, no citation either way
- 2024An Enhanced Prompt-Based LLM Reasoning Scheme via Knowledge Graph-Integrated Collaboration
- 2024Dual Reasoning: A GNN-LLM Collaborative Framework for Knowledge Graph Question Answering
- 2023Graph Neural Prompting with Large Language Models
- 2024A Prompt-Based Knowledge Graph Foundation Model for Universal In-Context Reasoning
- 2025LightPROF: A Lightweight Reasoning Framework for Large Language Model on Knowledge Graph
- 2025Learn to Think: Bootstrapping LLM Reasoning Capability Through Graph Representation Learning
- 2025Grounding LLM Reasoning with Knowledge Graphs
- 2024Thinking with Knowledge Graphs: Enhancing LLM Reasoning Through Structured Data