mlsanityData to 7 Oct 2026

Node Importance Estimation Leveraging LLMs for Semantic Augmentation in Knowledge Graphs

arXiv 2412.00478 ↗First posted 30 Nov 2024cs.AI cs.CLcited by 2

Not on the map. Why?

Abstract (arXiv)

Node Importance Estimation (NIE) is a task that quantifies the importance of node in a graph. Recent research has investigated to exploit various information from Knowledge Graphs (KGs) to estimate node importance scores. However, the semantic information in KGs could be insufficient, missing, and inaccurate, which would limit the performance of existing NIE models. To address these issues, we leverage Large Language Models (LLMs) for semantic augmentation thanks to the LLMs' extra knowledge and ability of integrating knowledge from both LLMs and KGs. To this end, we propose the LLMs Empowered Node Importance Estimation (LENIE) method to enhance the semantic information in KGs for better supporting NIE tasks. To our best knowledge, this is the first work incorporating LLMs into NIE. Specifically, LENIE employs a novel clustering-based triplet sampling strategy to extract diverse knowledge of a node sampled from the given KG. After that, LENIE adopts the node-specific adaptive prompts to integrate the sampled triplets and the original node descriptions, which are then fed into LLMs for generating richer and more precise augmented node descriptions. These augmented descriptions finally initialize node embeddings for boosting the downstream NIE model performance. Extensive experiments demonstrate LENIE's effectiveness in addressing semantic deficiencies in KGs, enabling more informative semantic augmentation and enhancing existing NIE models to achieve the state-of-the-art performance. The source code of LENIE is freely available at urlhttps://github.com/XinyuLin-FZ/LENIE.

Key facts. Cited by 2 papers in the map (data through 7 Oct 2026). Builds on 20 of its 49 references that are in the map. First posted on arXiv 30 Nov 2024.

Builds on

20 of 49 references.

References · 20

  1. 2023GPT-4 Technical Reportcited by 18,132
  2. 2023Llama 2: Open Foundation and Fine-Tuned Chat Modelscited by 12,865
  3. 2022Chain-of-Thought Prompting Elicits Reasoning in Large Language Modelscited by 12,302
  4. 2016Semi-Supervised Classification with Graph Convolutional Networkscited by 11,282
  5. 2020Retrieval-Augmented Generation for Knowledge-Intensive NLP Taskscited by 9,160
  6. 2017Inductive Representation Learning on Large Graphscited by 6,284
  7. 2024Qwen2 Technical Reportcited by 2,076
  8. 2017Modeling Relational Data with Graph Convolutional Networkscited by 1,684
  9. 2023A Survey on Evaluation of Large Language Modelscited by 1,227
  10. 2024ChatGLM: A Family of Large Language Models from GLM-130B to GLM-4 All Toolscited by 1,096
  11. 2023Unifying Large Language Models and Knowledge Graphs: A Roadmapcited by 663
  12. 2021Recent Advances in Natural Language Processing via Large Pre-Trained Language Models: A Surveycited by 457
8 more
  1. 2024CultureLLM: Incorporating Cultural Differences into Large Language Modelscited by 49
  2. 2019Estimating Node Importance in Knowledge Graphs Using Graph Neural Networkscited by 43
  3. 2023Enhancing Text-based Knowledge Graph Completion with Zero-Shot Large Language Models: A Focus on Semantic Enhancementcited by 14
  4. 2020MultiImport: Inferring Node Importance in a Knowledge Graph from Multiple Input Signalscited by 9
  5. 2024Deep Structural Knowledge Exploitation and Synergy for Estimating Node Importance Value on Heterogeneous Information Networkscited by 9
  6. 2020GloDyNE: Global Topology Preserving Dynamic Network Embeddingcited by 8
  7. 2020Centrality Measures in Complex Networks: A Surveycited by 8
  8. 2024Label Informed Contrastive Pretraining for Node Importance Estimation on Knowledge Graphscited by 5

Built on by

Cited by year

Citing papers per year: 2025: 2.

2 papers.