mlsanityData to 7 Oct 2026

Iterative Zero-Shot LLM Prompting for Knowledge Graph Construction

arXiv 2307.01128 ↗First posted 3 Jul 2023cs.CL cs.AIcited by 25

Not on the map. Why?

Abstract (arXiv)

In the current digitalization era, capturing and effectively representing knowledge is crucial in most real-world scenarios. In this context, knowledge graphs represent a potent tool for retrieving and organizing a vast amount of information in a properly interconnected and interpretable structure. However, their generation is still challenging and often requires considerable human effort and domain expertise, hampering the scalability and flexibility across different application fields. This paper proposes an innovative knowledge graph generation approach that leverages the potential of the latest generative large language models, such as GPT-3.5, that can address all the main critical issues in knowledge graph building. The approach is conveyed in a pipeline that comprises novel iterative zero-shot and external knowledge-agnostic strategies in the main stages of the generation process. Our unique manifold approach may encompass significant benefits to the scientific community. In particular, the main contribution can be summarized by: (i) an innovative strategy for iteratively prompting large language models to extract relevant components of the final graph; (ii) a zero-shot strategy for each prompt, meaning that there is no need for providing examples for "guiding" the prompt result; (iii) a scalable solution, as the adoption of LLMs avoids the need for any external resources or human expertise. To assess the effectiveness of our proposed model, we performed experiments on a dataset that covered a specific domain. We claim that our proposal is a suitable solution for scalable and versatile knowledge graph construction and may be applied to different and novel contexts.

Key facts. Cited by 25 papers in the map (data through 7 Oct 2026). Builds on 18 of its 30 references that are in the map. First posted on arXiv 3 Jul 2023.

Builds on

18 of 30 references.

References · 18

  1. 2023Tree of Thoughts: Deliberate Problem Solving with Large Language Modelscited by 3,155
  2. 2018Universal Sentence Encodercited by 485
  3. 2023Benchmarking Large Language Models for News Summarizationcited by 444
  4. 2018Multi-Task Identification of Entities, Relations, and Coreference for Scientific Knowledge Graph Constructioncited by 321
  5. 2023ChatIE: Zero-Shot Information Extraction via Chatting with ChatGPTcited by 250
  6. 2022Large Language Models are Few-Shot Clinical Information Extractorscited by 206
  7. 2015Named Entity Recognition with Bidirectional LSTM-CNNscited by 201
  8. 2023Evaluating ChatGPT's Information Extraction Capabilities: An Assessment of Performance, Explainability, Calibration, and Faithfulnesscited by 130
  9. 2020Language Models are Open Knowledge Graphscited by 95
  10. 2023GPT-RE: In-context Learning for Relation Extraction using Large Language Modelscited by 62
  11. 2022InPars: Data Augmentation for Information Retrieval using Large Language Modelscited by 60
  12. 2020Machine Knowledge: Creation and Curation of Comprehensive Knowledge Basescited by 55
6 more
  1. 2018A Survey on Open Information Extractioncited by 51
  2. 2023Enhancing Knowledge Graph Construction Using Large Language Modelscited by 44
  3. 2023PromptNER: Prompting For Named Entity Recognitioncited by 35
  4. 2023CodeKGC: Code Language Model for Generative Knowledge Graph Constructioncited by 28
  5. 2023VicunaNER: Zero/Few-shot Named Entity Recognition using Vicunacited by 9
  6. 2022Controllable Text Generation for Open-Domain Creativity and Fairnesscited by 6

Built on by

Cited by year (2026 to 7 Oct)

Citing papers per year: 2023: 3; 2024: 9; 2025: 8; 2026: 5.

25 papers.

Sort:

By area:

  1. 2024UniBind: LLM-Augmented Unified and Balanced Representation Space to Bind Them Allcited by 49
  2. 2023Making Large Language Models Perform Better in Knowledge Graph Completioncited by 48
  3. 2025Retrieval-Augmented Generation with Hierarchical Knowledgecited by 46
  4. 2025GraphEval: A Lightweight Graph-Based LLM Framework for Idea Evaluationcited by 17
  5. 2024Graphusion: A RAG Framework for Knowledge Graph Construction with a Global Perspectivecited by 12
  6. 2023Benchmarking the Abilities of Large Language Models for RDF Knowledge Graph Creation and Comprehension: How Well Do LLMs Speak Turtle?cited by 11
  7. 2024iText2KG: Incremental Knowledge Graphs Construction Using Large Language Modelscited by 11
  8. 2023Glitter or Gold? Deriving Structured Insights from Sustainability Reports via Large Language Modelscited by 6
  9. 2024Refining Wikidata Taxonomy using Large Language Modelscited by 5
  10. 2024Leveraging LLM for Automated Ontology Extraction and Knowledge Graph Generationcited by 5
  11. 2025Zero-Shot End-to-End Relation Extraction in Chinese: A Comparative Study of Gemini, LLaMA and ChatGPTcited by 5
  12. 2024Automating Intervention Discovery from Scientific Literature: A Progressive Ontology Prompting and Dual-LLM Frameworkcited by 2
13 more
  1. 2024Knowledge Pyramid Construction for Multi-Level Retrieval-Augmented Generationcited by 1
  2. 2025Enhancing Knowledge Graph Construction: Evaluating with Emphasis on Hallucination, Omission, and Graph Similarity Metricscited by 1
  3. 2025Fine-tuning of Large Language Models for Domain-Specific Cybersecurity Knowledgecited by 1
  4. 2026Integrating Graphs, Large Language Models, and Agents: Reasoning and Retrievalcited by 1
  5. 2024Interplay of Semantic Communication and Knowledge Learningcited by 0
  6. 2024Augmenting Knowledge Graph Hierarchies Using Neural Transformerscited by 0
  7. 2025Hidden Entity Detection from GitHub Leveraging Large Language Modelscited by 0
  8. 2025Automated Construction of a Knowledge Graph of Nuclear Fusion Energy for Effective Elicitation and Retrieval of Informationcited by 0
  9. 2025HyDRA: A Hybrid-Driven Reasoning Architecture for Verifiable Knowledge Graphscited by 0
  10. 2026LEC-KG: An LLM-Embedding Collaborative Framework for Domain-Specific Knowledge Graph Construction -- A Case Study on SDGscited by 0
  11. 2026The Semantic Ladder: A Framework for Progressive Formalization of Natural Language Content for Knowledge Graphs and AI Systemscited by 0
  12. 2026Construction of Knowledge Graph based on Language Modelcited by 0
  13. 2026FineREX: Fine-Tuned NER-RE for Human Smuggling Knowledge Graphscited by 0