Iterative Zero-Shot LLM Prompting for Knowledge Graph Construction
Not on the map. Why?
Abstract (arXiv)
In the current digitalization era, capturing and effectively representing knowledge is crucial in most real-world scenarios. In this context, knowledge graphs represent a potent tool for retrieving and organizing a vast amount of information in a properly interconnected and interpretable structure. However, their generation is still challenging and often requires considerable human effort and domain expertise, hampering the scalability and flexibility across different application fields. This paper proposes an innovative knowledge graph generation approach that leverages the potential of the latest generative large language models, such as GPT-3.5, that can address all the main critical issues in knowledge graph building. The approach is conveyed in a pipeline that comprises novel iterative zero-shot and external knowledge-agnostic strategies in the main stages of the generation process. Our unique manifold approach may encompass significant benefits to the scientific community. In particular, the main contribution can be summarized by: (i) an innovative strategy for iteratively prompting large language models to extract relevant components of the final graph; (ii) a zero-shot strategy for each prompt, meaning that there is no need for providing examples for "guiding" the prompt result; (iii) a scalable solution, as the adoption of LLMs avoids the need for any external resources or human expertise. To assess the effectiveness of our proposed model, we performed experiments on a dataset that covered a specific domain. We claim that our proposal is a suitable solution for scalable and versatile knowledge graph construction and may be applied to different and novel contexts.
Key facts. Cited by 25 papers in the map (data through 7 Oct 2026). Builds on 18 of its 30 references that are in the map. First posted on arXiv 3 Jul 2023.
Builds on
18 of 30 references.
References · 18
- 2023Tree of Thoughts: Deliberate Problem Solving with Large Language Modelscited by 3,155
- 2018Universal Sentence Encodercited by 485
- 2023Benchmarking Large Language Models for News Summarizationcited by 444
- 2018Multi-Task Identification of Entities, Relations, and Coreference for Scientific Knowledge Graph Constructioncited by 321
- 2023ChatIE: Zero-Shot Information Extraction via Chatting with ChatGPTcited by 250
- 2022Large Language Models are Few-Shot Clinical Information Extractorscited by 206
- 2015Named Entity Recognition with Bidirectional LSTM-CNNscited by 201
- 2023Evaluating ChatGPT's Information Extraction Capabilities: An Assessment of Performance, Explainability, Calibration, and Faithfulnesscited by 130
- 2020Language Models are Open Knowledge Graphscited by 95
- 2023GPT-RE: In-context Learning for Relation Extraction using Large Language Modelscited by 62
- 2022InPars: Data Augmentation for Information Retrieval using Large Language Modelscited by 60
- 2020Machine Knowledge: Creation and Curation of Comprehensive Knowledge Basescited by 55
6 more
- 2018A Survey on Open Information Extractioncited by 51
- 2023Enhancing Knowledge Graph Construction Using Large Language Modelscited by 44
- 2023PromptNER: Prompting For Named Entity Recognitioncited by 35
- 2023CodeKGC: Code Language Model for Generative Knowledge Graph Constructioncited by 28
- 2023VicunaNER: Zero/Few-shot Named Entity Recognition using Vicunacited by 9
- 2022Controllable Text Generation for Open-Domain Creativity and Fairnesscited by 6
Built on by
Citing papers per year: 2023: 3; 2024: 9; 2025: 8; 2026: 5.
25 papers.
Sort:
By area:
- 2024UniBind: LLM-Augmented Unified and Balanced Representation Space to Bind Them Allcited by 49
- 2023Making Large Language Models Perform Better in Knowledge Graph Completioncited by 48
- 2025Retrieval-Augmented Generation with Hierarchical Knowledgecited by 46
- 2025GraphEval: A Lightweight Graph-Based LLM Framework for Idea Evaluationcited by 17
- 2024Graphusion: A RAG Framework for Knowledge Graph Construction with a Global Perspectivecited by 12
- 2023Benchmarking the Abilities of Large Language Models for RDF Knowledge Graph Creation and Comprehension: How Well Do LLMs Speak Turtle?cited by 11
- 2024iText2KG: Incremental Knowledge Graphs Construction Using Large Language Modelscited by 11
- 2023Glitter or Gold? Deriving Structured Insights from Sustainability Reports via Large Language Modelscited by 6
- 2024Refining Wikidata Taxonomy using Large Language Modelscited by 5
- 2024Leveraging LLM for Automated Ontology Extraction and Knowledge Graph Generationcited by 5
- 2025Zero-Shot End-to-End Relation Extraction in Chinese: A Comparative Study of Gemini, LLaMA and ChatGPTcited by 5
- 2024Automating Intervention Discovery from Scientific Literature: A Progressive Ontology Prompting and Dual-LLM Frameworkcited by 2
13 more
- 2024Knowledge Pyramid Construction for Multi-Level Retrieval-Augmented Generationcited by 1
- 2025Enhancing Knowledge Graph Construction: Evaluating with Emphasis on Hallucination, Omission, and Graph Similarity Metricscited by 1
- 2025Fine-tuning of Large Language Models for Domain-Specific Cybersecurity Knowledgecited by 1
- 2026Integrating Graphs, Large Language Models, and Agents: Reasoning and Retrievalcited by 1
- 2024Interplay of Semantic Communication and Knowledge Learningcited by 0
- 2024Augmenting Knowledge Graph Hierarchies Using Neural Transformerscited by 0
- 2025Hidden Entity Detection from GitHub Leveraging Large Language Modelscited by 0
- 2025Automated Construction of a Knowledge Graph of Nuclear Fusion Energy for Effective Elicitation and Retrieval of Informationcited by 0
- 2025HyDRA: A Hybrid-Driven Reasoning Architecture for Verifiable Knowledge Graphscited by 0
- 2026LEC-KG: An LLM-Embedding Collaborative Framework for Domain-Specific Knowledge Graph Construction -- A Case Study on SDGscited by 0
- 2026The Semantic Ladder: A Framework for Progressive Formalization of Natural Language Content for Knowledge Graphs and AI Systemscited by 0
- 2026Construction of Knowledge Graph based on Language Modelcited by 0
- 2026FineREX: Fine-Tuned NER-RE for Human Smuggling Knowledge Graphscited by 0
- 2026FineREX: Fine-Tuned NER-RE for Human Smuggling Knowledge Graphs18 Jun 2026
- 2026Construction of Knowledge Graph based on Language Model21 Apr 2026
- 2026Integrating Graphs, Large Language Models, and Agents: Reasoning and Retrieval17 Apr 2026
- 2026The Semantic Ladder: A Framework for Progressive Formalization of Natural Language Content for Knowledge Graphs and AI Systems23 Mar 2026
- 2026LEC-KG: An LLM-Embedding Collaborative Framework for Domain-Specific Knowledge Graph Construction -- A Case Study on SDGs2 Feb 2026
- 2025Fine-tuning of Large Language Models for Domain-Specific Cybersecurity Knowledge25 Sep 2025
- 2025HyDRA: A Hybrid-Driven Reasoning Architecture for Verifiable Knowledge Graphs21 Jul 2025
- 2025Automated Construction of a Knowledge Graph of Nuclear Fusion Energy for Effective Elicitation and Retrieval of Information10 Apr 2025
- 2025GraphEval: A Lightweight Graph-Based LLM Framework for Idea Evaluation16 Mar 2025
- 2025Retrieval-Augmented Generation with Hierarchical Knowledge13 Mar 2025
- 2025Zero-Shot End-to-End Relation Extraction in Chinese: A Comparative Study of Gemini, LLaMA and ChatGPT8 Feb 2025
- 2025Enhancing Knowledge Graph Construction: Evaluating with Emphasis on Hallucination, Omission, and Graph Similarity Metrics7 Feb 2025
13 more
- 2025Hidden Entity Detection from GitHub Leveraging Large Language Models8 Jan 2025
- 2024Leveraging LLM for Automated Ontology Extraction and Knowledge Graph Generation30 Nov 2024
- 2024Graphusion: A RAG Framework for Knowledge Graph Construction with a Global Perspective23 Oct 2024
- 2024Refining Wikidata Taxonomy using Large Language Models6 Sep 2024
- 2024iText2KG: Incremental Knowledge Graphs Construction Using Large Language Models5 Sep 2024
- 2024Automating Intervention Discovery from Scientific Literature: A Progressive Ontology Prompting and Dual-LLM Framework20 Aug 2024
- 2024Knowledge Pyramid Construction for Multi-Level Retrieval-Augmented Generation31 Jul 2024
- 2024Augmenting Knowledge Graph Hierarchies Using Neural Transformers11 Apr 2024
- 2024UniBind: LLM-Augmented Unified and Balanced Representation Space to Bind Them All19 Mar 2024
- 2024Interplay of Semantic Communication and Knowledge Learning18 Jan 2024
- 2023Making Large Language Models Perform Better in Knowledge Graph Completion10 Oct 2023
- 2023Glitter or Gold? Deriving Structured Insights from Sustainability Reports via Large Language Models9 Oct 2023
- 2023Benchmarking the Abilities of Large Language Models for RDF Knowledge Graph Creation and Comprehension: How Well Do LLMs Speak Turtle?29 Sep 2023
- 2024UniBind: LLM-Augmented Unified and Balanced Representation Space to Bind Them Allcited by 49
- 2023Making Large Language Models Perform Better in Knowledge Graph Completioncited by 48
- 2025GraphEval: A Lightweight Graph-Based LLM Framework for Idea Evaluationcited by 17
- 2023Benchmarking the Abilities of Large Language Models for RDF Knowledge Graph Creation and Comprehension: How Well Do LLMs Speak Turtle?cited by 11
- 2024iText2KG: Incremental Knowledge Graphs Construction Using Large Language Modelscited by 11
- 2023Glitter or Gold? Deriving Structured Insights from Sustainability Reports via Large Language Modelscited by 6
- 2024Refining Wikidata Taxonomy using Large Language Modelscited by 5
- 2024Leveraging LLM for Automated Ontology Extraction and Knowledge Graph Generationcited by 5
- 2025Zero-Shot End-to-End Relation Extraction in Chinese: A Comparative Study of Gemini, LLaMA and ChatGPTcited by 5
- 2024Automating Intervention Discovery from Scientific Literature: A Progressive Ontology Prompting and Dual-LLM Frameworkcited by 2
- 2025Enhancing Knowledge Graph Construction: Evaluating with Emphasis on Hallucination, Omission, and Graph Similarity Metricscited by 1
- 2025Fine-tuning of Large Language Models for Domain-Specific Cybersecurity Knowledgecited by 1
12 most cited of 20 All 20 (JSON)
- 2026FineREX: Fine-Tuned NER-RE for Human Smuggling Knowledge Graphs18 Jun 2026
- 2026Construction of Knowledge Graph based on Language Model21 Apr 2026
- 2026The Semantic Ladder: A Framework for Progressive Formalization of Natural Language Content for Knowledge Graphs and AI Systems23 Mar 2026
- 2026LEC-KG: An LLM-Embedding Collaborative Framework for Domain-Specific Knowledge Graph Construction -- A Case Study on SDGs2 Feb 2026
- 2025Fine-tuning of Large Language Models for Domain-Specific Cybersecurity Knowledge25 Sep 2025
- 2025Automated Construction of a Knowledge Graph of Nuclear Fusion Energy for Effective Elicitation and Retrieval of Information10 Apr 2025
- 2025GraphEval: A Lightweight Graph-Based LLM Framework for Idea Evaluation16 Mar 2025
- 2025Zero-Shot End-to-End Relation Extraction in Chinese: A Comparative Study of Gemini, LLaMA and ChatGPT8 Feb 2025
- 2025Enhancing Knowledge Graph Construction: Evaluating with Emphasis on Hallucination, Omission, and Graph Similarity Metrics7 Feb 2025
- 2025Hidden Entity Detection from GitHub Leveraging Large Language Models8 Jan 2025
- 2024Leveraging LLM for Automated Ontology Extraction and Knowledge Graph Generation30 Nov 2024
- 2024Refining Wikidata Taxonomy using Large Language Models6 Sep 2024
12 newest of 20 All 20 (JSON)