Automated Construction of Theme-specific Knowledge Graphs
Not on the map. Why?
Abstract (arXiv)
Despite widespread applications of knowledge graphs (KGs) in various tasks such as question answering and intelligent conversational systems, existing KGs face two major challenges: information granularity and deficiency in timeliness. These hinder considerably the retrieval and analysis of in-context, fine-grained, and up-to-date knowledge from KGs, particularly in highly specialized themes (e.g., specialized scientific research) and rapidly evolving contexts (e.g., breaking news or disaster tracking). To tackle such challenges, we propose a theme-specific knowledge graph (i.e., ThemeKG), a KG constructed from a theme-specific corpus, and design an unsupervised framework for ThemeKG construction (named TKGCon). The framework takes raw theme-specific corpus and generates a high-quality KG that includes salient entities and relations under the theme. Specifically, we start with an entity ontology of the theme from Wikipedia, based on which we then generate candidate relations by Large Language Models (LLMs) to construct a relation ontology. To parse the documents from the theme corpus, we first map the extracted entity pairs to the ontology and retrieve the candidate relations. Finally, we incorporate the context and ontology to consolidate the relations for entity pairs. We observe that directly prompting GPT-4 for theme-specific KG leads to inaccurate entities (such as "two main types" as one entity in the query result) and unclear (such as "is", "has") or wrong relations (such as "have due to", "to start"). In contrast, by constructing the theme-specific KG step by step, our model outperforms GPT-4 and could consistently identify accurate entities and relations. Experimental results also show that our framework excels in evaluations compared with various KG construction baselines.
Key facts. Cited by 15 papers in the map (data through 7 Oct 2026). Builds on 27 of its 58 references that are in the map. First posted on arXiv 29 Apr 2024.
Builds on
27 of 58 references.
References · 27
- 2017Attention Is All You Needcited by 59,932
- 2020Language Models are Few-Shot Learnerscited by 32,199
- 2020Retrieval-Augmented Generation for Knowledge-Intensive NLP Taskscited by 9,160
- 2019BART: Denoising Sequence-to-Sequence Pre-training for Natural Language Generation, Translation, and Comprehensioncited by 5,874
- 2018Deep contextualized word representationscited by 2,285
- 2017Convolutional 2D Knowledge Graph Embeddingscited by 729
- 2022Large Language Models Struggle to Learn Long-Tail Knowledgecited by 452
- 2021PTR: Prompt Tuning with Rules for Text Classificationcited by 238
- 2019PullNet: Open Domain Question Answering with Iterative Retrieval on Knowledge Bases and Textcited by 182
- 2017Automated Phrase Mining from Massive Text Corporacited by 70
- 2023GPT-RE: In-context Learning for Relation Extraction using Large Language Modelscited by 62
- 2020IMoJIE: Iterative Memory-Based Joint Open Information Extractioncited by 34
15 more
- 2023Knowledge Graph Completion Models are Few-shot Learners: An Empirical Study of Relation Labeling in E-commerce with LLMscited by 24
- 2024MolTC: Towards Molecular Relational Modeling In Language Modelscited by 22
- 2022Relation Extraction as Open-book Examination: Retrieval-enhanced Prompt Tuningcited by 13
- 2022Few-Shot Document-Level Relation Extractioncited by 11
- 2022Open-Vocabulary Argument Role Prediction for Event Extractioncited by 11
- 2021DocOIE: A Document-level Context-Aware Dataset for OpenIEcited by 10
- 2017Weakly-supervised Relation Extraction by Pattern-enhanced Embedding Learningcited by 9
- 2018Graphene: Semantically-Linked Propositions in Open Information Extractioncited by 8
- 2022MedML: Fusing Medical Knowledge and Machine Learning Models for Early Pediatric COVID-19 Hospitalization and Severity Predictioncited by 8
- 2023Text-Augmented Open Knowledge Graph Completion via Pre-Trained Language Modelscited by 8
- 2024Revisiting Document-Level Relation Extraction with Context-Guided Link Predictioncited by 6
- 2023Beyond Isolation: Multi-Agent Synergy for Improving Knowledge Graph Constructioncited by 5
- 2023Making Large Language Models Better Knowledge Miners for Online Marketing with Progressive Prompting Augmentationcited by 5
- 2023Synergistic Anchored Contrastive Pre-training for Few-Shot Relation Extractioncited by 5
- 2023Comparison of pipeline, sequence-to-sequence, and GPT models for end-to-end relation extraction: experiments with the rare disease use-casecited by 2
Built on by
Citing papers per year: 2024: 5; 2025: 7; 2026: 3.
15 papers.
Sort:
By area:
- 2024Combining Knowledge Graphs and Large Language Modelscited by 16
- 2024iText2KG: Incremental Knowledge Graphs Construction Using Large Language Modelscited by 11
- 2024An Automatic Graph Construction Framework based on Large Language Models for Recommendationcited by 8
- 2025A Survey on Retrieval And Structuring Augmented Generation with Large Language Modelscited by 8
- 2024Scaling Knowledge Graph Construction through Synthetic Data Generation and Distillationcited by 6
- 2025Knowledge Augmented Complex Problem Solving with Large Language Models: A Surveycited by 6
- 2025MedKGent: A Large Language Model Agent Framework for Constructing Temporally Evolving Medical Knowledge Graphcited by 5
- 2025LKD-KGC: Domain-Specific KG Construction via LLM-driven Knowledge Dependency Parsingcited by 4
- 2025FinKario: Event-Enhanced Automated Construction of Financial Knowledge Graphcited by 4
- 2025Structure-Augmented Reasoning Generationcited by 2
- 2025Improving Factuality in LLMs via Inference-Time Knowledge Graph Constructioncited by 2
- 2024Hierarchical Knowledge Graph Construction from Images for Scalable E-Commercecited by 0
3 more
- 2026Automated Domain Question Mapping (DQM) with Educational Learning Materialscited by 0
- 2026Slides2MindMap: Reconstructing Cognitively Efficient Knowledge Hierarchies from Lecture Slidescited by 0
- 2026EGT-KG: Evidence-Grounded Typed KG Retrieval for Practical Scientific QA with Small Language Modelscited by 0
- 2026EGT-KG: Evidence-Grounded Typed KG Retrieval for Practical Scientific QA with Small Language Models31 Aug 2026
- 2026Slides2MindMap: Reconstructing Cognitively Efficient Knowledge Hierarchies from Lecture Slides1 Aug 2026
- 2026Automated Domain Question Mapping (DQM) with Educational Learning Materials11 Jan 2026
- 2025A Survey on Retrieval And Structuring Augmented Generation with Large Language Models12 Sep 2025
- 2025Improving Factuality in LLMs via Inference-Time Knowledge Graph Construction31 Aug 2025
- 2025MedKGent: A Large Language Model Agent Framework for Constructing Temporally Evolving Medical Knowledge Graph17 Aug 2025
- 2025FinKario: Event-Enhanced Automated Construction of Financial Knowledge Graph1 Aug 2025
- 2025Structure-Augmented Reasoning Generation10 Jun 2025
- 2025LKD-KGC: Domain-Specific KG Construction via LLM-driven Knowledge Dependency Parsing30 May 2025
- 2025Knowledge Augmented Complex Problem Solving with Large Language Models: A Survey6 May 2025
- 2024An Automatic Graph Construction Framework based on Large Language Models for Recommendation24 Dec 2024
- 2024Hierarchical Knowledge Graph Construction from Images for Scalable E-Commerce28 Oct 2024
- 2024Combining Knowledge Graphs and Large Language Modelscited by 16
- 2024iText2KG: Incremental Knowledge Graphs Construction Using Large Language Modelscited by 11
- 2024An Automatic Graph Construction Framework based on Large Language Models for Recommendationcited by 8
- 2025A Survey on Retrieval And Structuring Augmented Generation with Large Language Modelscited by 8
- 2025LKD-KGC: Domain-Specific KG Construction via LLM-driven Knowledge Dependency Parsingcited by 4
- 2025FinKario: Event-Enhanced Automated Construction of Financial Knowledge Graphcited by 4
- 2025Improving Factuality in LLMs via Inference-Time Knowledge Graph Constructioncited by 2
- 2024Hierarchical Knowledge Graph Construction from Images for Scalable E-Commercecited by 0
- 2026Automated Domain Question Mapping (DQM) with Educational Learning Materialscited by 0
- 2026Slides2MindMap: Reconstructing Cognitively Efficient Knowledge Hierarchies from Lecture Slidescited by 0
- 2026Slides2MindMap: Reconstructing Cognitively Efficient Knowledge Hierarchies from Lecture Slides1 Aug 2026
- 2026Automated Domain Question Mapping (DQM) with Educational Learning Materials11 Jan 2026
- 2025A Survey on Retrieval And Structuring Augmented Generation with Large Language Models12 Sep 2025
- 2025Improving Factuality in LLMs via Inference-Time Knowledge Graph Construction31 Aug 2025
- 2025FinKario: Event-Enhanced Automated Construction of Financial Knowledge Graph1 Aug 2025
- 2025LKD-KGC: Domain-Specific KG Construction via LLM-driven Knowledge Dependency Parsing30 May 2025
- 2024An Automatic Graph Construction Framework based on Large Language Models for Recommendation24 Dec 2024
- 2024Hierarchical Knowledge Graph Construction from Images for Scalable E-Commerce28 Oct 2024
- 2024iText2KG: Incremental Knowledge Graphs Construction Using Large Language Models5 Sep 2024
- 2024Combining Knowledge Graphs and Large Language Models9 Jul 2024