mlsanityData to 7 Oct 2026

Automated Construction of Theme-specific Knowledge Graphs

arXiv 2404.19146 ↗First posted 29 Apr 2024cs.AI cs.IRcited by 15

Not on the map. Why?

Abstract (arXiv)

Despite widespread applications of knowledge graphs (KGs) in various tasks such as question answering and intelligent conversational systems, existing KGs face two major challenges: information granularity and deficiency in timeliness. These hinder considerably the retrieval and analysis of in-context, fine-grained, and up-to-date knowledge from KGs, particularly in highly specialized themes (e.g., specialized scientific research) and rapidly evolving contexts (e.g., breaking news or disaster tracking). To tackle such challenges, we propose a theme-specific knowledge graph (i.e., ThemeKG), a KG constructed from a theme-specific corpus, and design an unsupervised framework for ThemeKG construction (named TKGCon). The framework takes raw theme-specific corpus and generates a high-quality KG that includes salient entities and relations under the theme. Specifically, we start with an entity ontology of the theme from Wikipedia, based on which we then generate candidate relations by Large Language Models (LLMs) to construct a relation ontology. To parse the documents from the theme corpus, we first map the extracted entity pairs to the ontology and retrieve the candidate relations. Finally, we incorporate the context and ontology to consolidate the relations for entity pairs. We observe that directly prompting GPT-4 for theme-specific KG leads to inaccurate entities (such as "two main types" as one entity in the query result) and unclear (such as "is", "has") or wrong relations (such as "have due to", "to start"). In contrast, by constructing the theme-specific KG step by step, our model outperforms GPT-4 and could consistently identify accurate entities and relations. Experimental results also show that our framework excels in evaluations compared with various KG construction baselines.

Key facts. Cited by 15 papers in the map (data through 7 Oct 2026). Builds on 27 of its 58 references that are in the map. First posted on arXiv 29 Apr 2024.

Builds on

27 of 58 references.

References · 27

  1. 2017Attention Is All You Needcited by 59,932
  2. 2020Language Models are Few-Shot Learnerscited by 32,199
  3. 2020Retrieval-Augmented Generation for Knowledge-Intensive NLP Taskscited by 9,160
  4. 2019BART: Denoising Sequence-to-Sequence Pre-training for Natural Language Generation, Translation, and Comprehensioncited by 5,874
  5. 2018Deep contextualized word representationscited by 2,285
  6. 2017Convolutional 2D Knowledge Graph Embeddingscited by 729
  7. 2022Large Language Models Struggle to Learn Long-Tail Knowledgecited by 452
  8. 2021PTR: Prompt Tuning with Rules for Text Classificationcited by 238
  9. 2019PullNet: Open Domain Question Answering with Iterative Retrieval on Knowledge Bases and Textcited by 182
  10. 2017Automated Phrase Mining from Massive Text Corporacited by 70
  11. 2023GPT-RE: In-context Learning for Relation Extraction using Large Language Modelscited by 62
  12. 2020IMoJIE: Iterative Memory-Based Joint Open Information Extractioncited by 34
15 more
  1. 2023Knowledge Graph Completion Models are Few-shot Learners: An Empirical Study of Relation Labeling in E-commerce with LLMscited by 24
  2. 2024MolTC: Towards Molecular Relational Modeling In Language Modelscited by 22
  3. 2022Relation Extraction as Open-book Examination: Retrieval-enhanced Prompt Tuningcited by 13
  4. 2022Few-Shot Document-Level Relation Extractioncited by 11
  5. 2022Open-Vocabulary Argument Role Prediction for Event Extractioncited by 11
  6. 2021DocOIE: A Document-level Context-Aware Dataset for OpenIEcited by 10
  7. 2017Weakly-supervised Relation Extraction by Pattern-enhanced Embedding Learningcited by 9
  8. 2018Graphene: Semantically-Linked Propositions in Open Information Extractioncited by 8
  9. 2022MedML: Fusing Medical Knowledge and Machine Learning Models for Early Pediatric COVID-19 Hospitalization and Severity Predictioncited by 8
  10. 2023Text-Augmented Open Knowledge Graph Completion via Pre-Trained Language Modelscited by 8
  11. 2024Revisiting Document-Level Relation Extraction with Context-Guided Link Predictioncited by 6
  12. 2023Beyond Isolation: Multi-Agent Synergy for Improving Knowledge Graph Constructioncited by 5
  13. 2023Making Large Language Models Better Knowledge Miners for Online Marketing with Progressive Prompting Augmentationcited by 5
  14. 2023Synergistic Anchored Contrastive Pre-training for Few-Shot Relation Extractioncited by 5
  15. 2023Comparison of pipeline, sequence-to-sequence, and GPT models for end-to-end relation extraction: experiments with the rare disease use-casecited by 2

Built on by

Cited by year (2026 to 7 Oct)

Citing papers per year: 2024: 5; 2025: 7; 2026: 3.

15 papers.

Sort:

By area: