mlsanityData to 7 Oct 2026

Large language models as oracles for instantiating ontologies with domain-specific knowledge

arXiv 2404.04108 ↗First posted 5 Apr 2024cs.AI cs.CL cs.IRcited by 6

Not on the map. Why?

Abstract (arXiv)

Background. Endowing intelligent systems with semantic data commonly requires designing and instantiating ontologies with domain-specific knowledge. Especially in the early phases, those activities are typically performed manually by human experts possibly leveraging on their own experience. The resulting process is therefore time-consuming, error-prone, and often biased by the personal background of the ontology designer. Objective. To mitigate that issue, we propose a novel domain-independent approach to automatically instantiate ontologies with domain-specific knowledge, by leveraging on large language models (LLMs) as oracles. Method. Starting from (i) an initial schema composed by inter-related classes and properties and (ii) a set of query templates, our method queries the LLM multiple times, and generates instances for both classes and properties from its replies. Thus, the ontology is automatically filled with domain-specific knowledge, compliant to the initial schema. As a result, the ontology is quickly and automatically enriched with manifold instances, which experts may consider to keep, adjust, discard, or complement according to their own needs and expertise. Contribution. We formalise our method in general way and instantiate it over various LLMs, as well as on a concrete case study. We report experiments rooted in the nutritional domain where an ontology of food meals and their ingredients is automatically instantiated from scratch, starting from a categorisation of meals and their relationships. There, we analyse the quality of the generated ontologies and compare ontologies attained by exploiting different LLMs. Experimentally, our approach achieves a quality metric that is up to five times higher than the state-of-the-art, while reducing erroneous entities and relations by up to ten times. Finally, we provide a SWOT analysis of the proposed method.

Key facts. Cited by 6 papers in the map (data through 7 Oct 2026). Builds on 38 of its 95 references that are in the map. First posted on arXiv 5 Apr 2024.

Builds on

38 of 95 references.

References · 38

  1. 2018BERT: Pre-training of Deep Bidirectional Transformers for Language Understandingcited by 40,204
  2. 2020Language Models are Few-Shot Learnerscited by 32,199
  3. 2023GPT-4 Technical Reportcited by 18,132
  4. 2019Exploring the Limits of Transfer Learning with a Unified Text-to-Text Transformercited by 14,491
  5. 2023LLaMA: Open and Efficient Foundation Language Modelscited by 13,958
  6. 2019RoBERTa: A Robustly Optimized BERT Pretraining Approachcited by 13,266
  7. 2023Llama 2: Open Foundation and Fine-Tuned Chat Modelscited by 12,865
  8. 2023Mistral 7Bcited by 3,065
  9. 2022Emergent Abilities of Large Language Modelscited by 2,483
  10. 2020Extracting Training Data from Large Language Modelscited by 2,144
  11. 2019Language Models as Knowledge Bases?cited by 1,922
  12. 2024Mixtral of Expertscited by 1,785
26 more
  1. 2015Aligning Books and Movies: Towards Story-like Visual Explanations by Watching Movies and Reading Bookscited by 1,041
  2. 2023Large Language Models as Optimizerscited by 830
  3. 2023Siren's Song in the AI Ocean: A Survey on Hallucination in Large Language Modelscited by 695
  4. 2023Unifying Large Language Models and Knowledge Graphs: A Roadmapcited by 663
  5. 2023Are Emergent Abilities of Large Language Models a Mirage?cited by 515
  6. 2021Recent Advances in Natural Language Processing via Large Pre-Trained Language Models: A Surveycited by 457
  7. 2019COMET: Commonsense Transformers for Automatic Knowledge Graph Constructioncited by 450
  8. 2020Autoregressive Entity Retrievalcited by 333
  9. 2018Multi-Task Identification of Entities, Relations, and Coreference for Scientific Knowledge Graph Constructioncited by 321
  10. 2023How is ChatGPT's behavior changing over time?cited by 265
  11. 2023OpenChat: Advancing Open-source Language Models with Mixed-Quality Datacited by 250
  12. 2023Reasoning or Reciting? Exploring the Capabilities and Limitations of Language Models Through Counterfactual Taskscited by 243
  13. 2018A Simple Method for Commonsense Reasoningcited by 223
  14. 2023LLMs for Knowledge Graph Construction and Reasoning: Recent Capabilities and Future Opportunitiescited by 97
  15. 2022Sequence-to-Sequence Knowledge Graph Completion and Question Answeringcited by 75
  16. 2022ReFinED: An Efficient Zero-shot-capable Approach to End-to-End Entity Linkingcited by 74
  17. 2023Large Language Models and Knowledge Graphs: Opportunities and Challengescited by 71
  18. 2019Cross-lingual Knowledge Graph Alignment via Graph Matching Neural Networkcited by 68
  19. 2018Co-training Embeddings of Knowledge Graphs and Entity Descriptions for Cross-lingual Entity Alignmentcited by 49
  20. 2022From Discrimination to Generation: Knowledge Graph Completion with Generative Transformercited by 45
  21. 2023PiVe: Prompting with Iterative Verification Improving Graph-based Generative Capability of LLMscited by 44
  22. 2022Knowledge Is Flat: A Seq2Seq Generative Framework for Various Knowledge Graph Completioncited by 32
  23. 2023Towards Ontology Construction with Language Modelscited by 23
  24. 2022BertNet: Harvesting Knowledge Graphs with Arbitrary Relations from Pretrained Language Modelscited by 20
  25. 2024Contextualization Distillation from Large Language Model for Knowledge Graph Completioncited by 18
  26. 2022Joint Language Semantic and Structure Embedding for Knowledge Graph Completioncited by 15

Built on by

Cited by year (2026 to 7 Oct)

Citing papers per year: 2024: 2; 2025: 2; 2026: 2.

6 papers.