Large language models as oracles for instantiating ontologies with domain-specific knowledge
Not on the map. Why?
Abstract (arXiv)
Background. Endowing intelligent systems with semantic data commonly requires designing and instantiating ontologies with domain-specific knowledge. Especially in the early phases, those activities are typically performed manually by human experts possibly leveraging on their own experience. The resulting process is therefore time-consuming, error-prone, and often biased by the personal background of the ontology designer. Objective. To mitigate that issue, we propose a novel domain-independent approach to automatically instantiate ontologies with domain-specific knowledge, by leveraging on large language models (LLMs) as oracles. Method. Starting from (i) an initial schema composed by inter-related classes and properties and (ii) a set of query templates, our method queries the LLM multiple times, and generates instances for both classes and properties from its replies. Thus, the ontology is automatically filled with domain-specific knowledge, compliant to the initial schema. As a result, the ontology is quickly and automatically enriched with manifold instances, which experts may consider to keep, adjust, discard, or complement according to their own needs and expertise. Contribution. We formalise our method in general way and instantiate it over various LLMs, as well as on a concrete case study. We report experiments rooted in the nutritional domain where an ontology of food meals and their ingredients is automatically instantiated from scratch, starting from a categorisation of meals and their relationships. There, we analyse the quality of the generated ontologies and compare ontologies attained by exploiting different LLMs. Experimentally, our approach achieves a quality metric that is up to five times higher than the state-of-the-art, while reducing erroneous entities and relations by up to ten times. Finally, we provide a SWOT analysis of the proposed method.
Key facts. Cited by 6 papers in the map (data through 7 Oct 2026). Builds on 38 of its 95 references that are in the map. First posted on arXiv 5 Apr 2024.
Builds on
38 of 95 references.
References · 38
- 2018BERT: Pre-training of Deep Bidirectional Transformers for Language Understandingcited by 40,204
- 2020Language Models are Few-Shot Learnerscited by 32,199
- 2023GPT-4 Technical Reportcited by 18,132
- 2019Exploring the Limits of Transfer Learning with a Unified Text-to-Text Transformercited by 14,491
- 2023LLaMA: Open and Efficient Foundation Language Modelscited by 13,958
- 2019RoBERTa: A Robustly Optimized BERT Pretraining Approachcited by 13,266
- 2023Llama 2: Open Foundation and Fine-Tuned Chat Modelscited by 12,865
- 2023Mistral 7Bcited by 3,065
- 2022Emergent Abilities of Large Language Modelscited by 2,483
- 2020Extracting Training Data from Large Language Modelscited by 2,144
- 2019Language Models as Knowledge Bases?cited by 1,922
- 2024Mixtral of Expertscited by 1,785
26 more
- 2015Aligning Books and Movies: Towards Story-like Visual Explanations by Watching Movies and Reading Bookscited by 1,041
- 2023Large Language Models as Optimizerscited by 830
- 2023Siren's Song in the AI Ocean: A Survey on Hallucination in Large Language Modelscited by 695
- 2023Unifying Large Language Models and Knowledge Graphs: A Roadmapcited by 663
- 2023Are Emergent Abilities of Large Language Models a Mirage?cited by 515
- 2021Recent Advances in Natural Language Processing via Large Pre-Trained Language Models: A Surveycited by 457
- 2019COMET: Commonsense Transformers for Automatic Knowledge Graph Constructioncited by 450
- 2020Autoregressive Entity Retrievalcited by 333
- 2018Multi-Task Identification of Entities, Relations, and Coreference for Scientific Knowledge Graph Constructioncited by 321
- 2023How is ChatGPT's behavior changing over time?cited by 265
- 2023OpenChat: Advancing Open-source Language Models with Mixed-Quality Datacited by 250
- 2023Reasoning or Reciting? Exploring the Capabilities and Limitations of Language Models Through Counterfactual Taskscited by 243
- 2018A Simple Method for Commonsense Reasoningcited by 223
- 2023LLMs for Knowledge Graph Construction and Reasoning: Recent Capabilities and Future Opportunitiescited by 97
- 2022Sequence-to-Sequence Knowledge Graph Completion and Question Answeringcited by 75
- 2022ReFinED: An Efficient Zero-shot-capable Approach to End-to-End Entity Linkingcited by 74
- 2023Large Language Models and Knowledge Graphs: Opportunities and Challengescited by 71
- 2019Cross-lingual Knowledge Graph Alignment via Graph Matching Neural Networkcited by 68
- 2018Co-training Embeddings of Knowledge Graphs and Entity Descriptions for Cross-lingual Entity Alignmentcited by 49
- 2022From Discrimination to Generation: Knowledge Graph Completion with Generative Transformercited by 45
- 2023PiVe: Prompting with Iterative Verification Improving Graph-based Generative Capability of LLMscited by 44
- 2022Knowledge Is Flat: A Seq2Seq Generative Framework for Various Knowledge Graph Completioncited by 32
- 2023Towards Ontology Construction with Language Modelscited by 23
- 2022BertNet: Harvesting Knowledge Graphs with Arbitrary Relations from Pretrained Language Modelscited by 20
- 2024Contextualization Distillation from Large Language Model for Knowledge Graph Completioncited by 18
- 2022Joint Language Semantic and Structure Embedding for Knowledge Graph Completioncited by 15
Built on by
Citing papers per year: 2024: 2; 2025: 2; 2026: 2.
6 papers.
- 2026Artificial Intelligence in Materials Science and Engineering: Current Landscape, Key Challenges, and Future Trajectoriecited by 5
- 2025Ontology Learning with LLMs: A Benchmark Study on Axiom Identificationcited by 4
- 2024Towards Ontology-Enhanced Representation Learning for Large Language Modelscited by 3
- 2025Integrating Machine Learning into Belief-Desire-Intention Agents: Current Advances and Open Challengescited by 1
- 2026Development of Ontological Knowledge Bases by Leveraging Large Language Modelscited by 1
- 2024The Mercurial Top-Level Ontology of Large Language Modelscited by 0
- 2026Artificial Intelligence in Materials Science and Engineering: Current Landscape, Key Challenges, and Future Trajectorie18 Jan 2026
- 2026Development of Ontological Knowledge Bases by Leveraging Large Language Models15 Jan 2026
- 2025Ontology Learning with LLMs: A Benchmark Study on Axiom Identification5 Dec 2025
- 2025Integrating Machine Learning into Belief-Desire-Intention Agents: Current Advances and Open Challenges23 Oct 2025
- 2024Towards Ontology-Enhanced Representation Learning for Large Language Models30 May 2024
- 2024The Mercurial Top-Level Ontology of Large Language Models26 Apr 2024