OntoChat: a Framework for Conversational Ontology Engineering using Language Models
Not on the map. Why?
Abstract (arXiv)
Ontology engineering (OE) in large projects poses a number of challenges arising from the heterogeneous backgrounds of the various stakeholders, domain experts, and their complex interactions with ontology designers. This multi-party interaction often creates systematic ambiguities and biases from the elicitation of ontology requirements, which directly affect the design, evaluation and may jeopardise the target reuse. Meanwhile, current OE methodologies strongly rely on manual activities (e.g., interviews, discussion pages). After collecting evidence on the most crucial OE activities, we introduce OntoChat, a framework for conversational ontology engineering that supports requirement elicitation, analysis, and testing. By interacting with a conversational agent, users can steer the creation of user stories and the extraction of competency questions, while receiving computational support to analyse the overall requirements and test early versions of the resulting ontologies. We evaluate OntoChat by replicating the engineering of the Music Meta Ontology, and collecting preliminary metrics on the effectiveness of each component from users. We release all code at https://github.com/King-s-Knowledge-Graph-Lab/OntoChat.
Key facts. Cited by 15 papers in the map (data through 14 Oct 2026). Builds on 16 of its 33 references that are in the map. First posted on arXiv 9 Mar 2024.
Builds on
16 of 33 references.
References · 16
- 2020Language Models are Few-Shot Learnerscited by 32,419
- 2019Gradio: Hassle-Free Sharing and Testing of ML Models in the Wildcited by 178
- 2020Unsupervised Domain Clusters in Pretrained Language Modelscited by 160
- 2023LLMs4OL: Large Language Models for Ontology Learningcited by 77
- 2023Large Language Models Enable Few-Shot Clusteringcited by 72
- 2023ClusterLLM: Large Language Models as a Guide for Text Clusteringcited by 70
- 2023LLM-assisted Knowledge Graph Engineering: Experiments with ChatGPTcited by 42
- 2023OLaLa: Ontology Matching with Large Language Modelscited by 35
- 2023Agent-OM: Leveraging LLM Agents for Ontology Matchingcited by 27
- 2023Exploring Large Language Models for Ontology Alignmentcited by 26
- 2023Towards Ontology Construction with Language Modelscited by 23
- 2023Ontology engineering with Large Language Modelscited by 17
4 more
- 2023An Experiment in Retrofitting Competency Questions for Existing Ontologiescited by 12
- 2023Knowledge Engineering using Large Language Modelscited by 9
- 2023Using Large Language Models for Knowledge Engineering (LLMKE): A Case Study on Wikidatacited by 5
- 2023The Music Meta Ontology: a flexible semantic model for the interoperability of music metadatacited by 4
Built on by
Citing papers per year: 2024: 3; 2025: 4; 2026: 8.
15 papers.
Sort:
- 2024LLMs4Life: Large Language Models for Ontology Learning in Life Sciencescited by 12
- 2024Large Language Models for Scholarly Ontology Generation: An Extensive Analysis in the Engineering Fieldcited by 10
- 2024Human Evaluation of Procedural Knowledge Graph Extraction from Text with Large Language Modelscited by 4
- 2025Bench4KE: Benchmarking Automated Competency Question Generationcited by 3
- 2025Schema Generation for Large Knowledge Graphs Using Large Language Modelscited by 3
- 2025A Comparative Study of Competency Question Elicitation Methods from Ontology Requirementscited by 3
- 2026The AnIML Ontology: Enabling Semantic Interoperability for Large-Scale Experimental Data in Interconnected Scientific Labscited by 3
- 2025Large Language Models Assisting Ontology Evaluationcited by 2
- 2026Open Ontologies: Tool-Augmented Ontology Engineering with Stable Matching Alignmentcited by 2
- 2026LLM-Enhanced Semantic Data Integration of Electronic Component Qualifications in the Aerospace Domaincited by 0
- 2026IDEA2: Expert-in-the-loop competency question elicitation for collaborative ontology engineeringcited by 0
- 2026Characterising LLM-Generated Competency Questions: a Cross-Domain Empirical Study using Open and Closed Modelscited by 0
- 2026DTScribe: Generating Models for Digital Twin Reporting using Local Large Language Models13 Oct 2026
- 2026Ontology-Mediated Neurosymbolic Constraint Acquisition from Multiple Stakeholders24 Sep 2026
- 2026BLINKG: A Benchmark for LLM-Integrated Knowledge Graph Generation19 May 2026
- 2026Open Ontologies: Tool-Augmented Ontology Engineering with Stable Matching Alignment9 May 2026
- 2026Characterising LLM-Generated Competency Questions: a Cross-Domain Empirical Study using Open and Closed Models17 Apr 2026
- 2026The AnIML Ontology: Enabling Semantic Interoperability for Large-Scale Experimental Data in Interconnected Scientific Labs2 Apr 2026
- 2026IDEA2: Expert-in-the-loop competency question elicitation for collaborative ontology engineering1 Apr 2026
- 2026LLM-Enhanced Semantic Data Integration of Electronic Component Qualifications in the Aerospace Domain20 Mar 2026
- 2025Large Language Models Assisting Ontology Evaluation19 Jul 2025
- 2025A Comparative Study of Competency Question Elicitation Methods from Ontology Requirements1 Jul 2025
- 2025Schema Generation for Large Knowledge Graphs Using Large Language Models4 Jun 2025
- 2025Bench4KE: Benchmarking Automated Competency Question Generation30 May 2025
3 more
- 2024Large Language Models for Scholarly Ontology Generation: An Extensive Analysis in the Engineering Field11 Dec 2024
- 2024LLMs4Life: Large Language Models for Ontology Learning in Life Sciences2 Dec 2024
- 2024Human Evaluation of Procedural Knowledge Graph Extraction from Text with Large Language Models27 Nov 2024
- 2024LLMs4Life: Large Language Models for Ontology Learning in Life Sciencescited by 12
- 2024Large Language Models for Scholarly Ontology Generation: An Extensive Analysis in the Engineering Fieldcited by 10
- 2024Human Evaluation of Procedural Knowledge Graph Extraction from Text with Large Language Modelscited by 4
- 2025Bench4KE: Benchmarking Automated Competency Question Generationcited by 3
- 2025Schema Generation for Large Knowledge Graphs Using Large Language Modelscited by 3
- 2025A Comparative Study of Competency Question Elicitation Methods from Ontology Requirementscited by 3
- 2026The AnIML Ontology: Enabling Semantic Interoperability for Large-Scale Experimental Data in Interconnected Scientific Labscited by 3
- 2025Large Language Models Assisting Ontology Evaluationcited by 2
- 2026Open Ontologies: Tool-Augmented Ontology Engineering with Stable Matching Alignmentcited by 2
- 2026LLM-Enhanced Semantic Data Integration of Electronic Component Qualifications in the Aerospace Domaincited by 0
- 2026IDEA2: Expert-in-the-loop competency question elicitation for collaborative ontology engineeringcited by 0
- 2026Characterising LLM-Generated Competency Questions: a Cross-Domain Empirical Study using Open and Closed Modelscited by 0
12 most cited of 15 All 15 (JSON)
- 2026DTScribe: Generating Models for Digital Twin Reporting using Local Large Language Models13 Oct 2026
- 2026Ontology-Mediated Neurosymbolic Constraint Acquisition from Multiple Stakeholders24 Sep 2026
- 2026BLINKG: A Benchmark for LLM-Integrated Knowledge Graph Generation19 May 2026
- 2026Open Ontologies: Tool-Augmented Ontology Engineering with Stable Matching Alignment9 May 2026
- 2026Characterising LLM-Generated Competency Questions: a Cross-Domain Empirical Study using Open and Closed Models17 Apr 2026
- 2026The AnIML Ontology: Enabling Semantic Interoperability for Large-Scale Experimental Data in Interconnected Scientific Labs2 Apr 2026
- 2026IDEA2: Expert-in-the-loop competency question elicitation for collaborative ontology engineering1 Apr 2026
- 2026LLM-Enhanced Semantic Data Integration of Electronic Component Qualifications in the Aerospace Domain20 Mar 2026
- 2025Large Language Models Assisting Ontology Evaluation19 Jul 2025
- 2025A Comparative Study of Competency Question Elicitation Methods from Ontology Requirements1 Jul 2025
- 2025Schema Generation for Large Knowledge Graphs Using Large Language Models4 Jun 2025
- 2025Bench4KE: Benchmarking Automated Competency Question Generation30 May 2025
12 newest of 15 All 15 (JSON)