An Experiment in Retrofitting Competency Questions for Existing Ontologies
Not on the map. Why?
Abstract (arXiv)
Competency Questions (CQs) are a form of ontology functional requirements expressed as natural language questions. Inspecting CQs together with the axioms in an ontology provides critical insights into the intended scope and applicability of the ontology. CQs also underpin a number of tasks in the development of ontologies e.g. ontology reuse, ontology testing, requirement specification, and the definition of patterns that implement such requirements. Although CQs are integral to the majority of ontology engineering methodologies, the practice of publishing CQs alongside the ontological artefacts is not widely observed by the community. In this context, we present an experiment in retrofitting CQs from existing ontologies. We propose RETROFIT-CQs, a method to extract candidate CQs directly from ontologies using Generative AI. In the paper we present the pipeline that facilitates the extraction of CQs by leveraging Large Language Models (LLMs) and we discuss its application to a number of existing ontologies.
Key facts. Cited by 12 papers in the map (data through 14 Oct 2026). Builds on 4 of its 29 references that are in the map. First posted on arXiv 9 Nov 2023.
Builds on
4 of 29 references.
References · 4
- 2022Training language models to follow instructions with human feedbackcited by 15,971
- 2019Sentence-BERT: Sentence Embeddings using Siamese BERT-Networkscited by 9,170
- 2021Pre-train, Prompt, and Predict: A Systematic Survey of Prompting Methods in Natural Language Processingcited by 2,234
- 2022Automatically Drafting Ontologies from Competency Questions with FrODOcited by 2
Built on by
Citing papers per year: 2024: 5; 2025: 4; 2026: 3.
12 papers.
- 2024OntoChat: a Framework for Conversational Ontology Engineering using Language Modelscited by 15
- 2024Generative AI for Requirements Engineering: A Systematic Literature Reviewcited by 11
- 2024A RAG Approach for Generating Competency Questions in Ontology Engineeringcited by 7
- 2024Discerning and Characterising Types of Competency Questions for Ontologiescited by 4
- 2025Retrieval-Augmented Generation of Ontologies from Relational Databasescited by 4
- 2025Bench4KE: Benchmarking Automated Competency Question Generationcited by 3
- 2025A Comparative Study of Competency Question Elicitation Methods from Ontology Requirementscited by 3
- 2025Large Language Models Assisting Ontology Evaluationcited by 2
- 2024Enhancing Rhetorical Figure Annotation: An Ontology-Based Web Application with RAG Integrationcited by 0
- 2026IDEA2: Expert-in-the-loop competency question elicitation for collaborative ontology engineeringcited by 0
- 2026Characterising LLM-Generated Competency Questions: a Cross-Domain Empirical Study using Open and Closed Modelscited by 0
- 2026OntoKG-EQ: A provenance-grounded, competency-question-governed knowledge graph for auditable analyst queryingcited by 0
- 2026OntoKG-EQ: A provenance-grounded, competency-question-governed knowledge graph for auditable analyst querying8 Sep 2026
- 2026Characterising LLM-Generated Competency Questions: a Cross-Domain Empirical Study using Open and Closed Models17 Apr 2026
- 2026IDEA2: Expert-in-the-loop competency question elicitation for collaborative ontology engineering1 Apr 2026
- 2025Large Language Models Assisting Ontology Evaluation19 Jul 2025
- 2025A Comparative Study of Competency Question Elicitation Methods from Ontology Requirements1 Jul 2025
- 2025Retrieval-Augmented Generation of Ontologies from Relational Databases2 Jun 2025
- 2025Bench4KE: Benchmarking Automated Competency Question Generation30 May 2025
- 2024Enhancing Rhetorical Figure Annotation: An Ontology-Based Web Application with RAG Integration18 Dec 2024
- 2024Discerning and Characterising Types of Competency Questions for Ontologies18 Dec 2024
- 2024A RAG Approach for Generating Competency Questions in Ontology Engineering13 Sep 2024
- 2024Generative AI for Requirements Engineering: A Systematic Literature Review10 Sep 2024
- 2024OntoChat: a Framework for Conversational Ontology Engineering using Language Models9 Mar 2024