Verifiable Knowledge Expansion through Retrieval-Grounded Formal Concept Analysis
Not on the map. Why?
Abstract (arXiv)
Ontology construction requires deciding which objects, attributes, and structural relations should be accepted as valid knowledge. Language models can propose such structures from text, but their outputs can still be unsupported or inconsistent. This paper proposes a retrieval-augmented small language model (SLM) framework that uses formal concept analysis (FCA) as a symbolic verification loop for knowledge expansion. Starting from seed attributes, FCA proposes implications over a growing formal context. A retrieval-grounded SLM oracle then validates each implication or returns a counterexample. The oracle also supports incidence judgments, consistency checks, and attribute proposals, making accepted implications, counterexamples, contradictions, and corrections inspectable. In a rare ataxia setting constructed from Orphadata resources, retrieval-grounded 10-seed runs obtain relation F1 of 0.29-0.52 and closure-based implication F1 of 0.22-0.30. Larger seed sets increase the number of evaluated implications and often improve implication F1. The lower implication scores reflect a stricter evaluation of derived implications, where one missed or extra relation can affect several implication judgments. Ablations show that incidence judgments in a fixed object-attribute setting can improve closure-based implication scores. However, identifying positive object-attribute pairs remains difficult even when the candidate objects and attributes are fixed.
Key facts. No citing papers in the map yet (data through 7 Oct 2026). Builds on 5 of its 16 references that are in the map. First posted on arXiv 2 Jul 2026.
Builds on
5 of 16 references.
References · 5
- 2023Lost in the Middle: How Language Models Use Long Contextscited by 3,383
- 2021Retrieval Augmentation Reduces Hallucination in Conversationcited by 691
- 2023Unifying Large Language Models and Knowledge Graphs: A Roadmapcited by 663
- 2024Comparing Specialised Small and General Large Language Models on Text Classification: 100 Labelled Samples to Achieve Break-Even Performancecited by 17
- 2025Small Language Models in the Real World: Insights from Industrial Text Classificationcited by 2
Built on by
Not cited yet.
Similar, not cited
Close in wording, no citation either way
- 2025Investigating Language Model Capabilities to Represent and Process Formal Knowledge: A Preliminary Study to Assist Ontology Engineering
- 2025KROMA: Ontology Matching with Knowledge Retrieval and Large Language Models
- 2024OG-RAG: Ontology-Grounded Retrieval-Augmented Generation For Large Language Models
- 2025Retrieval-Augmented Generation of Ontologies from Relational Databases
- 2026EGT-KG: Evidence-Grounded Typed KG Retrieval for Practical Scientific QA with Small Language Models
- 2026Large Language Model for OWL Proofs
- 2024Reasoning about concepts with LLMs: Inconsistencies abound
- 2024A RAG Approach for Generating Competency Questions in Ontology Engineering