Kastor: Fine-tuned Small Language Models for Shape-based Active Relation Extraction
Not on the map. Why?
Abstract (arXiv)
RDF pattern-based extraction is a compelling approach for fine-tuning small language models (SLMs) by focusing a relation extraction task on a specified SHACL shape. This technique enables the development of efficient models trained on limited text and RDF data. In this article, we introduce Kastor, a framework that advances this approach to meet the demands for completing and refining knowledge bases in specialized domains. Kastor reformulates the traditional validation task, shifting from single SHACL shape validation to evaluating all possible combinations of properties derived from the shape. By selecting the optimal combination for each training example, the framework significantly enhances model generalization and performance. Additionally, Kastor employs an iterative learning process to refine noisy knowledge bases, enabling the creation of robust models capable of uncovering new, relevant facts
Key facts. No citing papers in the map yet (data through 7 Oct 2026). Builds on 26 of its 40 references that are in the map. First posted on arXiv 5 Nov 2025.
Builds on
26 of 40 references.
References · 26
- 2023Judging LLM-as-a-Judge with MT-Bench and Chatbot Arenacited by 8,393
- 2022Survey of Hallucination in Natural Language Generationcited by 2,056
- 2023A Survey on Hallucination in Large Language Models: Principles, Taxonomy, Challenges, and Open Questionscited by 1,582
- 2022Large Language Models Struggle to Learn Long-Tail Knowledgecited by 452
- 2019DocRED: A Large-Scale Document-Level Relation Extraction Datasetcited by 239
- 2023Grammar-Constrained Decoding for Structured NLP Tasks without Finetuningcited by 186
- 2021Structured Prediction as Translation between Augmented Natural Languagescited by 183
- 2023Evaluating ChatGPT's Information Extraction Capabilities: An Assessment of Performance, Explainability, Calibration, and Faithfulnesscited by 130
- 2024A Comprehensive Survey of Small Language Models in the Era of Large Language Models: Techniques, Enhancements, Applications, Collaboration with LLMs, and Trustworthinesscited by 125
- 2024Small Language Models: Survey, Measurements, and Insightscited by 109
- 2023Revisiting Relation Extraction in the era of Large Language Modelscited by 100
- 2020TACRED Revisited: A Thorough Evaluation of the TACRED Relation Extraction Taskcited by 96
14 more
- 2023CoAnnotating: Uncertainty-Guided Work Allocation between Human and Large Language Models for Data Annotationcited by 93
- 2023GLiNER: Generalist Model for Named Entity Recognition using Bidirectional Transformercited by 84
- 2021Re-TACRED: Addressing Shortcomings of the TACRED Datasetcited by 73
- 2021GenIE: Generative Information Extractioncited by 53
- 2023DREEAM: Guiding Attention with Evidence for Improving Document-Level Relation Extractioncited by 37
- 2021A Study of the Quality of Wikidatacited by 35
- 2024Annotator-Centric Active Learning for Subjective NLP Taskscited by 18
- 2022KnowGL: Knowledge Generation and Linking from Textcited by 13
- 2023Construction of Knowledge Graphs: State and Challengescited by 12
- 2024Retrieval-Augmented Generation-based Relation Extractioncited by 9
- 2024The Effects of Hallucinations in Synthetic Training Data for Relation Extractioncited by 7
- 2023REDrm FM: a Filtered and Multilingual Relation Extraction Datasetcited by 6
- 2024Recall, Retrieve and Reason: Towards Better In-Context Relation Extractioncited by 6
- 2024Need a Small Specialized Language Model? Plan Early!cited by 4
Built on by
Not cited yet.