mlsanityData to 14 Oct 2026

RELRaE: LLM-Based Relationship Extraction, Labelling, Refinement, and Evaluation

arXiv 2507.03829 ↗First posted 4 Jul 2025cs.AIcited by 1

Not on the map. Why?

Abstract (arXiv)

A large volume of XML data is produced in experiments carried out by robots in laboratories. In order to support the interoperability of data between labs, there is a motivation to translate the XML data into a knowledge graph. A key stage of this process is the enrichment of the XML schema to lay the foundation of an ontology schema. To achieve this, we present the RELRaE framework, a framework that employs large language models in different stages to extract and accurately label the relationships implicitly present in the XML schema. We investigate the capability of LLMs to accurately generate these labels and then evaluate them. Our work demonstrates that LLMs can be effectively used to support the generation of relationship labels in the context of lab automation, and that they can play a valuable role within semi-automatic ontology generation frameworks more generally.

Key facts. Cited by 1 paper in the map (data through 14 Oct 2026). Builds on 12 of its 43 references that are in the map. First posted on arXiv 4 Jul 2025.

Builds on

12 of 43 references.

References · 12

  1. 2020Language Models are Few-Shot Learnerscited by 32,419
  2. 2021Pre-train, Prompt, and Predict: A Systematic Survey of Prompting Methods in Natural Language Processingcited by 2,234
  3. 2022Survey of Hallucination in Natural Language Generationcited by 2,075
  4. 2023Jailbreaking ChatGPT via Prompt Engineering: An Empirical Studycited by 498
  5. 2024LLMs-as-Judges: A Comprehensive Survey on LLM-based Evaluation Methodscited by 465
  6. 2024Who Validates the Validators? Aligning LLM-Assisted Evaluation of LLM Outputs with Human Preferencescited by 144
  7. 2024Limitations of the LLM-as-a-Judge Approach for Evaluating LLM Outputs in Expert Knowledge Taskscited by 106
  8. 2023LLMs4OL: Large Language Models for Ontology Learningcited by 77
  9. 2025Injecting Domain-Specific Knowledge into Large Language Models: A Comprehensive Surveycited by 51
  10. 2023Principled Instructions Are All You Need for Questioning LLaMA-1/2, GPT-3.5/4cited by 48
  11. 2021Phrase-BERT: Improved Phrase Embeddings from BERT with an Application to Corpus Explorationcited by 44
  12. 2023OLaLa: Ontology Matching with Large Language Modelscited by 35

Built on by

Cited by year (2026 to 14 Oct)

Citing papers per year: 2026: 1.

1 paper.