mlsanityData to 7 Oct 2026

Automated Standardization of Legacy Biomedical Metadata Using an Ontology-Constrained LLM Agent

arXiv 2604.08552 ↗First posted 10 Mar 2026cs.DB cs.AIcited by 0

Not on the map. Why?

Abstract (arXiv)

Descriptive scientific metadata in public repositories are often incomplete and inconsistent with community standards and ontologies, limiting data FAIRness. Large language models (LLMs) offer a promising approach to automatically standardizing such metadata when provided with relevant standards in machine-actionable form, such as metadata templates from the CEDAR Workbench. Prompt engineering, however, provides only fixed snapshots of these standards and relies on an LLM's pretrained knowledge to interpret and satisfy their constraints. We evaluate whether giving an LLM access to metadata specifications and authoritative terminology at runtime improves automated metadata standardization. Methods: We present ARMS, a tool-augmented LLM agent that retrieves complete CEDAR metadata templates and dynamically queries authoritative biomedical terminology services at execution time. We compared ARMS with a prompt-based approach on 839 legacy metadata records from the Human BioMolecular Atlas Program (HuBMAP), using expert-standardized records as the reference standard. Results: ARMS outperformed the prompt-based approach, increasing precision from 0.56 to 0.93 and recall from 0.51 to 0.85, with improvements across all field categories and assay types. The largest gains occurred for ontology-constrained fields, where precision increased from 0.36 to 0.92. Conclusion: LLMs cannot convert legacy metadata to standards-adherent form without knowledge of the relevant standards. ARMS improves metadata standardization by providing runtime access to authoritative resources that define valid metadata. Machine-actionable metadata standards enhance LLM-based rectification of legacy metadata, especially when they can be queried dynamically.

Key facts. No citing papers in the map yet (data through 7 Oct 2026). Builds on 13 of its 27 references that are in the map. First posted on arXiv 10 Mar 2026.

Builds on

13 of 27 references.

References · 13

  1. 2020Retrieval-Augmented Generation for Knowledge-Intensive NLP Taskscited by 9,160
  2. 2022ReAct: Synergizing Reasoning and Acting in Language Modelscited by 8,355
  3. 2023Toolformer: Language Models Can Teach Themselves to Use Toolscited by 4,072
  4. 2023Gorilla: Large Language Model Connected with Massive APIscited by 1,302
  5. 2023Structured prompt interrogation and recursive extraction of semantics (SPIRES): A method for populating knowledge bases using zero-shot learningcited by 50
  6. 2024Generalizable and Scalable Multistage Biomedical Concept Normalization Leveraging Large Language Modelscited by 7
  7. 2022Modeling community standards for metadata as templates makes data FAIRcited by 5
  8. 2018The variable quality of metadata about biological samples used in biomedical experimentscited by 3
  9. 2019The CEDAR Workbench: An Ontology-Assisted Environment for Authoring Metadata that Describe Scientific Experimentscited by 3
  10. 2025Predicting Failures of LLMs to Link Biomedical Ontology Terms to Identifiers Evidence Across Models and Ontologiescited by 3
  11. 2024Ensuring Adherence to Standards in Experiment-Related Metadata Entered Via Spreadsheetscited by 1
  12. 2025Toward Total Recall: Enhancing FAIRness through AI-Driven Metadata Standardizationcited by 1
1 more
  1. 2025Knowledge engineering for open science: Building and deploying knowledge bases for metadata standardscited by 1

Built on by

Not cited yet.

Similar, not cited

Close in wording, no citation either way

  1. 2026Benchmarking Resource-Efficient LLMs for Research Topic Ontology Generation in the Biomedical Field
  2. 2025CRAB: A Benchmark for Evaluating Curation of Retrieval-Augmented LLMs in Biomedicine
  3. 2026Frontier LLM-based agents can overcome the ontology curation bottleneck for natural phenotypes
  4. 2026OntologyAligner: Ontology-Aligned Retrieval and Hierarchy-Guided Large Language Model Reranking for Biomedical Ontology Normalization
  5. 2024Combining Domain-Specific Models and LLMs for Automated Disease Phenotyping from Survey Data
  6. 2024A Review on Scientific Knowledge Extraction using Large Language Models in Biomedical Sciences
  7. 2024LLMs are not Zero-Shot Reasoners for Biomedical Information Extraction
  8. 2025Knowledge-Driven Agentic Scientific Corpus Distillation Framework for Biomedical Large Language Models Training