Frontier LLM-based agents can overcome the ontology curation bottleneck for natural phenotypes
On the map: LLM agents and tool use → Web, search, and research agents
Abstract (arXiv)
Linking free-text phenotype descriptions to ontology terms, typically referred to as phenotype annotation, is essential for the cross-study integration of comparative morphological data. This labor intensive process has heavily relied on highly trained human experts, which makes it challenging to scale and thus a key bottleneck. Dahdul et al. (2018) established a Gold Standard (GS) of Entity-Quality (EQ) annotations across seven phylogenetic studies and used it to evaluate three human curators and the Semantic CharaParser NLP tool with ontology-based semantic similarity metrics; they reported that machine-human consistency was significantly lower than inter-curator (human-human) consistency. Here we revisit that benchmark with five frontier hosted LLMs from Anthropic and OpenAI, each operating as an "agentic curator" within a self-contained workspace that supplies the source publication PDF, the same annotation guide used by the original human curators, the four project ontologies (UBERON, PATO, BSPO, GO), and a validation script. Evaluated against the same Gold Standard, every agent fell within the range of inter-curator variability of the three trained human biocurators of the original study; the best performing agents approached but did not reach the best performing human curator. Agents substantially outperformed Semantic CharaParser on all four metrics.
Key facts. No citing papers in the map yet (data through 7 Oct 2026). Placed in Web, search, and research agents, one of 16 directions in LLM agents and tool use. Builds on 1 of its 28 references that are in the map. First posted on arXiv 27 May 2026.
Builds on
1 of 28 references.
References · 1
- 2026Qwen3-Coder-Next Technical Reportcited by 60
Built on by
Not cited yet.
Similar, not cited
Close in wording, no citation either way
- 2026FlyAOC: Evaluating Agentic Ontology Curation of Drosophila Scientific Knowledge Bases
- 2025Enhancing Domain-Specific Encoder Models with LLM-Generated Data: How to Leverage Ontologies, and How to Do Without Them
- 2026Automated Standardization of Legacy Biomedical Metadata Using an Ontology-Constrained LLM Agent
- 2026When Does Bigger Help? A Controlled Study of LLM Scale for Ontology Learning
- 2025Transforming Expert Knowledge into Scalable Ontology via Large Language Models
- 2026OntologyAligner: Ontology-Aligned Retrieval and Hierarchy-Guided Large Language Model Reranking for Biomedical Ontology Normalization
- 2026Do General NLP Embeddings Capture Ontological Reasoning?
- 2026PhenoLIP: Integrating Phenotype Ontology Knowledge into Medical Vision-Language Pretraining