Annif at SemEval-2025 Task 5: Traditional XMTC augmented by LLMs
Not on the map. Why?
Abstract (arXiv)
This paper presents the Annif system in SemEval-2025 Task 5 (LLMs4Subjects), which focussed on subject indexing using large language models (LLMs). The task required creating subject predictions for bibliographic records from the bilingual TIBKAT database using the GND subject vocabulary. Our approach combines traditional natural language processing and machine learning techniques implemented in the Annif toolkit with innovative LLM-based methods for translation and synthetic data generation, and merging predictions from monolingual models. The system ranked first in the all-subjects category and second in the tib-core-subjects category in the quantitative evaluation, and fourth in qualitative evaluations. These findings demonstrate the potential of combining traditional XMTC algorithms with modern LLM techniques to improve the accuracy and efficiency of subject indexing in multilingual contexts.
Key facts. Cited by 4 papers in the map (data through 14 Oct 2026). Builds on 4 of its 10 references that are in the map. First posted on arXiv 28 Apr 2025.
Builds on
4 of 10 references.
References · 4
- 2024The Llama 3 Herd of Modelscited by 14,715
- 2019Bonsai -- Diverse and Shallow Trees for Extreme Multi-label Classificationcited by 61
- 2020PECOS: Prediction for Enormous and Correlated Output Spacescited by 50
- 2025SemEval-2025 Task 5: LLMs4Subjects -- LLM-based Automated Subject Tagging for a National Technical Library's Open-Access Catalogcited by 10
Built on by
Citing papers per year: 2025: 2; 2026: 2.
4 papers.
- 2025Annif at the GermEval-2025 LLMs4Subjects Task: Traditional XMTC Augmented by Efficient LLMscited by 2
- 2026A Skill-Based AI Agentic Pipeline for Library of Congress Subject Indexingcited by 1
- 2025NFDI4DS Shared Tasks for Scholarly Document Processingcited by 0
- 2026Does generative AI supersede supervised XMLC? A Benchmark Study on Automated Subject Indexing with German Scientific Literaturecited by 0
- 2026Does generative AI supersede supervised XMLC? A Benchmark Study on Automated Subject Indexing with German Scientific Literature16 Jul 2026
- 2026A Skill-Based AI Agentic Pipeline for Library of Congress Subject Indexing5 May 2026
- 2025NFDI4DS Shared Tasks for Scholarly Document Processing26 Sep 2025
- 2025Annif at the GermEval-2025 LLMs4Subjects Task: Traditional XMTC Augmented by Efficient LLMs21 Aug 2025