On the Use of LLMs for Specialised Terminology: A Good Alternative to Corpora?
Not on the map. Why?
Abstract (arXiv)
Specialised translation relies on the use of documentary and terminological resources, including corpora. These resources are particularly useful for terminology. However, their compilation and exploitation have several limitations: they require time, technical skills and access to data that can be difficult to collect. This study examines the extent to which LLMs can assist specialised translators in finding equivalents from English to French. We evaluate four proprietary models, GPT-4o, GPT-5.2, Claude Sonnet 4.5 and DeepSeek, in two specialised domains, Earth, Environmental and Planetary Sciences (EEPS) and Natural Language Processing (NLP). The experiment is based on 80 terms per domain and compares two prompting strategies: a terminology and a translation mode. The results highlight clear differences between models, prompting strategies and, to a lesser extent, domains. Claude Sonnet 4.5 achieves the best results in the most favourable configuration, while DeepSeek stands out for its greater stability. Analysis of confidence estimates also shows that they are only a partial indicator of terminological accuracy. Overall, the findings suggest that LLMs can be useful tools for specialised translators, but cannot, at this stage, replace specialised corpora. This research therefore paves the way for future work on the real practical usefulness of LLMs for specialised translators in work and educational contexts.
Key facts. No citing papers in the map yet (data through 7 Oct 2026). Builds on 8 of its 30 references that are in the map. First posted on arXiv 22 Jun 2026.
Builds on
8 of 30 references.
References · 8
- 2023Large Language Models Are State-of-the-Art Evaluators of Translation Qualitycited by 416
- 2023How Good Are GPT Models at Machine Translation? A Comprehensive Evaluationcited by 344
- 2022Prompting PaLM for Translation: Assessing Strategies and Performancecited by 144
- 2023GEMBA-MQM: Detecting Translation Quality Error Spans with GPT-4cited by 143
- 2023The Devil is in the Errors: Leveraging Large Language Models for Fine-grained Machine Translation Evaluationcited by 95
- 2023INSTRUCTSCORE: Explainable Text Generation Evaluation with Finegrained Feedbackcited by 21
- 2024MT-Ranker: Reference-free machine translation evaluation by inter-system rankingcited by 14
- 2025Testing LLMs' Capabilities in Annotating Translations Based on an Error Typology Designed for LSP Translation: First Experiments with ChatGPTcited by 2
Built on by
Not cited yet.