Multi-Method Validation of Large Language Model Medical Translation Across High- and Low-Resource Languages
Not on the map. Why?
Abstract (arXiv)
Language barriers affect 27.3 million U.S. residents with non-English language preference, yet professional medical translation remains costly and often unavailable. We evaluated four frontier large language models (GPT-5.1, Claude Opus 4.5, Gemini 3 Pro, Kimi K2) translating 22 medical documents into 8 languages spanning high-resource (Spanish, Chinese, Russian, Vietnamese), medium-resource (Korean, Arabic), and low-resource (Tagalog, Haitian Creole) categories using a five-layer validation framework. Across 704 translation pairs, all models achieved high semantic preservation (LaBSE greater than 0.92), with no significant difference between high- and low-resource languages (p = 0.066). Cross-model back-translation confirmed results were not driven by same-model circularity (delta = -0.0009). Inter-model concordance across four independently trained models was high (LaBSE: 0.946), and lexical borrowing analysis showed no correlation between English term retention and fidelity scores in low-resource languages (rho = +0.018, p = 0.82). These converging results suggest frontier LLMs preserve medical meaning across resource levels, with implications for language access in healthcare.
Key facts. No citing papers in the map yet (data through 14 Oct 2026). Builds on 9 of its 31 references that are in the map. First posted on arXiv 23 Mar 2026.
Builds on
9 of 31 references.
References · 9
- 2018BERT: Pre-training of Deep Bidirectional Transformers for Language Understandingcited by 40,399
- 2020Language Models are Few-Shot Learnerscited by 32,419
- 2019BERTScore: Evaluating Text Generation with BERTcited by 5,512
- 2019Unsupervised Cross-lingual Representation Learning at Scalecited by 3,935
- 2019Cross-lingual Language Model Pretrainingcited by 1,090
- 2020COMET: A Neural Framework for MT Evaluationcited by 1,033
- 2020Language-agnostic BERT Sentence Embeddingcited by 627
- 2023ChatGPT Beyond English: Towards a Comprehensive Evaluation of Large Language Models in Multilingual Learningcited by 206
- 2025Are Language Models Borrowing-Blind? A Multilingual Evaluation of Loanword Identification across 10 Languagescited by 2
Built on by
Not cited yet.