Perspectives on Cross-Lingual Consistency in LLMs for Medical Questions
Not on the map. Why?
Abstract (arXiv)
Should multilingual LLMs answer medical questions consistently across input languages, or adapt responses to cultural cues? Existing multilingual medical benchmarks usually assume that medically correct answers should remain consistent across languages and treat cross-lingual variation as model error. In contrast, cultural adaptation research argues that appropriate medical answers may legitimately differ across contexts. We review the multilingual medical NLP literature through these two perspectives, we identify three gaps: limited stakeholder perspectives (e.g., of medical professionals), a lack of empirical evidence on which approach better serves users, and no benchmarks capable of distinguishing universally correct from culture-specific cases. To address the first gap, we survey 356 participants across three stakeholder groups (medical, NLP, and anthropology professionals) in three countries (Germany, Spain, and the United States). Anthropologists consistently favor adaptation, while medical and NLP respondents remain divided, with notable divergence between U.S. and European medical professionals. LLMs prompted with profession and country personas fail to reproduce this variation, overestimating cross-lingual consistency preference among NLP and medical personas. We conclude that neither consistency nor adaptation can currently be considered clearly preferable, highlighting the need for empirical evidence on which approach better serves users across cultural contexts.
Key facts. No citing papers in the map yet (data through 14 Oct 2026). Builds on 20 of its 43 references that are in the map. First posted on arXiv 7 Sep 2026.
Builds on
20 of 43 references.
References · 20
- 2017Attention Is All You Needcited by 60,361
- 2018XNLI: Evaluating Cross-lingual Sentence Representationscited by 915
- 2020XTREME: A Massively Multilingual Multi-task Benchmark for Evaluating Cross-lingual Generalizationcited by 742
- 2025HealthBench: Evaluating Large Language Models Towards Improved Human Healthcited by 429
- 2022Challenges and Strategies in Cross-Cultural NLPcited by 218
- 2024Towards Measuring and Modeling "Culture" in LLMs: A Surveycited by 167
- 2022Probing Pre-Trained Language Models for Cross-Cultural Differences in Valuescited by 149
- 2023CMB: A Comprehensive Medical Benchmark in Chinesecited by 115
- 2024Towards Building Multilingual Language Model for Medicinecited by 92
- 2023Better to Ask in English: Cross-Lingual Evaluation of Large Language Models for Healthcare Queriescited by 82
- 2024Apollo: A Lightweight Multilingual Medical LLM towards Democratizing Medical AI to 6B Peoplecited by 38
- 2024SUTRA: Scalable Multilingual Language Model Architecturecited by 11
8 more
- 2024WorldMedQA-V: a multilingual, multimodal medical examination dataset for multimodal language models evaluationcited by 11
- 2024Multi-OphthaLingua: A Multilingual Benchmark for Assessing and Debiasing LLM Ophthalmological QA in LMICscited by 10
- 2025Do LLMs Provide Consistent Answers to Health-Related Questions across Languages?cited by 9
- 2023Explanatory Argument Extraction of Correct Answers in Resident Medical Examscited by 6
- 2024Exploring the Comprehension of ChatGPT in Traditional Chinese Medicine Knowledgecited by 2
- 2025Discrepancy Detection at the Data Level: Toward Consistent Multilingual Question Answeringcited by 2
- 2025Beyond the Rubric: Cultural Misalignment in LLM Benchmarks for Sexual and Reproductive Healthcited by 2
- 2025Multilingual Medical Reasoning for Question Answering with Large Language Modelscited by 2
Built on by
Not cited yet.