mlsanityData to 7 Oct 2026

Effects of Cross-lingual Evidence in Multilingual Medical Question Answering

arXiv 2604.20531 ↗First posted 22 Apr 2026cs.CLcited by 0

Not on the map. Why?

Abstract (arXiv)

This paper investigates Multilingual Medical Question Answering across high-resource (English, Spanish, French, Italian) and low-resource (Basque, Kazakh) languages. We evaluate three types of external evidence sources across models of varying size: curated repositories of specialized medical knowledge, web-retrieved content, and explanations from LLM's parametric knowledge. Moreover, we conduct experiments with multilingual, monolingual and cross-lingual retrieval. Our results demonstrate that larger models consistently achieve superior performance in English across baseline evaluations. When incorporating external knowledge, web-retrieved data in English proves most beneficial for high-resource languages. Conversely, for low-resource languages, the most effective strategy combines retrieval in both English and the target language, achieving comparable accuracy to high-resource language results. These findings challenge the assumption that external knowledge systematically improves performance and reveal that effective strategies depend on both the source of language resources and on model scale. Furthermore, specialized medical knowledge sources such as PubMed are limited: while they provide authoritative expert knowledge, they lack adequate multilingual coverage

Key facts. No citing papers in the map yet (data through 7 Oct 2026). Builds on 23 of its 46 references that are in the map. First posted on arXiv 22 Apr 2026.

Builds on

23 of 46 references.

References · 23

  1. 2020Language Models are Few-Shot Learnerscited by 32,199
  2. 2020Retrieval-Augmented Generation for Knowledge-Intensive NLP Taskscited by 9,160
  3. 2020What Disease does this Patient Have? A Large-scale Open Domain Question Answering Dataset from Medical Examscited by 1,324
  4. 2019PubMedQA: A Dataset for Biomedical Research Question Answeringcited by 1,271
  5. 2020COMET: A Neural Framework for MT Evaluationcited by 1,024
  6. 2024LLM Evaluators Recognize and Favor Their Own Generationscited by 651
  7. 2024Benchmarking Retrieval-Augmented Generation for Medicinecited by 326
  8. 2024HuatuoGPT-o1, Towards Medical Complex Reasoning with LLMscited by 257
  9. 2023MedCPT: Contrastive Pre-trained Transformers with Large-scale PubMed Search Logs for Zero-shot Biomedical Information Retrievalcited by 182
  10. 2023Investigating the Factual Knowledge Boundary of Large Language Models with Retrieval Augmentationcited by 146
  11. 2022Lifting the Curse of Multilinguality by Pre-training Modular Transformerscited by 145
  12. 2023Physics of Language Models: Part 3.2, Knowledge Manipulationcited by 142
11 more
  1. 2025Medical Hallucinations in Foundation Models and Their Impact on Healthcarecited by 89
  2. 2024How Large Language Models Encode Context Knowledge? A Layer-Wise Probing Studycited by 64
  3. 2024Improving Retrieval-Augmented Generation in Medicine with Iterative Follow-up Questionscited by 54
  4. 2024MedExpQA: Multilingual Benchmarking of Large Language Models for Medical Question Answeringcited by 43
  5. 2024Rationale-Guided Retrieval Augmented Generation for Medical Question Answeringcited by 41
  6. 2019On The Evaluation of Machine Translation Systems Trained With Back-Translationcited by 40
  7. 2023Creating Trustworthy LLMs: Dealing with Hallucinations in Healthcare AIcited by 33
  8. 2023When Is Multilinguality a Curse? Language Modeling for 250 High- and Low-Resource Languagescited by 32
  9. 2023MKRAG: Medical Knowledge Retrieval Augmented Generation for Medical Question Answeringcited by 23
  10. 2023HiTZ@Antidote: Argumentation-driven Explainable Artificial Intelligence for Digital Medicinecited by 5
  11. 2024Overview of TREC 2024 Medical Video Question Answering (MedVidQA) Trackcited by 2

Built on by

Not cited yet.