mlsanityData to 13 Oct 2026

Counterfactual Cultural Cues Reduce Medical QA Accuracy in LLMs: Identifier vs Context Effects

arXiv 2601.20102 ↗First posted 27 Jan 2026cs.CLcited by 1

Not on the map. Why?

Abstract (arXiv)

Engineering sustainable and equitable healthcare requires medical language models that do not change clinically correct diagnoses when presented with non-decisive cultural information. We introduce a counterfactual benchmark that expands 150 MedQA test items into 1650 variants by inserting culture-related (i) identifier tokens, (ii) contextual cues, or (iii) their combination for three groups (Indigenous Canadian, Middle-Eastern Muslim, Southeast Asian), plus a length-matched neutral control, where a clinician verified that the gold answer remains invariant in all variants. We evaluate GPT-5.2, Llama-3.1-8B, DeepSeek-R1, and MedGemma (4B/27B) under option-only and brief-explanation prompting. Across models, cultural cues significantly affect accuracy (Cochran's Q, p<10^-14), with the largest degradation when identifier and context co-occur (up to 3-7 percentage points under option-only prompting), while neutral edits produce smaller, non-systematic changes. A human-validated rubric (kappa=0.76) applied via an LLM-as-judge shows that more than half of culturally grounded explanations end in an incorrect answer, linking culture-referential reasoning to diagnostic failure. We release prompts and augmentations to support evaluation and mitigation of culturally induced diagnostic errors.

Key facts. Cited by 1 paper in the map (data through 13 Oct 2026). Builds on 7 of its 21 references that are in the map. First posted on arXiv 27 Jan 2026.

Builds on

7 of 21 references.

References · 7

  1. 2024The Llama 3 Herd of Modelscited by 14,486
  2. 2020What Disease does this Patient Have? A Large-scale Open Domain Question Answering Dataset from Medical Examscited by 1,338
  3. 2023Capabilities of GPT-4 on Medical Challenge Problemscited by 635
  4. 2024A Toolbox for Surfacing Health Equity Harms and Biases in Large Language Modelscited by 45
  5. 2025Leveraging Open-Source Large Language Models for Clinical Information Extraction in Resource-Constrained Settingscited by 7
  6. 2025Prompt Engineering Techniques for Mitigating Cultural Bias Against Arabs and Muslims in Large Language Models: A Systematic Reviewcited by 3
  7. 2025Purdah and Patriarchy: Evaluating and Mitigating South Asian Biases in Open-Ended Multilingual LLM Generationscited by 2

Built on by

Cited by year (2026 to 13 Oct)

Citing papers per year: 2026: 1.

1 paper.

Similar, not cited

Close in wording, no citation either way

  1. 2025MEDEQUALQA: Evaluating Biases in LLMs with Counterfactual Reasoning
  2. 2026Prompting language influences diagnostic reasoning and accuracy of large language models
  3. 2026CLEAR: Revealing How Noise and Ambiguity Degrade Reliability in LLMs for Medicine
  4. 2026Investigating Linear Probe Robustness to Linguistic Register, Medical Specialty, and Corpus Shifts in Medical QA
  5. 2025Medical large language models are easily distracted
  6. 2026When Large Language Models Fail in Healthcare: Evaluating Sensitivity to Prompt Variations
  7. 2025Evaluating Prompt Engineering Techniques for Accuracy and Confidence Elicitation in Medical LLMs
  8. 2026Measuring Epistemic Resilience of LLMs Under Misleading Medical Context