Artificial Intolerance: Stigmatizing Language in Clinical Documentation Skews Large Language Model Decision-Making
Not on the map. Why?
Abstract (arXiv)
Large Language Models (LLMs) are increasingly deployed in high-stakes domains such as clinical decision support and medical documentation. However, the robustness of these models against subtle linguistic variations, specifically stigmatizing language (SL) commonly found in human-authored clinical notes, remains critically under-explored. In this work, we investigate whether frontier LLMs inherit and propagate this human bias when processing clinical text. We systematically evaluate nine frontier LLMs across four stigmatized medical conditions, utilizing clinical vignettes injected with varying intensities and phenotypes of SL (doubt, blame, and maligning). Our results demonstrate that all evaluated models exhibit substantial bias, with clinical decision-making significantly skewed towards less aggressive patient management. Notably, we observe a high sensitivity to linguistic framing, where a single SL sentence is sufficient to alter model outputs, revealing a clear dose-response relationship. Furthermore, we evaluate standard prompt-based mitigation strategies, including Chain-of-Thought (CoT) reasoning and model self-debiasing. These approaches show limited efficacy; models struggle to explicitly identify SL while remaining implicitly influenced by it. Our findings expose a critical vulnerability in current LLMs regarding fairness and robustness in clinical NLP, underscoring the need for rigorous algorithmic guardrails to prevent the automation of health disparities.
Key facts. No citing papers in the map yet (data through 14 Oct 2026). Builds on 9 of its 50 references that are in the map. First posted on arXiv 17 May 2026.
Builds on
9 of 50 references.
References · 9
- 2022Chain-of-Thought Prompting Elicits Reasoning in Large Language Modelscited by 12,459
- 2022Large Language Models are Zero-Shot Reasonerscited by 4,374
- 2026GLM-5: from Vibe Coding to Agentic Engineeringcited by 587
- 2026Kimi K2.5: Visual Agentic Intelligencecited by 501
- 2024Measuring Implicit Bias in Explicitly Unbiased Large Language Modelscited by 51
- 2024A Toolbox for Surfacing Health Equity Harms and Biases in Large Language Modelscited by 45
- 2025Explicit vs. Implicit: Investigating Social Bias in Large Language Models through Self-Reflectioncited by 27
- 2025VisBias: Measuring Explicit and Implicit Social Biases in Vision Language Modelscited by 14
- 2024How Can We Diagnose and Treat Bias in Large Language Models for Clinical Decision-Making?cited by 4
Built on by
Not cited yet.
Similar, not cited
Close in wording, no citation either way
- 2024Bias patterns in the application of LLMs for clinical decision support: A comprehensive study
- 2026Large language models are vulnerable to incidental information in clinical documentation and reasoning
- 2026Analyzing LLM Reasoning to Uncover Mental Health Stigma
- 2025MEDEQUALQA: Evaluating Biases in LLMs with Counterfactual Reasoning
- 2026Evaluating the Presence of Sex Bias in Clinical Reasoning by Large Language Models
- 2025Why Chain of Thought Fails in Clinical Text Understanding
- 2026First, Do No Harm (With LLMs): Mitigating Racial Bias via Agentic Workflows
- 2026The Value Sensitivity Gap: How Clinical Large Language Models Respond to Patient Preference Statements in Shared Decision-Making