Large language models are vulnerable to incidental information in clinical documentation and reasoning
On the map: LLM reasoning → Clinical and biomedical applications
Abstract (arXiv)
Large language models (LLMs) are increasingly relied upon to support ambient documentation and clinical reasoning. Here we examine the impact of a failure mode shared between these two applications by assessing their sensitivity to information incidental to the patient encounter. In 576 patient-clinician dialogues, we found that frontier models inserted small-talk exchanges into 35% of notes, while mean quality scores changed by at most 0.20 points on five-point scales. In 3.7% of frontier notes, models misattributed the asides or used them clinically. In 57 mock recorded consultations, background speech from a separate patient encounter at -10 dB leaked into 48.2% of transcripts, with contamination detected in 5.3% of downstream notes generated by four open-weight models. We propose a dual encoding hypothesis of clinical reasoning and distraction in LLMs, with preliminary evidence that LLM components associated with disruption by incidental information also support clinical reasoning. These findings support evaluating resistance to incidental information before clinical use, with safeguards that prevent contamination while preserving clinical reasoning.
Key facts. No citing papers in the map yet (data through 7 Oct 2026). Placed in Clinical and biomedical applications, one of 17 directions in LLM reasoning. First posted on arXiv 6 Oct 2026.
Builds on
No reference list yet.
Built on by
Not cited yet.
Similar, not cited
Close in wording, no citation either way
- 2025Medical large language models are easily distracted
- 2026A rubric landscape for evaluating clinical reasoning in large language models: what exists, what is missing, and what needs to be combined
- 2025Why Chain of Thought Fails in Clinical Text Understanding
- 2026Artificial Intolerance: Stigmatizing Language in Clinical Documentation Skews Large Language Model Decision-Making
- 2025Limitations of Large Language Models in Clinical Problem-Solving Arising from Inflexible Reasoning
- 2025Evaluating Large Language Models for Evidence-Based Clinical Question Answering
- 2026Safety and accuracy follow different scaling laws in clinical large language models
- 2025Susceptibility of Large Language Models to User-Driven Factors in Medical Queries