Mapping Clinical Doubt: Locating Linguistic Uncertainty in LLMs
Not on the map. Why?
Abstract (arXiv)
Large Language Models (LLMs) are increasingly used in clinical settings, where sensitivity to linguistic uncertainty can influence diagnostic interpretation and decision-making. Yet little is known about where such epistemic cues are internally represented within these models. Distinct from uncertainty quantification, which measures output confidence, this work examines input-side representational sensitivity to linguistic uncertainty in medical text. We curate a contrastive dataset of clinical statements varying in epistemic modality (e.g., 'is consistent with' vs. 'may be consistent with') and propose Model Sensitivity to Uncertainty (MSU), a layerwise probing metric that quantifies activation-level shifts induced by uncertainty cues. Our results show that LLMs exhibit structured, depth-dependent sensitivity to clinical uncertainty, suggesting that epistemic information is progressively encoded in deeper layers. These findings reveal how linguistic uncertainty is internally represented in LLMs, offering insight into their interpretability and epistemic reliability.
Key facts. No citing papers in the map yet (data through 14 Oct 2026). Builds on 6 of its 10 references that are in the map. First posted on arXiv 27 Nov 2025.
Builds on
6 of 10 references.
References · 6
- 2024The Llama 3 Herd of Modelscited by 14,715
- 2022Teaching Models to Express Their Uncertainty in Wordscited by 751
- 2023Towards Automated Circuit Discovery for Mechanistic Interpretabilitycited by 724
- 2020Calibration of Pre-trained Transformerscited by 315
- 2023Localizing Model Behavior with Path Patchingcited by 195
- 2024Are LLM-Judges Robust to Expressions of Uncertainty? Investigating the effect of Epistemic Markers on LLM-based Evaluationcited by 29
Built on by
Not cited yet.