mlsanityData to 14 Oct 2026

The strength of clinical evidence is recoverable from language model representations but not from their stated grades

arXiv 2606.29034 ↗First posted 27 Jun 2026cs.CL cs.AI cs.IRcited by 1

Not on the map. Why?

Abstract (arXiv)

Large language models (LLMs) increasingly summarize clinical evidence, where a claim's weight depends on how strongly it is supported. Yet these models convey confidence poorly, and properties they never state, such as truth, are often readable from their activations. Whether a clinical model registers evidence strength, distinct from truth, and states it when asked is untested, and any such signal could be lexical. We compiled 45,134 clinical claims from six public sources, harmonized 20,611 into a four-level evidence grade under three independent frameworks, and tested 22 local, open-weight LLMs from several developers (0.6-70 billion parameters; general, medical, and reasoning), with lexical, truth, and cross-framework controls. A linear estimator recovered the grade in every model (median AUROC 71.8), yet decodability did not rise with scale and was weakest in reasoning models. The grade the models stated fell to chance, 25-27 percentage points below the estimator. The recoverable signal was largely lexical and did not transfer across topics or frameworks, yet it was distinct from factual truth and still flagged weakly supported claims (AUROC 69.2). Clinical LLMs thus carry an ordered evidence-strength signal they do not express, so their stated grades fail to convey a claim's support even when it is recoverable from their representations and text.

Key facts. Cited by 1 paper in the map (data through 14 Oct 2026). Builds on 35 of its 57 references that are in the map. First posted on arXiv 27 Jun 2026.

Builds on

35 of 57 references.

References · 35

  1. 2024The Llama 3 Herd of Modelscited by 14,715
  2. 2025DeepSeek-R1: Incentivizing Reasoning Capability in LLMs via Reinforcement Learningcited by 6,330
  3. 2024Gemma 2: Improving Open Language Models at a Practical Sizecited by 1,998
  4. 2020Shortcut Learning in Deep Neural Networkscited by 1,969
  5. 2024Phi-3 Technical Report: A Highly Capable Language Model Locally on Your Phonecited by 1,917
  6. 2022Language Models (Mostly) Know What They Knowcited by 1,856
  7. 2022Large Language Models Encode Clinical Knowledgecited by 1,830
  8. 2023Representation Engineering: A Top-Down Approach to AI Transparencycited by 1,336
  9. 2023Inference-Time Intervention: Eliciting Truthful Answers from a Language Modelcited by 1,302
  10. 2023Can LLMs Express Their Uncertainty? An Empirical Evaluation of Confidence Elicitation in LLMscited by 974
  11. 2023Steering Language Models With Activation Engineeringcited by 922
  12. 2021Probing Classifiers: Promises, Shortcomings, and Advancescited by 876
23 more
  1. 2023Quantifying Language Models' Sensitivity to Spurious Features in Prompt Design or: How I learned to start worrying about prompt formattingcited by 817
  2. 2023Just Ask for Calibration: Strategies for Eliciting Calibrated Confidence Scores from Language Models Fine-Tuned with Human Feedbackcited by 812
  3. 2022Discovering Latent Knowledge in Language Models Without Supervisioncited by 767
  4. 2022Teaching Models to Express Their Uncertainty in Wordscited by 751
  5. 2023The Geometry of Truth: Emergent Linear Structure in Large Language Model Representations of True/False Datasetscited by 712
  6. 2018Annotation Artifacts in Natural Language Inference Datacited by 671
  7. 2023The Internal State of an LLM Knows When It's Lyingcited by 659
  8. 2019Designing and Interpreting Probes with Control Taskscited by 640
  9. 2024INSIDE: LLMs' Internal States Retain the Power of Hallucination Detectioncited by 323
  10. 2024BioMistral: A Collection of Open-Source Pretrained Large Language Models for Medical Domainscited by 301
  11. 2023MEDITRON-70B: Scaling Medical Pretraining for Large Language Modelscited by 274
  12. 2023Adapted Large Language Models Can Outperform Medical Experts in Clinical Text Summarizationcited by 246
  13. 2024LLMs Know More Than They Show: On the Intrinsic Representation of LLM Hallucinationscited by 244
  14. 2024Analyzing the Generalization and Reliability of Steering Vectorscited by 143
  15. 2024What Large Language Models Know and What People Think They Knowcited by 110
  16. 2024Med42-v2: A Suite of Clinical LLMscited by 90
  17. 2018A Corpus with Multi-Level Annotations of Patients, Interventions and Outcomes to Support Language Processing for Medical Literaturecited by 79
  18. 2019Inferring Which Medical Treatments Work from Reports of Clinical Trialscited by 64
  19. 2024RadioRAG: Online Retrieval-augmented Generation for Radiology Question Answeringcited by 10
  20. 2025Do LLMs Really Know What They Don't Know? Internal States Mainly Reflect Knowledge Recall Rather Than Truthfulnesscited by 10
  21. 2025Multi-step retrieval and reasoning improves radiology question answering with large language modelscited by 7
  22. 2026Safety and accuracy follow different scaling laws in clinical large language modelscited by 6
  23. 2026Case-Grounded Evidence Verification: A Framework for Constructing Evidence-Sensitive Supervisioncited by 3

Built on by

Cited by year (2026 to 14 Oct)

Citing papers per year: 2026: 1.

1 paper.

Similar, not cited

Close in wording, no citation either way

  1. 2025The Knowledge-Reasoning Dissociation: Fundamental Limitations of LLMs in Clinical Natural Language Inference
  2. 2026Towards Reliable Medical LLMs: Benchmarking and Enhancing Confidence Estimation of Large Language Models in Medical Consultation
  3. 2025Evaluating Large Language Models for Evidence-Based Clinical Question Answering
  4. 2025Susceptibility of Large Language Models to User-Driven Factors in Medical Queries
  5. 2026A rubric landscape for evaluating clinical reasoning in large language models: what exists, what is missing, and what needs to be combined
  6. 2026Measuring Epistemic Resilience of LLMs Under Misleading Medical Context
  7. 2025Why Chain of Thought Fails in Clinical Text Understanding
  8. 2026Same Facts, Different Diagnosis: Measuring and Mitigating Narrative Anchoring in Clinical Language Models