mlsanityData to 14 Oct 2026

Safety and accuracy follow different scaling laws in clinical large language models

arXiv 2605.04039 ↗First posted 5 May 2026cs.CL cs.AI cs.LGcited by 6

On the map: LLM reasoning → Clinical and biomedical applications

also in 2 more
Abstract (arXiv)

Clinical LLMs are often scaled by increasing model size, context length, retrieval complexity, or inference-time compute, with the implicit expectation that higher accuracy implies safer behavior. This assumption is incomplete in medicine, where a few confident, high-risk, or evidence-contradicting errors can matter more than average benchmark performance. We introduce SaFE-Scale, a framework for measuring how clinical LLM safety changes across model scale, evidence quality, retrieval strategy, context exposure, and inference-time compute. To instantiate this framework, we introduce RadSaFE-200, a Radiology Safety-Focused Evaluation benchmark of 200 multiple-choice questions with clinician-defined clean evidence, conflict evidence, and option-level labels for high-risk error, unsafe answer, and evidence contradiction. We evaluated 34 locally deployed LLMs across six deployment conditions: closed-book prompting (zero-shot), clean evidence, conflict evidence, standard RAG, agentic RAG, and max-context prompting. Clean evidence produced the strongest improvement, increasing mean accuracy from 73.5% to 94.1%, while reducing high-risk error from 12.0% to 2.6%, contradiction from 12.7% to 2.3%, and dangerous overconfidence from 8.0% to 1.6%. Standard RAG and agentic RAG did not reproduce this safety profile: agentic RAG improved accuracy over standard RAG and reduced contradiction, but high-risk error and dangerous overconfidence remained elevated. Max-context prompting increased latency without closing the safety gap, and additional inference-time compute produced only limited gains. Worst-case analysis showed that clinically consequential errors concentrated in a small subset of questions. Clinical LLM safety is therefore not a passive consequence of scaling, but a deployment property shaped by evidence quality, retrieval design, context construction, and collective failure behavior.

Key facts. Cited by 6 papers in the map (data through 14 Oct 2026). Placed in Clinical and biomedical applications, one of 17 directions in LLM reasoning. Builds on 32 of its 46 references that are in the map. First posted on arXiv 5 May 2026.

Builds on

32 of 46 references.

Closest ancestors · 2

Same direction, newest first

  1. 2026Agentic retrieval-augmented reasoning reshapes collective reliability under model variability in radiology question answering6 Mar
  2. 2025Multi-step retrieval and reasoning improves radiology question answering with large language models1 Aug

Other references · 30

  1. 2020Language Models are Few-Shot Learnerscited by 32,419
  2. 2024The Llama 3 Herd of Modelscited by 14,715
  3. 2020Retrieval-Augmented Generation for Knowledge-Intensive NLP Taskscited by 9,297
  4. 2020Measuring Massive Multitask Language Understandingcited by 7,963
  5. 2020Scaling Laws for Neural Language Modelscited by 6,586
  6. 2025DeepSeek-R1: Incentivizing Reasoning Capability in LLMs via Reinforcement Learningcited by 6,330
  7. 2022Self-Consistency Improves Chain of Thought Reasoning in Language Modelscited by 5,708
  8. 2017On Calibration of Modern Neural Networkscited by 4,960
  9. 2016Simple and Scalable Predictive Uncertainty Estimation using Deep Ensemblescited by 3,926
  10. 2023Lost in the Middle: How Language Models Use Long Contextscited by 3,455
  11. 2022Training Compute-Optimal Large Language Modelscited by 3,019
  12. 2022Language Models (Mostly) Know What They Knowcited by 1,856
18 more
  1. 2022Large Language Models Encode Clinical Knowledgecited by 1,830
  2. 2019CheXpert: A Large Chest Radiograph Dataset with Uncertainty Labels and Expert Comparisoncited by 1,423
  3. 2025gpt-oss-120b & gpt-oss-20b Model Cardcited by 1,386
  4. 2020Beyond Accuracy: Behavioral Testing of NLP models with CheckListcited by 1,006
  5. 2017Selective Classification for Deep Neural Networkscited by 852
  6. 2023SelfCheckGPT: Zero-Resource Black-Box Hallucination Detection for Generative Large Language Modelscited by 810
  7. 2022MedMCQA : A Large-scale Multi-Subject Multi-Choice Dataset for Medical domain Question Answeringcited by 543
  8. 2023Adaptive Chameleon or Stubborn Sloth: Revealing the Behavior of Large Language Models in Knowledge Conflictscited by 341
  9. 2021RadGraph: Extracting Clinical Entities and Relations from Radiology Reportscited by 319
  10. 2020Selective Question Answering under Domain Shiftcited by 238
  11. 2024ClashEval: Quantifying the tug-of-war between an LLM's internal prior and external evidencecited by 113
  12. 2024Enhancing Noise Robustness of Retrieval-Augmented Language Models with Adaptive Adversarial Trainingcited by 89
  13. 2024Ensemble Learning for Heterogeneous Large Language Models with Deep Parallel Collaborationcited by 67
  14. 2025Retrieval-Augmented Generation with Conflicting Evidencecited by 63
  15. 2025Correlated Errors in Large Language Modelscited by 45
  16. 2023Large Language Models Streamline Automated Machine Learning for Clinical Studiescited by 24
  17. 2024RadioRAG: Online Retrieval-augmented Generation for Radiology Question Answeringcited by 10
  18. 2026Case-Grounded Evidence Verification: A Framework for Constructing Evidence-Sensitive Supervisioncited by 3

Built on by

Cited by year (2026 to 14 Oct)

Citing papers per year: 2026: 6.

6 papers.

Similar, not cited

Close in wording, no citation either way

  1. 2026When Large Language Models Fail in Healthcare: Evaluating Sensitivity to Prompt Variations
  2. 2026When Medical Safety Alignment Fails: A Benchmark for Evaluating LLMs on High-Risk Medical Queries
  3. 2025Evaluating Large Language Models for Evidence-Based Clinical Question Answering
  4. 2026CLEAR: Revealing How Noise and Ambiguity Degrade Reliability in LLMs for Medicine
  5. 2026Measuring Epistemic Resilience of LLMs Under Misleading Medical Context
  6. 2025MedGUIDE: Benchmarking Clinical Decision-Making in Large Language Models
  7. 2026Preferred, Not Safer: Pairwise Preference Is a Poor Proxy for Clinical Safety
  8. 2026Towards Reliable Medical LLMs: Benchmarking and Enhancing Confidence Estimation of Large Language Models in Medical Consultation