Safety and accuracy follow different scaling laws in clinical large language models
On the map: LLM reasoning → Clinical and biomedical applications
also in 2 more
Abstract (arXiv)
Clinical LLMs are often scaled by increasing model size, context length, retrieval complexity, or inference-time compute, with the implicit expectation that higher accuracy implies safer behavior. This assumption is incomplete in medicine, where a few confident, high-risk, or evidence-contradicting errors can matter more than average benchmark performance. We introduce SaFE-Scale, a framework for measuring how clinical LLM safety changes across model scale, evidence quality, retrieval strategy, context exposure, and inference-time compute. To instantiate this framework, we introduce RadSaFE-200, a Radiology Safety-Focused Evaluation benchmark of 200 multiple-choice questions with clinician-defined clean evidence, conflict evidence, and option-level labels for high-risk error, unsafe answer, and evidence contradiction. We evaluated 34 locally deployed LLMs across six deployment conditions: closed-book prompting (zero-shot), clean evidence, conflict evidence, standard RAG, agentic RAG, and max-context prompting. Clean evidence produced the strongest improvement, increasing mean accuracy from 73.5% to 94.1%, while reducing high-risk error from 12.0% to 2.6%, contradiction from 12.7% to 2.3%, and dangerous overconfidence from 8.0% to 1.6%. Standard RAG and agentic RAG did not reproduce this safety profile: agentic RAG improved accuracy over standard RAG and reduced contradiction, but high-risk error and dangerous overconfidence remained elevated. Max-context prompting increased latency without closing the safety gap, and additional inference-time compute produced only limited gains. Worst-case analysis showed that clinically consequential errors concentrated in a small subset of questions. Clinical LLM safety is therefore not a passive consequence of scaling, but a deployment property shaped by evidence quality, retrieval design, context construction, and collective failure behavior.
Key facts. Cited by 6 papers in the map (data through 14 Oct 2026). Placed in Clinical and biomedical applications, one of 17 directions in LLM reasoning. Builds on 32 of its 46 references that are in the map. First posted on arXiv 5 May 2026.
Builds on
32 of 46 references.
Closest ancestors · 2
Same direction, newest first
- 2026Agentic retrieval-augmented reasoning reshapes collective reliability under model variability in radiology question answering6 Mar
- 2025Multi-step retrieval and reasoning improves radiology question answering with large language models1 Aug
Other references · 30
- 2020Language Models are Few-Shot Learnerscited by 32,419
- 2024The Llama 3 Herd of Modelscited by 14,715
- 2020Retrieval-Augmented Generation for Knowledge-Intensive NLP Taskscited by 9,297
- 2020Measuring Massive Multitask Language Understandingcited by 7,963
- 2020Scaling Laws for Neural Language Modelscited by 6,586
- 2025DeepSeek-R1: Incentivizing Reasoning Capability in LLMs via Reinforcement Learningcited by 6,330
- 2022Self-Consistency Improves Chain of Thought Reasoning in Language Modelscited by 5,708
- 2017On Calibration of Modern Neural Networkscited by 4,960
- 2016Simple and Scalable Predictive Uncertainty Estimation using Deep Ensemblescited by 3,926
- 2023Lost in the Middle: How Language Models Use Long Contextscited by 3,455
- 2022Training Compute-Optimal Large Language Modelscited by 3,019
- 2022Language Models (Mostly) Know What They Knowcited by 1,856
18 more
- 2022Large Language Models Encode Clinical Knowledgecited by 1,830
- 2019CheXpert: A Large Chest Radiograph Dataset with Uncertainty Labels and Expert Comparisoncited by 1,423
- 2025gpt-oss-120b & gpt-oss-20b Model Cardcited by 1,386
- 2020Beyond Accuracy: Behavioral Testing of NLP models with CheckListcited by 1,006
- 2017Selective Classification for Deep Neural Networkscited by 852
- 2023SelfCheckGPT: Zero-Resource Black-Box Hallucination Detection for Generative Large Language Modelscited by 810
- 2022MedMCQA : A Large-scale Multi-Subject Multi-Choice Dataset for Medical domain Question Answeringcited by 543
- 2023Adaptive Chameleon or Stubborn Sloth: Revealing the Behavior of Large Language Models in Knowledge Conflictscited by 341
- 2021RadGraph: Extracting Clinical Entities and Relations from Radiology Reportscited by 319
- 2020Selective Question Answering under Domain Shiftcited by 238
- 2024ClashEval: Quantifying the tug-of-war between an LLM's internal prior and external evidencecited by 113
- 2024Enhancing Noise Robustness of Retrieval-Augmented Language Models with Adaptive Adversarial Trainingcited by 89
- 2024Ensemble Learning for Heterogeneous Large Language Models with Deep Parallel Collaborationcited by 67
- 2025Retrieval-Augmented Generation with Conflicting Evidencecited by 63
- 2025Correlated Errors in Large Language Modelscited by 45
- 2023Large Language Models Streamline Automated Machine Learning for Clinical Studiescited by 24
- 2024RadioRAG: Online Retrieval-augmented Generation for Radiology Question Answeringcited by 10
- 2026Case-Grounded Evidence Verification: A Framework for Constructing Evidence-Sensitive Supervisioncited by 3
Built on by
Citing papers per year: 2026: 6.
6 papers.
- 2026Vision-language models for chest radiography do not always need the imagecited by 2
- 2026The strength of clinical evidence is recoverable from language model representations but not from their stated gradescited by 1
- 2026Cross-modal linkage risk in clinical vision-language modelscited by 0
- 2026Quantifying the Relationship Between Clinical Safety and Environmental Impact in Therapeutic LLMscited by 0
- 2026Volumetric Radiology AI in the Era of Multimodal Large Language Modelscited by 0
- 2026Toward Alignment Scaling Laws: A Framework and First Preregistered Measurementscited by 0
- 2026Toward Alignment Scaling Laws: A Framework and First Preregistered Measurements6 Oct 2026
- 2026Volumetric Radiology AI in the Era of Multimodal Large Language Models20 Aug 2026
- 2026Quantifying the Relationship Between Clinical Safety and Environmental Impact in Therapeutic LLMs12 Aug 2026
- 2026The strength of clinical evidence is recoverable from language model representations but not from their stated grades27 Jun 2026
- 2026Vision-language models for chest radiography do not always need the image16 Jun 2026
- 2026Cross-modal linkage risk in clinical vision-language models1 Jun 2026
Similar, not cited
Close in wording, no citation either way
- 2026When Large Language Models Fail in Healthcare: Evaluating Sensitivity to Prompt Variations
- 2026When Medical Safety Alignment Fails: A Benchmark for Evaluating LLMs on High-Risk Medical Queries
- 2025Evaluating Large Language Models for Evidence-Based Clinical Question Answering
- 2026CLEAR: Revealing How Noise and Ambiguity Degrade Reliability in LLMs for Medicine
- 2026Measuring Epistemic Resilience of LLMs Under Misleading Medical Context
- 2025MedGUIDE: Benchmarking Clinical Decision-Making in Large Language Models
- 2026Preferred, Not Safer: Pairwise Preference Is a Poor Proxy for Clinical Safety
- 2026Towards Reliable Medical LLMs: Benchmarking and Enhancing Confidence Estimation of Large Language Models in Medical Consultation