When Correct Beliefs Collapse: Epistemic Resilience of LLMs under Clinical Pressure
Not on the map. Why?
Abstract (arXiv)
Despite strong medical benchmark accuracy, LLMs can exhibit severe multi-turn sycophancy in clinical dialogue, abandoning initial correct diagnosis under escalating pressure. We propose textbftextscMed-Stress, a targeted stress test framework that evaluates belief stability under escalating pressure. Across nine frontier large language models (LLMs), we find a clear dissociation between medical knowledge and robustness: high initial diagnostic capability does not imply high belief stability, yielding large knowledge-robustness gaps for several LLMs. To mitigate this failure mode, we propose a lightweight inference-time defense, textbftextttRBED (Role-Based Epistemic Defense), and textbftextttR-FT (Resilience-oriented Fine-Tuning), a training-time approach that internalizes evidence-based resistance to pressure. Experiments show that textbftextttR-FT nearly eliminates belief change and substantially improves robustness.
Key facts. Cited by 4 papers in the map (data through 7 Oct 2026). Builds on 26 of its 37 references that are in the map. First posted on arXiv 23 Apr 2026.
Builds on
26 of 37 references.
References · 26
- 2020Measuring Massive Multitask Language Understandingcited by 7,768
- 2023Efficient Memory Management for Large Language Model Serving with PagedAttentioncited by 5,767
- 2023FlashAttention-2: Faster Attention with Better Parallelism and Work Partitioningcited by 2,551
- 2020What Disease does this Patient Have? A Large-scale Open Domain Question Answering Dataset from Medical Examscited by 1,324
- 2019PubMedQA: A Dataset for Biomedical Research Question Answeringcited by 1,271
- 2023Representation Engineering: A Top-Down Approach to AI Transparencycited by 1,239
- 2023Towards Understanding Sycophancy in Language Modelscited by 988
- 2019Plug and Play Language Models: A Simple Approach to Controlled Text Generationcited by 793
- 2020How Much Knowledge Can You Pack Into the Parameters of a Language Model?cited by 713
- 2024HuatuoGPT-o1, Towards Medical Complex Reasoning with LLMscited by 257
- 2024Improving Instruction-Following in Language Models through Activation Steeringcited by 149
- 2023Inspecting and Editing Knowledge Representations in Language Modelscited by 140
14 more
- 2023The Earth is Flat because...: Investigating LLMs' Belief towards Misinformation via Persuasive Conversationcited by 107
- 2024Benchmarking Large Language Models on Answering and Explaining Challenging Medical Questionscited by 106
- 2024Sycophancy in Large Language Models: Causes and Mitigationscited by 97
- 2025Measuring Sycophancy of Language Models in Multi-turn Dialoguescited by 91
- 2025A Survey of LLM-based Agents in Medicine: How far are we from Baymax?cited by 84
- 2024Hidden Persuaders: LLMs' Political Leaning and Their Influence on Voterscited by 71
- 2024Measuring and Controlling Instruction (In)Stability in Language Model Dialogscited by 51
- 2025TRUTH DECAY: Quantifying Multi-Turn Sycophancy in Language Modelscited by 31
- 2025Peacemaker or Troublemaker: How Sycophancy Shapes Multi-Agent Debatecited by 29
- 2025A Comprehensive Survey on the Trustworthiness of Large Language Models in Healthcarecited by 27
- 2024Teaching Models to Balance Resisting and Accepting Persuasioncited by 19
- 2025Sycophancy under Pressure: Evaluating and Mitigating Sycophantic Bias via Adversarial Dialogues in Scientific QAcited by 16
- 2025Persuasion Dynamics in LLMs: Investigating Robustness and Adaptability in Knowledge and Safety with DuET-PDcited by 13
- 2025Enhancing Cross-task Transfer of Large Language Models via Activation Steeringcited by 6
Built on by
Citing papers per year: 2026: 4.
4 papers.
- 2026AI Can Be Easily Persuaded in Clinical Decision Makingcited by 0
- 2026Source-Dependent Deference in Medical Imaging Agents Under Falsified Findings: A Pilot Auditcited by 0
- 2026Didactic knowledge or Clinical Cases? How Data Types Shape Medical Large Language Modelscited by 0
- 2026"You're Right, Let Me Fix It": How LLM Agents Damage Correct Work When Falsely Accusedcited by 0
- 2026"You're Right, Let Me Fix It": How LLM Agents Damage Correct Work When Falsely Accused26 Sep 2026
- 2026Source-Dependent Deference in Medical Imaging Agents Under Falsified Findings: A Pilot Audit30 Aug 2026
- 2026AI Can Be Easily Persuaded in Clinical Decision Making29 Aug 2026
- 2026Didactic knowledge or Clinical Cases? How Data Types Shape Medical Large Language Models26 Aug 2026