mlsanityData to 14 Oct 2026

Untangling the Mechanisms of Misleading Context in Medical Question Answering

arXiv 2609.02754 ↗First posted 2 Sep 2026cs.CL cs.AI cs.LGcited by 0

On the map: LLM reasoning → Clinical and biomedical applications

Abstract (arXiv)

Large language models now answer medical questions with expert-level performance. However, the context these systems act on can be misleading, and misleading context can corrupt a model's medical judgment. To understand how misleading context corrupts this judgment, we examine the model's susceptibility to the context, disclosure of it, mechanism of corrupted reasoning, and monitorability of the decision. On the medical reasoning subset of MedMisBench, a clinician-reviewed question-answering benchmark of 8,627 questions, we inject two types of misleading context cues, fabricated evidence and a bare assertion. We test three reasoning models, two that expose their full reasoning trace and one frontier model that exposes only its response. All three are more susceptible to the assertion than to the fabricated evidence, adopting the asserted answer 10 to 27 points more often. The misleading cues are disclosed in 81 to 98% of traces but only 7 to 90% of responses, and the assertion is disclosed less often than evidence based cues. Resampling from reasoning traces without disclosure shows the two cues corrupt reasoning differently, evidence entering early and accumulating while the assertion redirects the conclusion near its end. An LLM monitor catches 78% of corrupted decisions at 5% false positives when reading an open model's trace with guidance, against at most 32% from any response. The misleading context that models are most susceptible to is disclosed least, and was caught reliably only from an open reasoning trace, which frontier providers withhold.

Key facts. No citing papers in the map yet (data through 14 Oct 2026). Placed in Clinical and biomedical applications, one of 17 directions in LLM reasoning. Builds on 31 of its 55 references that are in the map. First posted on arXiv 2 Sep 2026.

Builds on

31 of 55 references.

Closest ancestors · 2

Same direction, newest first

  1. 2026Faithful or Just Plausible? Evaluating the Faithfulness of Closed-Source LLMs in Medical Reasoning14 Mar
  2. 2025MedOmni-45deg: A Safety-Performance Benchmark for Reasoning-Oriented LLMs in Medicine22 Aug

Other references · 29

  1. 2022Chain-of-Thought Prompting Elicits Reasoning in Large Language Modelscited by 12,459
  2. 2023Judging LLM-as-a-Judge with MT-Bench and Chatbot Arenacited by 8,626
  3. 2025DeepSeek-R1: Incentivizing Reasoning Capability in LLMs via Reinforcement Learningcited by 6,330
  4. 2023Efficient Memory Management for Large Language Model Serving with PagedAttentioncited by 5,944
  5. 2023Not what you've signed up for: Compromising Real-World LLM-Integrated Applications with Indirect Prompt Injectioncited by 1,443
  6. 2025gpt-oss-120b & gpt-oss-20b Model Cardcited by 1,386
  7. 2023Language Models Don't Always Say What They Think: Unfaithful Explanations in Chain-of-Thought Promptingcited by 1,122
  8. 2023Towards Understanding Sycophancy in Language Modelscited by 1,040
  9. 2023Measuring Faithfulness in Chain-of-Thought Reasoningcited by 703
  10. 2025Reasoning Models Don't Always Say What They Thinkcited by 415
  11. 2025Monitoring Reasoning Models for Misbehavior and the Risks of Promoting Obfuscationcited by 384
  12. 2025Chain of Thought Monitorability: A New and Fragile Opportunity for AI Safetycited by 249
17 more
  1. 2025Chain-of-Thought Reasoning In The Wild Is Not Always Faithfulcited by 170
  2. 2025Thought Anchors: Which LLM Reasoning Steps Matter?cited by 129
  3. 2023The Earth is Flat because...: Investigating LLMs' Belief towards Misinformation via Persuasive Conversationcited by 109
  4. 2025When Chain of Thought is Necessary, Language Models Struggle to Evade Monitorscited by 88
  5. 2024MEDEC: A Benchmark for Medical Error Detection and Correction in Clinical Notescited by 80
  6. 2025Are DeepSeek R1 And Other Reasoning Models More Faithful?cited by 72
  7. 2025CoT Red-Handed: Stress Testing Chain-of-Thought Monitoringcited by 54
  8. 2024MedFuzz: Exploring the Robustness of Large Language Models in Medical Question Answeringcited by 26
  9. 2026PhysicianBench: Evaluating LLM Agents in Real-World EHR Environmentscited by 21
  10. 2025Measuring Chain-of-Thought Monitorability Through Faithfulness and Verbositycited by 17
  11. 2025Thought Branches: Interpreting LLM Reasoning Requires Resamplingcited by 16
  12. 2025Is Chain-of-Thought Really Not Explainability? Chain-of-Thought Can Be Faithful without Hint Verbalizationcited by 16
  13. 2025Cancer-Myth: Evaluating Large Language Models on Patient Questions with False Presuppositionscited by 15
  14. 2025Shallow Robustness, Deep Vulnerabilities: Multi-Turn Evaluation of Medical LLMscited by 8
  15. 2026Why Models Know But Don't Say: Chain-of-Thought Faithfulness Divergence Between Thinking Tokens and Answers in Open-Weight Reasoning Modelscited by 4
  16. 2026Measuring Epistemic Resilience of LLMs Under Misleading Medical Contextcited by 3
  17. 2026Chain-of-Thought Monitoring Can Be Unreliable in Implicit-Influence Settingscited by 2

Built on by

Not cited yet.

Similar, not cited

Close in wording, no citation either way

  1. 2025HealthContradict: Evaluating Biomedical Knowledge Conflicts in Language Models
  2. 2026Why LLMs Give In: Conversational Factors and Reasoning Behind Medical Sycophancy
  3. 2026CLEAR: Revealing How Noise and Ambiguity Degrade Reliability in LLMs for Medicine
  4. 2025Improving Reliability and Explainability of Medical Question Answering through Atomic Fact Checking in Retrieval-Augmented LLMs
  5. 2025On the Robustness of Answer Formats in Medical Reasoning Models
  6. 2025Limitations of Large Language Models in Clinical Problem-Solving Arising from Inflexible Reasoning
  7. 2025Towards Transparent Reasoning: What Drives Faithfulness in Large Language Models?
  8. 2025m1: Unleash the Potential of Test-Time Scaling for Medical Reasoning with Large Language Models