mlsanityData to 14 Oct 2026

Where Do Apparent LLM Clinical Triage Failures Arise? Localizing the Multiple-Choice Format Effect

arXiv 2605.29889 ↗First posted 28 May 2026cs.CL cs.AIcited by 4

Not on the map. Why?

Abstract (arXiv)

LLM evaluations using clinician-authored triage vignettes have reported substantial under-triage under constrained multiple-choice testing. Yet model performance on the same clinical cases can change when responses are generated in free text. We test whether this format effect appears while the case is processed or when clinical information is mapped to the final answer. Using sparse-autoencoder (SAE) features in Gemma 3 4B/12B IT and Qwen3-8B, we find that medical features fire on the shared clinical narrative under both formats but are inactive at the multiple-choice decision token. Emergency-tier information is linearly decodable from vignette representations with ROC-AUC 0.95--1.00 under both formats, with no significant format difference, but is attenuated at the decision token. Natural-language autoencoder verbalization and top-feature characterization associate that token with the multiple-choice scaffold. In a direct linear projection, the identified medical features contribute zero, whereas scaffold-peaking features account for over 91% of unsigned attribution in both Gemma models. Behaviorally, whether multiple choice improves or worsens performance depends on the model. Option-order shuffles rule out simple positional bias, and cases that differ between formats are usually one severity tier apart. Together, these findings place the strongest correlates of the format effect at answer selection while leaving open whether unmeasured clinical representations also differ. Code and data to reproduce experiments are available in the study repository. https://github.com/dafraile/SAEmad

Key facts. Cited by 4 papers in the map (data through 14 Oct 2026). Builds on 13 of its 68 references that are in the map. First posted on arXiv 28 May 2026.

Builds on

13 of 68 references.

References · 13

  1. 2023Sparse Autoencoders Find Highly Interpretable Features in Language Modelscited by 1,420
  2. 2023Language Models Don't Always Say What They Think: Unfaithful Explanations in Chain-of-Thought Promptingcited by 1,122
  3. 2023Steering Language Models With Activation Engineeringcited by 922
  4. 2023Quantifying Language Models' Sensitivity to Spurious Features in Prompt Design or: How I learned to start worrying about prompt formattingcited by 817
  5. 2022Discovering Latent Knowledge in Language Models Without Supervisioncited by 767
  6. 2023Large Language Models Are Not Robust Multiple Choice Selectorscited by 486
  7. 2024Sparse Feature Circuits: Discovering and Editing Interpretable Causal Graphs in Language Modelscited by 435
  8. 2024Gemma Scope: Open Sparse Autoencoders Everywhere All At Once on Gemma 2cited by 394
  9. 2024Jumping Ahead: Improving Reconstruction Fidelity with JumpReLU Sparse Autoencoderscited by 300
  10. 2013k-Sparse Autoencoderscited by 215
  11. 2024Towards Principled Evaluations of Sparse Autoencoders for Interpretability and Controlcited by 86
  12. 2026Interpretability without actionability: mechanistic methods cannot correct language model errors despite near-perfect internal representationscited by 17
1 more
  1. 2024Pattern Recognition or Medical Knowledge? The Problem with Multiple-Choice Questions in Medicinecited by 13

Built on by

Cited by year (2026 to 14 Oct)

Citing papers per year: 2026: 4.

4 papers.

Similar, not cited

Close in wording, no citation either way

  1. 2025ER-Reason: A Benchmark Dataset for LLM Clinical Reasoning in the Emergency Room
  2. 2026CLEAR: Revealing How Noise and Ambiguity Degrade Reliability in LLMs for Medicine
  3. 2026Reasoning in Real World Clinical Care: Why Large Language Models Are Not Yet Safe for Autonomous Clinical Decision Support
  4. 2026EQUITRIAGE: A Fairness Audit of Gender Bias in LLM-Based Emergency Department Triage
  5. 2026Unknown is not normal: separating language-model extraction from rule-based decision logic for clinical risk scores
  6. 2024Bias patterns in the application of LLMs for clinical decision support: A comprehensive study
  7. 2026TRIAGE: Dialectical Reasoning for Explainable Risk Prediction on Irregularly Sampled Medical Time Series with LLMs
  8. 2026Safety and accuracy follow different scaling laws in clinical large language models