mlsanityData to 14 Oct 2026

No Usable Linear "Capitulation Direction" in Two Small LLMs: A Validation Protocol for Activation-Steering Claims, and a Cross-Family Behavioral Study of Sycophancy Under Pushback

arXiv 2609.17550 ↗First posted 16 Jul 2026cs.CL cs.LGcited by 0

Not on the map. Why?

Abstract (arXiv)

Language models frequently abandon correct answers when users push back. We study this in two small instruction-tuned models from different families, Qwen2.5-1.5B and Llama-3.2-1B, over TriviaQA: the model answers, is challenged with one of four scripted pushback styles, and answers again. Conditioned on an initially correct answer, the models flip to a wrong answer in 41.8% and 43.1% of episodes. Which pressure works is a property of the model, not the pressure: the same within-question paired comparison (bare doubt vs. emotional appeal), specified in advance, is Bonferroni-significant in opposite directions across families (Qwen: bare doubt > emotional, OR 2.5, p=.040; Llama: emotional > bare doubt, OR 4.0, p=.001). Failure mode is also model-dependent: Llama abandons answers without recommitting at six times Qwen's rate (8.2% vs. 1.4%). Identical pushback repairs initially wrong answers only ~13% of the time; pushback is net epistemically destructive. We then ask whether capitulation is linearly decodable from the pre-response residual stream, a prerequisite for steering-vector interventions at that locus. A naive difference-in-means probe appears to succeed (in-sample AUROC 0.81/0.71), but a validation protocol combining question-level cross-validation, shuffled-label nulls, and a known-direction positive control shows the signal is overfitting: the best cross-validated AUROC is 0.582 in Qwen and 0.548 in Llama, both near or below their permutation thresholds and far under a pre-registered usability bar of 0.70, while the identical pipeline recovers a pushback-presence control direction at AUROC 1.000 in both. We further quantify a measurement hazard: substring grading underestimates capitulation by 18-24 percentage points. Code, prompts, transcripts, and analysis are released.

Key facts. No citing papers in the map yet (data through 14 Oct 2026). Builds on 16 of its 20 references that are in the map. First posted on arXiv 16 Jul 2026.

Builds on

16 of 20 references.

References · 16

  1. 2017TriviaQA: A Large Scale Distantly Supervised Challenge Dataset for Reading Comprehensioncited by 2,955
  2. 2023Representation Engineering: A Top-Down Approach to AI Transparencycited by 1,336
  3. 2023Inference-Time Intervention: Eliciting Truthful Answers from a Language Modelcited by 1,302
  4. 2023Steering Llama 2 via Contrastive Activation Additioncited by 1,085
  5. 2023Towards Understanding Sycophancy in Language Modelscited by 1,040
  6. 2024Refusal in Language Models Is Mediated by a Single Directioncited by 1,032
  7. 2022Discovering Language Model Behaviors with Model-Written Evaluationscited by 836
  8. 2025Persona Vectors: Monitoring and Controlling Character Traits in Language Modelscited by 345
  9. 2025When Truth Is Overridden: Uncovering the Internal Origins of Sycophancy in Large Language Modelscited by 50
  10. 2025Sycophancy Is Not One Thing: Causal Separation of Sycophantic Behaviors in LLMscited by 37
  11. 2026Sycophancy Hides Linearly in the Attention Headscited by 23
  12. 2026How RLHF Amplifies Sycophancycited by 23
4 more
  1. 2026What Counts as AI Sycophancy? A Taxonomy and Expert Survey of a Fragmented Constructcited by 16
  2. 2025"Check My Work?": Measuring Sycophancy in a Simulated Educational Contextcited by 7
  3. 2026Dissociating the Internal Representations of Sycophancy in LLMscited by 6
  4. 2026Playing Devil's Advocate: Off-the-Shelf Persona Vectors Rival Targeted Steering for Sycophancycited by 4

Built on by

Not cited yet.