Endogenous Resistance to Activation Steering in Language Models
Not on the map. Why?
Abstract (arXiv)
Large language models can recover mid-generation from task-misaligned activation steering, producing explicit verbal restarts (e.g., ``wait, that's not right'') and continuing on-topic even while the steering perturbation remains active. We term this Endogenous Steering Resistance (ESR). Using sparse autoencoder (SAE) latents to steer model activations, we find that Llama-3.3-70B exhibits explicit ESR at 3.8%, with smaller models from the Llama-3 and Gemma-2 families showing the explicit form less frequently. Two controls dissociate ESR into a detection event and a sustained-resistance component that conditioning on recent on-topic tokens does not fully explain. We identify 26 SAE latents through contrastive on-topic/off-topic search; zero-ablating them reduces the multi-attempt rate by 25%, with random-latent and held-out-prompt controls supporting specificity. ESR can also be deliberately enhanced through both meta-prompting and fine-tuning on synthetic self-correction examples. ESR has dual implications for safety: it could harden models against adversarial activation-space manipulation, but may equally interfere with beneficial steering-based interventions, since the model has no way to distinguish the two. Code is available at https://github.com/agencyenterprise/endogenous-steering-resistance.
Key facts. Cited by 3 papers in the map (data through 7 Oct 2026). Builds on 17 of its 35 references that are in the map. First posted on arXiv 6 Feb 2026.
Builds on
17 of 35 references.
References · 17
- 2025DeepSeek-R1: Incentivizing Reasoning Capability in LLMs via Reinforcement Learningcited by 6,146
- 2022Locating and Editing Factual Associations in GPTcited by 2,609
- 2023Sparse Autoencoders Find Highly Interpretable Features in Language Modelscited by 1,359
- 2023Inference-Time Intervention: Eliciting Truthful Answers from a Language Modelcited by 1,259
- 2023Representation Engineering: A Top-Down Approach to AI Transparencycited by 1,239
- 2022Interpretability in the Wild: a Circuit for Indirect Object Identification in GPT-2 smallcited by 1,130
- 2023Steering Language Models With Activation Engineeringcited by 824
- 2024Sparse Feature Circuits: Discovering and Editing Interpretable Causal Graphs in Language Modelscited by 412
- 2024Gemma Scope: Open Sparse Autoencoders Everywhere All At Once on Gemma 2cited by 381
- 2025R1-Zero's "Aha Moment" in Visual Reasoning on a 2B Non-SFT Modelcited by 163
- 2023The Hydra Effect: Emergent Self-repair in Language Model Computationscited by 145
- 2026Emergent Introspective Awareness in Large Language Modelscited by 73
5 more
- 2025Understanding Aha Moments: from External Observations to Internal Mechanismscited by 48
- 2023Rigorously Assessing Natural Language Explanations of Neuronscited by 44
- 2025Enhancing Automated Interpretability with Output-Centric Feature Descriptionscited by 39
- 2025SafeKey: Amplifying Aha-Moment Insights for Safety Reasoningcited by 20
- 2025Scaling laws for activation steering with Llama 2 models and refusal mechanismscited by 3
Built on by
Citing papers per year: 2026: 3.
3 papers.
- 2026LLMs Learn to Evade Latent Monitors from Prior Feedback Alone29 Sep 2026
- 2026Gathered, Not Admitted: How Attention Brings a Latent Variable into Verbalizable Form15 Aug 2026
- 2026Decodable but Not Corrected by Fixed Residual-Stream Linear Steering: Evidence from Medical LLM Failure Regimes7 May 2026