mlsanityData to 7 Oct 2026

Endogenous Resistance to Activation Steering in Language Models

arXiv 2602.06941 ↗First posted 6 Feb 2026cs.LG cs.AI cs.CLcited by 3

Not on the map. Why?

Abstract (arXiv)

Large language models can recover mid-generation from task-misaligned activation steering, producing explicit verbal restarts (e.g., ``wait, that's not right'') and continuing on-topic even while the steering perturbation remains active. We term this Endogenous Steering Resistance (ESR). Using sparse autoencoder (SAE) latents to steer model activations, we find that Llama-3.3-70B exhibits explicit ESR at 3.8%, with smaller models from the Llama-3 and Gemma-2 families showing the explicit form less frequently. Two controls dissociate ESR into a detection event and a sustained-resistance component that conditioning on recent on-topic tokens does not fully explain. We identify 26 SAE latents through contrastive on-topic/off-topic search; zero-ablating them reduces the multi-attempt rate by 25%, with random-latent and held-out-prompt controls supporting specificity. ESR can also be deliberately enhanced through both meta-prompting and fine-tuning on synthetic self-correction examples. ESR has dual implications for safety: it could harden models against adversarial activation-space manipulation, but may equally interfere with beneficial steering-based interventions, since the model has no way to distinguish the two. Code is available at https://github.com/agencyenterprise/endogenous-steering-resistance.

Key facts. Cited by 3 papers in the map (data through 7 Oct 2026). Builds on 17 of its 35 references that are in the map. First posted on arXiv 6 Feb 2026.

Builds on

17 of 35 references.

References · 17

  1. 2025DeepSeek-R1: Incentivizing Reasoning Capability in LLMs via Reinforcement Learningcited by 6,146
  2. 2022Locating and Editing Factual Associations in GPTcited by 2,609
  3. 2023Sparse Autoencoders Find Highly Interpretable Features in Language Modelscited by 1,359
  4. 2023Inference-Time Intervention: Eliciting Truthful Answers from a Language Modelcited by 1,259
  5. 2023Representation Engineering: A Top-Down Approach to AI Transparencycited by 1,239
  6. 2022Interpretability in the Wild: a Circuit for Indirect Object Identification in GPT-2 smallcited by 1,130
  7. 2023Steering Language Models With Activation Engineeringcited by 824
  8. 2024Sparse Feature Circuits: Discovering and Editing Interpretable Causal Graphs in Language Modelscited by 412
  9. 2024Gemma Scope: Open Sparse Autoencoders Everywhere All At Once on Gemma 2cited by 381
  10. 2025R1-Zero's "Aha Moment" in Visual Reasoning on a 2B Non-SFT Modelcited by 163
  11. 2023The Hydra Effect: Emergent Self-repair in Language Model Computationscited by 145
  12. 2026Emergent Introspective Awareness in Large Language Modelscited by 73
5 more
  1. 2025Understanding Aha Moments: from External Observations to Internal Mechanismscited by 48
  2. 2023Rigorously Assessing Natural Language Explanations of Neuronscited by 44
  3. 2025Enhancing Automated Interpretability with Output-Centric Feature Descriptionscited by 39
  4. 2025SafeKey: Amplifying Aha-Moment Insights for Safety Reasoningcited by 20
  5. 2025Scaling laws for activation steering with Llama 2 models and refusal mechanismscited by 3

Built on by

Cited by year (2026 to 7 Oct)

Citing papers per year: 2026: 3.

3 papers.