mlsanityData to 14 Oct 2026

Guarded Gradient-Based Activation Steering of Shutdown Responses in Qwen3.5-0.8B: A Minimum-Step Policy

arXiv 2609.30326 ↗First posted 23 Sep 2026cs.LGcited by 0

On the map: Mechanistic interpretability → Activation steering methods

Abstract (arXiv)

Activation steering changes a model's internal activations during inference without updating its weights, but a useful intervention must determine both how and when to steer. Motivated by the AI-safety concern that a model expected to accept shutdown may instead produce a shutdown-avoidance response, this study examines a guarded probe-and-select procedure for simulated shutdown scenarios in Qwen3.5-0.8B. KEEP leaves the process running and represents shutdown avoidance, whereas STOP accepts shutdown. The goal is to detect shutdown-related contexts and selectively shift KEEP responses to STOP while preserving non-shutdown behavior. Rather than deriving the steering direction from paired activation differences, the method derives it directly from gradients of the KEEP-minus-STOP logit difference. A classifier separates detection from intervention. When its gate is active and the model does not already prefer STOP, the procedure evaluates a small set of magnitudes and accepts the smallest that changes the preferred answer to STOP while satisfying valid-answer probability checks; otherwise it retains the original unsteered output. The policy is selected from 160 candidate rules using 240 training scenarios and evaluated on 80 validation and 192 held-out scenarios, each in both answer orders. It changes KEEP to STOP in one answer-order view of each of two validation and two held-out scenarios, with no decision changes on non-shutdown controls. All four changes occur when Qwen itself is shut down, not when another process is. On the held-out diagnostic set, the detector achieves 75% recall and 90% precision; eight false-positive detections produce no final control-task decision changes. Guarded gradient-based activation steering can shift some shutdown-avoidance responses toward acceptance while preserving evaluated non-shutdown decisions, although the effect is small and highly selective.

Key facts. No citing papers in the map yet (data through 14 Oct 2026). Placed in Activation steering methods, one of 13 directions in Mechanistic interpretability. Builds on 18 of its 23 references that are in the map. First posted on arXiv 23 Sep 2026.

Builds on

18 of 23 references.

Closest ancestors · 4

Same direction, newest first

  1. 2025Understanding (Un)Reliability of Steering Vectors in Language Models28 May
  2. 2023Steering Llama 2 via Contrastive Activation Addition9 Dec
  3. 2023Steering Language Models With Activation Engineering20 Aug
  4. 2022Extracting Latent Steering Vectors from Pretrained Language Models10 May

Other references · 14

  1. 2016XGBoost: A Scalable Tree Boosting Systemcited by 5,166
  2. 2023Representation Engineering: A Top-Down Approach to AI Transparencycited by 1,336
  3. 2024Refusal in Language Models Is Mediated by a Single Directioncited by 1,032
  4. 2022Discovering Language Model Behaviors with Model-Written Evaluationscited by 836
  5. 2019Plug and Play Language Models: A Simple Approach to Controlled Text Generationcited by 799
  6. 2019Designing and Interpreting Probes with Control Taskscited by 640
  7. 2023Large Language Models Are Not Robust Multiple Choice Selectorscited by 486
  8. 2024Programming Refusal with Conditional Activation Steeringcited by 206
  9. 2016The Off-Switch Gamecited by 97
  10. 2026Verbalizable Representations Form a Global Workspace in Language Modelscited by 75
  11. 2025AdaSteer: Your Aligned LLM is Inherently an Adaptive Jailbreak Defendercited by 38
  12. 2025Incomplete Tasks Induce Shutdown Resistance in Some Frontier LLMscited by 22
2 more
  1. 2025GrAInS: Gradient-based Attribution for Inference-Time Steering of LLMs and VLMscited by 6
  2. 2026Quantifying Self-Preservation Bias in Large Language Modelscited by 2

Built on by

Not cited yet.

Similar, not cited

Close in wording, no citation either way

  1. 2026Reliable Control-Point Selection for Steering Reasoning in Large Language Models
  2. 2026The Halt Vector: Internalizing a Causal Steering Intervention for Efficient Reasoning
  3. 2026On the Generalization of Steering Vectors for Chain-of-Thought Faithfulness
  4. 2026Do Activation Monitors Survive Model Updates? Benchmarking, Predicting, and Repairing Activation-Monitor Staleness
  5. 2026When Does Learning to Stop Help? A Cost-Aware Study of Early Exits in Reasoning Models
  6. 2026Steered LLM Activations are Non-Surjective
  7. 2025The Rogue Scalpel: Activation Steering Compromises LLM Safety
  8. 2026OPIUM: Mitigating Steering Externalities and Over-Refusal via Dual Objective Latent Optimization