mlsanityData to 14 Oct 2026

Refusal Steering: Fine-grained Control over LLM Refusal Behaviour for Sensitive Topics

arXiv 2512.16602 ↗First posted 18 Dec 2025cs.CL cs.AIcited by 6

On the map: LLM safety and security → Safety alignment, refusal and guardrails

also in 1 more
Abstract (arXiv)

We introduce Refusal Steering, an inference-time method to exercise fine-grained control over Large Language Models refusal behaviour on politically sensitive topics without retraining. We replace fragile pattern-based refusal detection with an LLM-as-a-judge that assigns refusal confidence scores and we propose a ridge-regularized variant to compute steering vectors that better isolate the refusal--compliance direction. On Qwen3-Next-80B-A3B-Thinking, our method removes the refusal behaviour of the model around politically sensitive topics while maintaining safety on JailbreakBench and near-baseline performance on general benchmarks. The approach generalizes across 4B and 80B models and can also induce targeted refusals when desired. We analize the steering vectors and show that refusal signals concentrate in deeper layers of the transformer and are distributed across many dimensions. Together, these results demonstrate that activation steering can remove political refusal behaviour while retaining safety alignment for harmful content, offering a practical path to controllable, transparent moderation at inference time.

Key facts. Cited by 6 papers in the map (data through 14 Oct 2026). Placed in Safety alignment, refusal and guardrails, one of 12 directions in LLM safety and security. Builds on 30 of its 47 references that are in the map. First posted on arXiv 18 Dec 2025.

Builds on

30 of 47 references.

Closest ancestors · 1

Same direction, newest first

  1. 2024Refusal in Language Models Is Mediated by a Single Direction17 Jun

Other references · 29

  1. 2022Training language models to follow instructions with human feedbackcited by 15,971
  2. 2021Training Verifiers to Solve Math Word Problemscited by 10,109
  3. 2021Evaluating Large Language Models Trained on Codecited by 8,320
  4. 2023Direct Preference Optimization: Your Language Model is Secretly a Reward Modelcited by 8,065
  5. 2017Outrageously Large Neural Networks: The Sparsely-Gated Mixture-of-Experts Layercited by 3,509
  6. 2024MMLU-Pro: A More Robust and Challenging Multi-Task Language Understanding Benchmarkcited by 1,848
  7. 2023Representation Engineering: A Top-Down Approach to AI Transparencycited by 1,336
  8. 2023Inference-Time Intervention: Eliciting Truthful Answers from a Language Modelcited by 1,302
  9. 2023Instruction-Following Evaluation for Large Language Modelscited by 1,228
  10. 2023Steering Llama 2 via Contrastive Activation Additioncited by 1,085
  11. 2023Steering Language Models With Activation Engineeringcited by 922
  12. 2023The Geometry of Truth: Emergent Linear Structure in Large Language Model Representations of True/False Datasetscited by 712
17 more
  1. 2023GPTFUZZER: Red Teaming Large Language Models with Auto-Generated Jailbreak Promptscited by 560
  2. 2023Safety-Tuned LLaMAs: Lessons From Improving the Safety of Large Language Models that Follow Instructionscited by 387
  3. 2025SmolLM2: When Smol Goes Big -- Data-Centric Training of a Small Language Modelcited by 335
  4. 2023In-context Vectors: Making In Context Learning More Effective and Controllable Through Latent Space Steeringcited by 245
  5. 2024JailBreakV: A Benchmark for Assessing the Robustness of MultiModal Large Language Models against Jailbreak Attackscited by 230
  6. 2024Programming Refusal with Conditional Activation Steeringcited by 206
  7. 2023Inspecting and Editing Knowledge Representations in Language Modelscited by 141
  8. 2024Multi-property Steering of Large Language Models with Dynamic Activation Compositioncited by 39
  9. 2024AI Risk Categorization Decoded (AIR 2024): From Government Regulations to Corporate Policiescited by 37
  10. 2023Fact-checking information from large language models can decrease headline discernmentcited by 22
  11. 2024Trojan Detection in Large Language Models: Insights from The Trojan Detection Challengecited by 14
  12. 2025Steering the CensorShip: Uncovering Representation Vectors for LLM "Thought" Controlcited by 14
  13. 2025Instructing Large Language Models for Low-Resource Languages: A Systematic Study for Basquecited by 12
  14. 2025What Large Language Models Do Not Talk About: An Empirical Study of Moderation and Censorship Practicescited by 11
  15. 2025Information Suppression in Large Language Models: Auditing, Quantifying, and Characterizing Censorship in DeepSeekcited by 11
  16. 2025Unsupervised Concept Vector Extraction for Bias Control in LLMscited by 7
  17. 2025Longitudinal Monitoring of LLM Content Moderation of Social Issuescited by 2

Built on by

Cited by year (2026 to 14 Oct)

Citing papers per year: 2026: 6.

6 papers.

Similar, not cited

Close in wording, no citation either way

  1. 2026From Refusal Tokens to Refusal Control: Discovering and Steering Category-Specific Refusal Directions
  2. 2024Refusal Tokens: A Simple Way to Calibrate Refusals in Large Language Models
  3. 2025RefusalBench: Generative Evaluation of Selective Refusal in Grounded Language Models
  4. 2025Beyond I'm Sorry, I Can't: Dissecting Large Language Model Refusal
  5. 2026There Is More to Refusal in Large Language Models than a Single Direction
  6. 2026On the Steering Dimensionality of Refusal in Language Models
  7. 2025An Embarrassingly Simple Defense Against LLM Abliteration Attacks
  8. 2026Decomposing Refusal Steering in Mixture-of-Experts Models