mlsanityData to 7 Oct 2026

There Is More to Refusal in Large Language Models than a Single Direction

arXiv 2602.02132 ↗First posted 2 Feb 2026cs.CLcited by 22

Not on the map. Why?

Abstract (arXiv)

Prior work argues that refusal in large language models is mediated by a single direction, enabling steering and abliteration. We show that this account is incomplete: across diverse refusal and non-compliance categories, refusal behaviors correspond to geometrically distinct directions in activation space. Yet activation steering along any refusal-related direction produces nearly identical refusal--over-refusal trade-offs, acting as a shared one-dimensional control knob. Thus, different directions primarily affect not whether the model refuses, but how it refuses. Using sparse autoencoders, we uncover a structured internal representation of refusal: a reusable core of shared refusal latents supplemented by style- and domain-specific latents. Linear interventions collapse this structure into uniform behavioral control, flattening mechanistic differences across refusal types. Our results reconcile the apparent simplicity of refusal steering with the diversity of refusal behaviors, and clarify the limits of linear interpretability for aligned model behavior.

Key facts. Cited by 22 papers in the map (data through 7 Oct 2026). Builds on 25 of its 41 references that are in the map. First posted on arXiv 2 Feb 2026.

Builds on

25 of 41 references.

References · 25

  1. 2022Constitutional AI: Harmlessness from AI Feedbackcited by 2,950
  2. 2023Representation Engineering: A Top-Down Approach to AI Transparencycited by 1,239
  3. 2021A General Language Assistant as a Laboratory for Alignmentcited by 1,023
  4. 2023Steering Llama 2 via Contrastive Activation Additioncited by 1,009
  5. 2024Refusal in Language Models Is Mediated by a Single Directioncited by 960
  6. 2020Aligning AI With Shared Human Valuescited by 706
  7. 2024WildGuard: Open One-Stop Moderation Tools for Safety Risks, Jailbreaks, and Refusals of LLMscited by 460
  8. 2024Gemma Scope: Open Sparse Autoencoders Everywhere All At Once on Gemma 2cited by 381
  9. 2024Improving Alignment and Robustness with Circuit Breakerscited by 302
  10. 2024Jumping Ahead: Improving Reconstruction Fidelity with JumpReLU Sparse Autoencoderscited by 283
  11. 2024Do I Know This Entity? Knowledge Awareness and Hallucinations in Language Modelscited by 114
  12. 2025The Geometry of Refusal in Large Language Models: Concept Cones and Representational Independencecited by 104
13 more
  1. 2024The Art of Saying No: Contextual Noncompliance in Language Modelscited by 100
  2. 2024Steering Language Model Refusal with Sparse Autoencoderscited by 89
  3. 2025LLMs Encode Harmfulness and Refusal Separatelycited by 75
  4. 2024Refuse Whenever You Feel Unsafe: Improving Safety in LLMs via Decoupled Refusal Trainingcited by 67
  5. 2023From Instructions to Intrinsic Human Values -- A Survey of Alignment Goals for Big Modelscited by 45
  6. 2025Representation Bending for Large Language Model Safetycited by 28
  7. 2025Understanding Refusal in Language Models with Sparse Autoencoderscited by 26
  8. 2022Discovering Salient Neurons in Deep NLP Modelscited by 21
  9. 2022On the Transformation of Latent Space in Fine-Tuned NLP Modelscited by 19
  10. 2025Beyond I'm Sorry, I Can't: Dissecting Large Language Model Refusalcited by 17
  11. 2023Can LLMs facilitate interpretation of pre-trained language models?cited by 15
  12. 2025Differentiated Directional Intervention A Framework for Evading LLM Safety Alignmentcited by 4
  13. 2025Beyond the Leaderboard: Understanding Performance Disparities in Large Language Models via Model Diffingcited by 2

Built on by

Cited by year (2026 to 7 Oct)

Citing papers per year: 2026: 22.

22 papers.

Sort:

By area:

  1. 2026A Single Neuron Is Sufficient to Bypass Safety Alignment in Large Language Modelscited by 3
  2. 2026Activation Steering for Aligned Open-ended Generation without Sacrificing Coherencecited by 2
  3. 2026Low-Resource Safety Failures Are Action Failures, Not Representation Failurescited by 2
  4. 2026The Entanglement Wall: Activation-Space Probes as Risk Detectors, Not Context Adjudicatorscited by 2
  5. 2026C-DeltaTheta: Circuit-Restricted Weight Arithmetic for Selective Refusalcited by 0
  6. 2026Behind Harmful Compliance: Behavioral and Mechanistic Divergence Across LLM Jailbreakscited by 0
  7. 2026From Concept-Aligned Tokens to Vulnerable Features: Mechanistic Localization of Jailbreakscited by 0
  8. 2026Capabilities of Claude Fable 5 on Biomedical Challenge Problemscited by 0
  9. 2026Breaking Refusal in the First Half: A Mechanistic Study of the Prefill Jailbreakcited by 0
  10. 2026Minimizing Targeted Activations: Input-Only Suppression of Evaluation-Awareness Latents in Large Language Modelscited by 0
  11. 2026Fool's Gold: Defensive Deception Against Safety-Removal Attacks on Open-Weight Modelscited by 0
  12. 2026InsufficiencyBench: Evaluating LLM legal advice on underspecified user queriescited by 0
10 more
  1. 2026Who Pays More for Safety? Measuring the Disparate Cost of Safety Alignment across Languagescited by 0
  2. 2026Beyond Shallow Alignment: How Post-Training Methods Determine Refusal Circuits And Steering Robustnesscited by 0
  3. 2026Steering Interference Reflects the Model's Defaults, Not the Behavior Directionscited by 0
  4. 2026How Fragile Is Safety Alignment at Frontier Scale? A Single-Direction Attack on a 320B MoEcited by 0
  5. 2026Decoy Direction Optimization: A Post-Hoc Defense Against LLM Abliterationcited by 0
  6. 2026From Trait Vectors to Circuits: Tracing Refusal and Sycophancy Through Language Modelscited by 0
  7. 2026"As a Language Model...": Chat Template Switches LLM Self-Referential Voice and Activation Steering Reproduces Itcited by 0
  8. 2026From Latents to Wires: Surgical Post-Editing on Large Language Modelscited by 0
  9. 2026Tool Mediation Alters Refusal Mechanisms in Large Language Modelscited by 0
  10. 2026Authority Bias in Language Models: Source Deference and User Agreement Are Not Interchangeablecited by 0