Jailbreaking the Matrix: Nullspace Steering for Controlled Model Subversion
On the map: LLM safety and security → Jailbreaking
Abstract (arXiv)
Large language models remain vulnerable to jailbreak attacks -- inputs designed to bypass safety mechanisms and elicit harmful responses -- despite advances in alignment and instruction tuning. We propose Head-Masked Nullspace Steering (HMNS), a circuit-level intervention that (i) identifies attention heads most causally responsible for a model's default behavior, (ii) suppresses their write paths via targeted column masking, and (iii) injects a perturbation constrained to the orthogonal complement of the muted subspace. HMNS operates in a closed-loop detection-intervention cycle, re-identifying causal heads and reapplying interventions across multiple decoding attempts. Across multiple jailbreak benchmarks, strong safety defenses, and widely used language models, HMNS attains state-of-the-art attack success rates with fewer queries than prior methods. Ablations confirm that nullspace-constrained injection, residual norm scaling, and iterative re-identification are key to its effectiveness. To our knowledge, this is the first jailbreak method to leverage geometry-aware, interpretability-informed interventions, highlighting a new paradigm for controlled model steering and adversarial safety circumvention.
Key facts. No citing papers in the map yet (data through 7 Oct 2026). Placed in Jailbreaking, one of 12 directions in LLM safety and security. Builds on 42 of its 47 references that are in the map. First posted on arXiv 11 Apr 2026.
Builds on
42 of 47 references.
Closest ancestors · 25
Same direction, newest first
- 2025One Model Transfer to All: On Robust Jailbreak Prompts Generation against LLMs23 May
- 2025Tempest: Autonomous Multi-Turn Jailbreaking of Large Language Models with Tree Search13 Mar
- 2025Foot-In-The-Door: A Multi-turn Jailbreak for LLMs27 Feb
- 2024LLM Defenses Are Not Robust to Multi-Turn Human Jailbreaks Yet27 Aug
- 2024Improved Techniques for Optimization-Based Jailbreaking on Large Language Models31 May
- 2024Defensive Prompt Patch: A Robust and Interpretable Defense of LLMs against Jailbreak Attacks30 May
- 2024Efficient LLM Jailbreak via Adaptive Dense-to-sparse Constrained Optimization15 May
- 2024Boosting Jailbreak Attack with Momentum2 May
- 2024AmpleGCG: Learning a Universal and Transferable Generative Model of Adversarial Suffixes for Jailbreaking Both Open and Closed LLMs11 Apr
- 2024JailbreakBench: An Open Robustness Benchmark for Jailbreaking Large Language Models28 Mar
- 2024CodeChameleon: Personalized Encryption Framework for Jailbreaking Large Language Models26 Feb
- 2024DrAttack: Prompt Decomposition and Reconstruction Makes Powerful LLM Jailbreakers25 Feb
13 more
- 2024Semantic Mirror Jailbreak: Genetic Algorithm Based Jailbreak Prompts Against Open-source LLMs21 Feb
- 2024A StrongREJECT for Empty Jailbreaks15 Feb
- 2024SafeDecoding: Defending against Jailbreak Attacks via Safety-Aware Decoding14 Feb
- 2024Fight Back Against Jailbreaking via Prompt Adversarial Tuning9 Feb
- 2024Robust Prompt Optimization for Defending Language Models Against Jailbreaking Attacks30 Jan
- 2024All in How You Ask for It: Simple Black-Box Method for Jailbreak Attacks18 Jan
- 2023Tree of Attacks: Jailbreaking Black-Box LLMs Automatically4 Dec
- 2023DeepInception: Hypnotize Large Language Model to Be Jailbreaker6 Nov
- 2023AutoDAN: Interpretable Gradient-Based Adversarial Attacks on Large Language Models23 Oct
- 2023SmoothLLM: Defending Large Language Models Against Jailbreaking Attacks5 Oct
- 2023AutoDAN: Generating Stealthy Jailbreak Prompts on Aligned Large Language Models3 Oct
- 2023Universal and Transferable Adversarial Attacks on Aligned Language Models27 Jul
- 2023Jailbroken: How Does LLM Safety Training Fail?5 Jul
Other references · 17
- 2022Training language models to follow instructions with human feedbackcited by 15,712
- 2023Llama 2: Open Foundation and Fine-Tuned Chat Modelscited by 12,865
- 2023Direct Preference Optimization: Your Language Model is Secretly a Reward Modelcited by 7,916
- 2023QLoRA: Efficient Finetuning of Quantized LLMscited by 3,355
- 2022Locating and Editing Factual Associations in GPTcited by 2,609
- 2024HarmBench: A Standardized Evaluation Framework for Automated Red Teaming and Robust Refusalcited by 1,330
- 2023Steering Llama 2 via Contrastive Activation Additioncited by 1,009
- 2022Red Teaming Language Models with Language Modelscited by 983
- 2023Steering Language Models With Activation Engineeringcited by 824
- 2023Baseline Defenses for Adversarial Attacks Against Aligned Language Modelscited by 608
- 2023Towards Best Practices of Activation Patching in Language Models: Metrics and Methodscited by 328
- 2023CodeGeeX: A Pre-Trained Model for Code Generation with Multilingual Benchmarking on HumanEval-Xcited by 294
5 more
- 2023Function Vectors in Large Language Modelscited by 292
- 2023ToolQA: A Dataset for LLM Question Answering with External Toolscited by 273
- 2023Pretraining Language Models with Human Preferencescited by 245
- 2023LLM Self Defense: By Self Examination, LLMs Know They Are Being Trickedcited by 226
- 2023Tensor Trust: Interpretable Prompt Injection Attacks from an Online Gamecited by 135
Built on by
Not cited yet.