Closing the Activation-Cone Blind Spot: Response-Time Probing and Unified Defense
Not on the map. Why?
Abstract (arXiv)
Inference-time safety methods for large language models have proliferated, yet no systematic comparison exists. We evaluate five defense paradigms (no defense, static steering, CAST, AlphaSteer, probe-gated) across seven instruction-tuned models (7-31B) and five attack types (GCG, AutoDAN, DeepInception, prefilling, intent laundering). Our central finding: prompt-time activation defenses are structurally blind to prefilling attacks. AlphaSteer achieves 0% attack success on GCG, AutoDAN, and intent laundering but 50% on prefilling. We prove a corollary: any defense that gates intervention on a single layer's activation alignment with a benign reference (cone, subspace, or null-space) is blind to attacks that craft activations to lie inside that reference, whether checked at prompt time or per token. As its constructive contrapositive we introduce response-time probing: a linear probe on the model's hidden state at the first generated tokens, with AUROC 0.97-1.00 across all seven models. Combined with a halt, it cuts prefilling attack success to 0/40 on every model with 0% benign false positives, outperforming Llama Guard 3. Cross-template generalisation depends on probe depth, so we scope the claim to the canonical prefilling-template family. Composing the response-halt with AlphaSteer's null-space steering gives an orthogonal split (the halt catches prefilling, AlphaSteer catches semantic attacks), reaching defense success 0.983 on Mistral and 0.994 on Llama and dominating both components. We further show MMLU fails to capture steering's true utility cost, which appears as behavioral hedging rather than factual loss, and that diverse negative training sets cut probe false positives from 80-100% to near zero. Code, attacks, per-sample results, and the judge prompt are released.
Key facts. No citing papers in the map yet (data through 14 Oct 2026). Builds on 14 of its 17 references that are in the map. First posted on arXiv 28 Jun 2026.
Builds on
14 of 17 references.
References · 14
- 2024The Llama 3 Herd of Modelscited by 14,715
- 2023Universal and Transferable Adversarial Attacks on Aligned Language Modelscited by 3,104
- 2023AutoDAN: Generating Stealthy Jailbreak Prompts on Aligned Large Language Modelscited by 785
- 2024Safety Alignment Should Be Made More Than Just a Few Tokens Deepcited by 472
- 2023DeepInception: Hypnotize Large Language Model to Be Jailbreakercited by 367
- 2024Programming Refusal with Conditional Activation Steeringcited by 206
- 2025AlphaSteer: Learning Refusal Steering with Principled Null-Space Constraintcited by 49
- 2026Building Production-Ready Probes For Geminicited by 47
- 2025The Rogue Scalpel: Activation Steering Compromises LLM Safetycited by 21
- 2025ARGUS: Defending Against Multimodal Indirect Prompt Injection via Steering Instruction-Following Behaviorcited by 7
- 2026Defending Large Language Models Against Jailbreak Attacks via In-Decoding Safety-Awareness Probingcited by 4
- 2026AISA: Awakening Intrinsic Safety Awareness in Large Language Models against Jailbreak Attackscited by 3
2 more
Built on by
Not cited yet.
Similar, not cited
Close in wording, no citation either way
- 2025SecInfer: Preventing Prompt Injection via Inference-time Scaling
- 2025Activation Approximations Can Incur Safety Vulnerabilities Even in Aligned LLMs: Comprehensive Analysis and Defense
- 2026Silencing the Guardrails: Inference-Time Jailbreaking via Dynamic Contextual Representation Ablation
- 2023Evaluating the Instruction-Following Robustness of Large Language Models to Prompt Injection
- 2026Language Triggers Hijack Language Circuits: A Mechanistic Analysis of Backdoor Behaviors in Large Language Models
- 2025SAID: Safety-Aware Intent Defense via Prefix Probing for Large Language Models
- 2026BASIS: Breach-Aware Selective Prompt Injection Shielding with Prefill Attention Probes
- 2026A Cross-Architecture Audit of Direction-Based Inference-Time Defences in Vision-Language Models