How Alignment Routes: Localizing, Scaling, and Controlling Policy Circuits in Language Models
Not on the map. Why?
Abstract (arXiv)
We localize the policy routing mechanism in alignment-trained language models. An intermediate-layer attention gate reads detected content and triggers deeper amplifier heads that boost the signal toward refusal. In smaller models the gate and amplifier are single heads; at larger scale they become bands of heads across adjacent layers. The gate contributes under 1% of output DLA, yet interchange testing (p < 0.001) and knockout cascade confirm it is causally necessary. Interchange screening at n >= 120 detects the same motif in twelve models from six labs (2B to 72B), though specific heads differ by lab. Per-head ablation weakens up to 58x at 72B and misses gates that interchange identifies; at scale, interchange is the only reliable audit. Modulating the detection-layer signal continuously controls policy from hard refusal through evasion to factual answering. On safety prompts the same intervention turns refusal into harmful guidance, showing that the safety-trained capability is gated by routing, not removed. Thresholds vary by topic and by input language, and the circuit relocates across generations within a family even while behavioral benchmarks register no change. Routing is early-commitment: the gate fires at its own layer before deeper layers finish processing the input. An in-context substitution cipher collapses gate interchange necessity by 70 to 99% across three models, and the model switches to puzzle-solving rather than refusal. Injecting the plaintext gate activation into the cipher forward pass restores 48% of refusals in Phi-4-mini, localizing the bypass to the routing interface. A second method, cipher contrast analysis, uses plain/cipher DLA differences to map the full cipher-sensitive routing circuit in O(3n) forward passes. Any encoding that defeats detection-layer pattern matching bypasses the policy regardless of whether deeper layers reconstruct the content.
Key facts. Cited by 3 papers in the map (data through 7 Oct 2026). Builds on 13 of its 15 references that are in the map. First posted on arXiv 6 Apr 2026.
Builds on
13 of 15 references.
References · 13
- 2022Locating and Editing Factual Associations in GPTcited by 2,609
- 2023Representation Engineering: A Top-Down Approach to AI Transparencycited by 1,239
- 2022Interpretability in the Wild: a Circuit for Indirect Object Identification in GPT-2 smallcited by 1,130
- 2024Refusal in Language Models Is Mediated by a Single Directioncited by 960
- 2019Designing and Interpreting Probes with Control Taskscited by 608
- 2021Causal Abstractions of Neural Networkscited by 401
- 2025The Geometry of Refusal in Large Language Models: Concept Cones and Representational Independencecited by 104
- 2025LLMs Encode Harmfulness and Refusal Separatelycited by 75
- 2025Steering the CensorShip: Uncovering Representation Vectors for LLM "Thought" Controlcited by 14
- 2025Discovering Forbidden Topics in Language Modelscited by 8
- 2025Refusal Steering: Fine-grained Control over LLM Refusal Behaviour for Sensitive Topicscited by 5
- 2026Censored LLMs as a Natural Testbed for Secret Knowledge Elicitationcited by 5
Built on by
Citing papers per year: 2026: 3.
3 papers.
Similar, not cited
Close in wording, no citation either way
- 2025Head-Specific Intervention Can Induce Misaligned AI Coordination in Large Language Models
- 2025Mitigating Over-Refusal in Aligned Large Language Models via Inference-Time Activation Energy
- 2026SafeEvo: Deciphering the Safety Alignment Mechanism and Evolution in Language Models
- 2026Localizing Safety Alignment: MLP Layers and Mid-Network Blocks Encode Refusal Behavior in Large Language Models
- 2026When Safety Routing Breaks: Understanding Alignment Fragility under Benign Fine-Tuning
- 2026The Geometry of Refusal: Linear Instability in Safety-Aligned LLMs
- 2026Mechanistic Interpretability for Large Language Model Alignment: Progress, Challenges, and Future Directions
- 2026Decided Upstream, Written Late: Locating and Pricing the Cross-Lingual Refusal Circuit of a Multilingual MoE