mlsanityData to 7 Oct 2026

How Alignment Routes: Localizing, Scaling, and Controlling Policy Circuits in Language Models

arXiv 2604.04385 ↗First posted 6 Apr 2026cs.CL cs.AI cs.LGcited by 3

Not on the map. Why?

Abstract (arXiv)

We localize the policy routing mechanism in alignment-trained language models. An intermediate-layer attention gate reads detected content and triggers deeper amplifier heads that boost the signal toward refusal. In smaller models the gate and amplifier are single heads; at larger scale they become bands of heads across adjacent layers. The gate contributes under 1% of output DLA, yet interchange testing (p < 0.001) and knockout cascade confirm it is causally necessary. Interchange screening at n >= 120 detects the same motif in twelve models from six labs (2B to 72B), though specific heads differ by lab. Per-head ablation weakens up to 58x at 72B and misses gates that interchange identifies; at scale, interchange is the only reliable audit. Modulating the detection-layer signal continuously controls policy from hard refusal through evasion to factual answering. On safety prompts the same intervention turns refusal into harmful guidance, showing that the safety-trained capability is gated by routing, not removed. Thresholds vary by topic and by input language, and the circuit relocates across generations within a family even while behavioral benchmarks register no change. Routing is early-commitment: the gate fires at its own layer before deeper layers finish processing the input. An in-context substitution cipher collapses gate interchange necessity by 70 to 99% across three models, and the model switches to puzzle-solving rather than refusal. Injecting the plaintext gate activation into the cipher forward pass restores 48% of refusals in Phi-4-mini, localizing the bypass to the routing interface. A second method, cipher contrast analysis, uses plain/cipher DLA differences to map the full cipher-sensitive routing circuit in O(3n) forward passes. Any encoding that defeats detection-layer pattern matching bypasses the policy regardless of whether deeper layers reconstruct the content.

Key facts. Cited by 3 papers in the map (data through 7 Oct 2026). Builds on 13 of its 15 references that are in the map. First posted on arXiv 6 Apr 2026.

Builds on

13 of 15 references.

References · 13

  1. 2022Locating and Editing Factual Associations in GPTcited by 2,609
  2. 2023Representation Engineering: A Top-Down Approach to AI Transparencycited by 1,239
  3. 2022Interpretability in the Wild: a Circuit for Indirect Object Identification in GPT-2 smallcited by 1,130
  4. 2024Refusal in Language Models Is Mediated by a Single Directioncited by 960
  5. 2019Designing and Interpreting Probes with Control Taskscited by 608
  6. 2021Causal Abstractions of Neural Networkscited by 401
  7. 2025The Geometry of Refusal in Large Language Models: Concept Cones and Representational Independencecited by 104
  8. 2025LLMs Encode Harmfulness and Refusal Separatelycited by 75
  9. 2025Steering the CensorShip: Uncovering Representation Vectors for LLM "Thought" Controlcited by 14
  10. 2025Discovering Forbidden Topics in Language Modelscited by 8
  11. 2025Refusal Steering: Fine-grained Control over LLM Refusal Behaviour for Sensitive Topicscited by 5
  12. 2026Censored LLMs as a Natural Testbed for Secret Knowledge Elicitationcited by 5
1 more
  1. 2026Detection Is Cheap, Routing Is Learned: Why Refusal-Based Alignment Evaluation Failscited by 3

Built on by

Cited by year (2026 to 7 Oct)

Citing papers per year: 2026: 3.

3 papers.

Similar, not cited

Close in wording, no citation either way

  1. 2025Head-Specific Intervention Can Induce Misaligned AI Coordination in Large Language Models
  2. 2025Mitigating Over-Refusal in Aligned Large Language Models via Inference-Time Activation Energy
  3. 2026SafeEvo: Deciphering the Safety Alignment Mechanism and Evolution in Language Models
  4. 2026Localizing Safety Alignment: MLP Layers and Mid-Network Blocks Encode Refusal Behavior in Large Language Models
  5. 2026When Safety Routing Breaks: Understanding Alignment Fragility under Benign Fine-Tuning
  6. 2026The Geometry of Refusal: Linear Instability in Safety-Aligned LLMs
  7. 2026Mechanistic Interpretability for Large Language Model Alignment: Progress, Challenges, and Future Directions
  8. 2026Decided Upstream, Written Late: Locating and Pricing the Cross-Lingual Refusal Circuit of a Multilingual MoE