mlsanityData to 14 Oct 2026

Actionable Activation Directions for Detecting and Mitigating Emergent Misalignment Across Language Model Families

arXiv 2606.20225 ↗First posted 18 Jun 2026cs.CLcited by 1

Not on the map. Why?

Abstract (arXiv)

Fine-tuning language models on insecure code induces emergent misalignment with poorly understood internal structure. We investigate whether this misalignment corresponds to a causally actionable activation-space direction shared across architectures. Across four instruction-tuned model families (Qwen2.5-1.5B, Gemma-2-2B, Llama-3.2-1B, Ministral-3-3B) finetuned identically, a difference-in-means direction achieves 99.6% separation of aligned and misaligned activations at each model's final layer. Causal steering by subtracting this direction reduces code spillover by 21-51 points, while a secure-code control confirms content specificity. Cross-architecture transfer via ridge regression maps yields large behavioral suppression (up to 46 points) but fails specificity controls as random and orthogonal directions perform comparably. We identify a two-tier specificity structure: within-model directions are causally specific and actionable; cross-model directions are causally real but non-specific. An asymmetric transfer topology emerges, with Gemma and Qwen acting as geometric donors and Llama as a receiver. These findings define the limits of linear cross-architecture correction and recommend within-model probing for auditing.

Key facts. Cited by 1 paper in the map (data through 14 Oct 2026). Builds on 10 of its 11 references that are in the map. First posted on arXiv 18 Jun 2026.

Builds on

10 of 11 references.

References · 10

  1. 2023Representation Engineering: A Top-Down Approach to AI Transparencycited by 1,336
  2. 2023Steering Llama 2 via Contrastive Activation Additioncited by 1,085
  3. 2023Steering Language Models With Activation Engineeringcited by 922
  4. 2025Emergent Misalignment: Narrow finetuning can produce broadly misaligned LLMscited by 172
  5. 2025Model Organisms for Emergent Misalignmentcited by 91
  6. 2025Convergent Linear Representations of Emergent Misalignmentcited by 71
  7. 2025Steering Out-of-Distribution Generalization with Concept Ablation Fine-Tuningcited by 39
  8. 2026Cross-Architecture Model Diffing with Crosscoders: Unsupervised Discovery of Differences Between LLMscited by 12
  9. 2026BLOCK-EM: Preventing Emergent Misalignment via Latent Blockingcited by 3
  10. 2026Cross-Generational Transfer of Adversarial Attacks Reveals Non-Monotonic Safety Alignment in LLMscited by 1

Built on by

Cited by year (2026 to 14 Oct)

Citing papers per year: 2026: 1.

1 paper.