Latent Space Refusal Anchoring for Low-Resource African Languages: Mechanistic Safety Recovery Without Retraining
On the map: LLM safety and security → Safety alignment, refusal and guardrails
also in 1 more
Abstract (arXiv)
Instruction-tuned models often refuse harmful requests in English but comply with the same requests in Yoruba, Igbo, Igala, and Hausa. This suggests that the refusal mechanism is present in the residual stream but fails to activate for low-resource inputs. Recovering it normally requires labelled target-language data and retraining, neither of which is available at scale for most African languages. We introduce Latent Space Refusal Anchoring (LSR-Anchoring), a training-free method that extracts the refusal direction from English prompts and clamps it onto the residual stream at inference time. The primary variant, Mean-Activation Steering (MAS), operates across the four architectures we tested: Llama-3-8B, Llama-3.1-70B, Mistral-7B-Instruct, and Qwen2.5-7B. On Mistral and Qwen it recovers safety with benign degradation below 0.08. On Llama-3-8B it overcorrects, with Degraded Performance on Legitimate prompts (DPL) reaching 1.00. We address this with SAE-Derived Steering (SDS), which replaces the dense mean-difference direction with a single Sparse Autoencoder (SAE) feature and reduces Kullback-Leibler (KL) divergence by 3.5-7x without benign collapse. Four languages transfer positively, but Arabic fails on every architecture and at every steering magnitude, indicating a geometric mismatch rather than a baseline effect. Massive Multitask Language Understanding (MMLU) accuracy drops remain below 0.35 percentage points at every effective steering magnitude.
Key facts. No citing papers in the map yet (data through 14 Oct 2026). Placed in Safety alignment, refusal and guardrails, one of 12 directions in LLM safety and security. Builds on 11 of its 13 references that are in the map. First posted on arXiv 5 Jun 2026.
Builds on
11 of 13 references.
Closest ancestors · 3
Same direction, newest first
- 2026Align Once, Benefit Multilingually: Enforcing Multilingual Consistency for LLM Safety Alignment18 Feb
- 2025The Rogue Scalpel: Activation Steering Compromises LLM Safety26 Sep
- 2024Refusal in Language Models Is Mediated by a Single Direction17 Jun
Other references · 8
- 2023Sparse Autoencoders Find Highly Interpretable Features in Language Modelscited by 1,420
- 2023Steering Llama 2 via Contrastive Activation Additioncited by 1,085
- 2023Low-Resource Languages Jailbreak GPT-4cited by 309
- 2024Do Llamas Work in English? On the Latent Language of Multilingual Transformerscited by 281
- 2023Multilingual Jailbreak Challenges in Large Language Modelscited by 240
- 2026Scaling Monosemanticity: Extracting Interpretable Features from Claude 3 Sonnetcited by 191
- 2023Not All Languages Are Created Equal in LLMs: Improving Multilingual Capability by Cross-Lingual-Thought Promptingcited by 165
- 2024The Language Barrier: Dissecting Safety Challenges of LLMs in Multilingual Contextscited by 94
Built on by
Not cited yet.
Similar, not cited
Close in wording, no citation either way
- 2026LSR: Linguistic Safety Robustness Benchmark for Low-Resource West African Languages
- 2026SomaliBench Eval: Measuring English-to-Somali Refusal Gaps in Open-Weight Language Models
- 2026Low-Resource Safety Failures Are Action Failures, Not Representation Failures
- 2026Latent-space Attacks for Refusal Evasion in Language Models
- 2024Steering Language Model Refusal with Sparse Autoencoders
- 2026The Illusion of Cross-Lingual Safety in Low-Resource Languages
- 2026TukaBench: A Culturally Grounded Jailbreak Benchmark for African Languages
- 2025Anchoring Refusal Direction: Mitigating Safety Risks in Tuning via Projection Constraint