Large Language Lobotomy: Jailbreaking Mixture-of-Experts via Expert Silencing
On the map: LLM safety and security → Mixture-of-experts routing safety
Abstract (arXiv)
The rapid adoption of Mixture-of-Experts (MoE) architectures marks a major shift in the deployment of Large Language Models (LLMs). MoE LLMs improve scaling efficiency by activating only a small subset of parameters per token, but their routing structure introduces new safety attack surfaces. We find that safety-critical behaviors in MoE LLMs (e.g., refusal) are concentrated in a small set of experts rather than being uniformly distributed. Building on this, we propose Large Language Lobotomy (L3), a training-free, architecture-agnostic attack that compromises safety alignment by exploiting expert routing dynamics. L3 learns routing patterns that correlate with refusal, attributes safety behavior to specific experts, and adaptively silences the most safety-relevant experts until harmful outputs are produced. We evaluate L3 on eight state-of-the-art open-source MoE LLMs and show that our adaptive expert silencing increases average attack success from 7.3% to 70.4%, reaching up to 86.3%, outperforming prior training-free MoE jailbreak methods. Moreover, bypassing guardrails typically requires silencing fewer than 20% of layer-wise experts while largely preserving general language utility. These results reveal a fundamental tension between efficiency-driven MoE design and robust safety alignment and motivate distributing safety mechanisms more robustly in future MoE LLMs with architecture- and routing-aware methods.
Key facts. Cited by 4 papers in the map (data through 14 Oct 2026). Placed in Mixture-of-experts routing safety, one of 12 directions in LLM safety and security. Builds on 34 of its 42 references that are in the map. First posted on arXiv 9 Feb 2026.
Builds on
34 of 42 references.
Closest ancestors · 4
Same direction, newest first
- 2025GateBreaker: Gate-Guided Attacks on Mixture-of-Expert LLMs24 Dec
- 2025Steering MoE LLMs via Expert (De)Activation11 Sep
- 2025SAFEx: Analyzing Vulnerabilities of MoE-Based LLMs via Stable Safety-critical Expert Identification20 Jun
- 2025BadMoE: Backdooring Mixture-of-Experts LLMs via Optimizing Routing Triggers and Infecting Dormant Experts24 Apr
Other references · 30
- 2014Adam: A Method for Stochastic Optimizationcited by 37,240
- 2020Language Models are Few-Shot Learnerscited by 32,419
- 2022Training language models to follow instructions with human feedbackcited by 15,971
- 2025Qwen3 Technical Reportcited by 8,820
- 2017Outrageously Large Neural Networks: The Sparsely-Gated Mixture-of-Experts Layercited by 3,509
- 2023Universal and Transferable Adversarial Attacks on Aligned Language Modelscited by 3,104
- 2021Switch Transformers: Scaling to Trillion Parameter Models with Simple and Efficient Sparsitycited by 3,073
- 2022Constitutional AI: Harmlessness from AI Feedbackcited by 3,050
- 2024Mixtral of Expertscited by 1,823
- 2020GShard: Scaling Giant Models with Conditional Computation and Automatic Shardingcited by 1,631
- 2024Qwen2.5-Math Technical Report: Toward Mathematical Expert Model via Self-Improvementcited by 1,090
- 2024Gemma: Open Models Based on Gemini Research and Technologycited by 916
18 more
- 2024DeepSeekMoE: Towards Ultimate Expert Specialization in Mixture-of-Experts Language Modelscited by 867
- 2023AutoDAN: Generating Stealthy Jailbreak Prompts on Aligned Large Language Modelscited by 785
- 2024Phi-4 Technical Reportcited by 711
- 2022Mixture-of-Experts with Expert Choice Routingcited by 623
- 2024A StrongREJECT for Empty Jailbreakscited by 385
- 2021BASE Layers: Simplifying Training of Large, Sparse Modelscited by 320
- 2023Using an LLM to Help With Code Understandingcited by 228
- 2023Red-Teaming Large Language Models using Chain of Utterances for Safety-Alignmentcited by 223
- 2024ArtPrompt: ASCII Art-based Jailbreak Attacks against Aligned LLMscited by 216
- 2024Safety Layers in Aligned Large Language Models: The Key to LLM Securitycited by 134
- 2024Language Models are Homer Simpson! Safety Re-Alignment of Fine-tuned Language Models through Task Arithmeticcited by 112
- 2024Towards Understanding Safety Alignment: A Mechanistic Perspective from Safety Neuronscited by 53
- 2025NeuroStrike: Neuron-Level Attacks on Aligned LLMscited by 22
- 2025TwinBreak: Jailbreaking LLM Security Alignments based on Twin Promptscited by 19
- 2025Pangu Pro MoE: Mixture of Grouped Experts for Efficient Sparsitycited by 18
- 2025Adversarial Poetry as a Universal Single-Turn Jailbreak Mechanism in Large Language Modelscited by 15
- 2024Buffer Overflow in Mixture of Expertscited by 13
- 2023Dr. Jekyll and Mr. Hyde: Two Faces of LLMscited by 3
Built on by
Citing papers per year: 2026: 4.
4 papers.
- 2026RouteHijack: Routing-Aware Attack on Mixture-of-Experts LLMscited by 6
- 2026Decomposing Refusal Steering in Mixture-of-Experts Modelscited by 0
- 2026SEAL: Reinforcing Global Safety in Mixture-of-Experts through Shared Expert ALignmentcited by 0
- 2026BadEngram: Backdoor Attack on Gated Memory Components in LLMscited by 0
- 2026BadEngram: Backdoor Attack on Gated Memory Components in LLMs11 Sep 2026
- 2026SEAL: Reinforcing Global Safety in Mixture-of-Experts through Shared Expert ALignment2 Sep 2026
- 2026Decomposing Refusal Steering in Mixture-of-Experts Models2 Jun 2026
- 2026RouteHijack: Routing-Aware Attack on Mixture-of-Experts LLMs1 May 2026
Similar, not cited
Close in wording, no citation either way
- 2026RASA: Routing-Aware Safety Alignment for Mixture-of-Experts Models
- 2025Who Speaks for the Trigger? Dynamic Expert Routing in Backdoored Mixture-of-Experts Transformers
- 2026Misrouter: Exploiting Routing Mechanisms for Input-Only Attacks on Mixture-of-Experts LLMs
- 2025Exploiting the Experts: Unauthorized Compression in MoE-LLMs
- 2026Sparse Models, Sparse Safety: Unsafe Routes in Mixture-of-Experts LLMs
- 2024Stealing User Prompts from Mixture of Experts
- 2026MESA: Improving MoE Safety Alignment via Decentralized Expertise
- 2025Defending MoE LLMs against Harmful Fine-Tuning via Safety Routing Alignment