RouteHijack: Routing-Aware Attack on Mixture-of-Experts LLMs
On the map: LLM alignment / RLHF / preference optimisation → Safety alignment and jailbreak attacks
also in 2 more
Abstract (arXiv)
Safety alignment is critical for the responsible deployment of large language models (LLMs). As Mixture-of-Experts (MoE) architectures are increasingly adopted to scale model capacity, understanding their safety robustness becomes essential. Existing adversarial attacks, however, have notable limitations. Prompt-based jailbreaks rely on heuristic search and transfer poorly, model intervention methods require privileged access to internal representations, and optimization-based input attacks remain output-centric and are fundamentally limited to MoE models due to the non-differentiable routing mechanism. In this paper, we present RouteHijack, a routing-aware jailbreak for MoE LLMs. Our key insight is that safety behavior is concentrated in a small subset of experts, creating an opportunity to steer model behavior by influencing routing decisions through input optimization. Building on this observation, RouteHijack first performs response-driven expert localization to identify safety-critical and harmful experts by contrasting activations under safe refusals and harmful completions. It then constructs adversarial suffixes with a routing-aware objective that suppresses safety experts, promotes harmful experts, and prevents early-stage refusal during generation. At inference time, the optimized suffix is appended to a malicious prompt, requiring only input access. Across seven MoE LLMs, RouteHijack achieves a 69.3% average attack success rate (ASR), outperforming prior optimization-based attack by 3.2×. RouteHijack also transfers zero-shot across five sibling MoE variants, raising average ASR from 27.7% to 61.2%, and further generalizes to three MoE-based VLMs, increasing average ASR from 2.47% to 38.7%. These findings expose a fundamental vulnerability in sparse expert architectures and highlight the need for defenses beyond output-level alignment.
Key facts. Cited by 6 papers in the map (data through 14 Oct 2026). Placed in Safety alignment and jailbreak attacks, one of 10 directions in LLM alignment / RLHF / preference optimisation. Builds on 45 of its 80 references that are in the map. First posted on arXiv 1 May 2026.
Builds on
45 of 80 references.
Closest ancestors · 7
Same direction, newest first
- 2025Beyond Surface Alignment: Rebuilding LLMs Safety Mechanism via Probabilistically Ablating Refusal Direction18 Sep
- 2025NeuroStrike: Neuron-Level Attacks on Aligned LLMs15 Sep
- 2025SAFEx: Analyzing Vulnerabilities of MoE-Based LLMs via Stable Safety-critical Expert Identification20 Jun
- 2025The dark deep side of DeepSeek: Fine-tuning attacks against the safety alignment of CoT-enabled models3 Feb
- 2024Safety Alignment Should Be Made More Than Just a Few Tokens Deep10 Jun
- 2023AutoDAN: Generating Stealthy Jailbreak Prompts on Aligned Large Language Models3 Oct
- 2023Universal and Transferable Adversarial Attacks on Aligned Language Models27 Jul
Other references · 38
- 2024The Llama 3 Herd of Modelscited by 14,715
- 2025Qwen3 Technical Reportcited by 8,820
- 2020Scaling Laws for Neural Language Modelscited by 6,586
- 2018Think you have Solved Question Answering? Try ARC, the AI2 Reasoning Challengecited by 4,886
- 2017Outrageously Large Neural Networks: The Sparsely-Gated Mixture-of-Experts Layercited by 3,509
- 2016Pointer Sentinel Mixture Modelscited by 3,096
- 2024Phi-3 Technical Report: A Highly Capable Language Model Locally on Your Phonecited by 1,917
- 2023Representation Engineering: A Top-Down Approach to AI Transparencycited by 1,336
- 2023Steering Language Models With Activation Engineeringcited by 922
- 2024DeepSeekMoE: Towards Ultimate Expert Specialization in Mixture-of-Experts Language Modelscited by 867
- 2024DeepSeek-V3 Technical Reportcited by 811
- 2023Instruction Tuning with GPT-4cited by 686
26 more
- 2025Kimi-VL Technical Reportcited by 388
- 2025Persona Vectors: Monitoring and Controlling Character Traits in Language Modelscited by 345
- 2023Challenges and Applications of Large Language Modelscited by 254
- 2024Jailbreak Attacks and Defenses Against Large Language Models: A Surveycited by 230
- 2024An Introduction to Vision-Language Modelingcited by 178
- 2024Latent Adversarial Training Improves Robustness to Persistent Harmful Behaviors in LLMscited by 173
- 2024AmpleGCG: Learning a Universal and Transferable Generative Model of Adversarial Suffixes for Jailbreaking Both Open and Closed LLMscited by 172
- 2025Qwen3Guard Technical Reportcited by 155
- 2024Jailbreaking Attack against Multimodal Large Language Modelcited by 135
- 2026Emergent Introspective Awareness in Large Language Modelscited by 82
- 2025Attention Sinks and Compression Valleys in LLMs are Two Sides of the Same Coincited by 52
- 2025Understanding (Un)Reliability of Steering Vectors in Language Modelscited by 47
- 2025Towards Greater Leverage: Scaling Laws for Efficient Mixture-of-Experts Language Modelscited by 45
- 2024AttnGCG: Enhancing Jailbreaking Attacks on LLMs with Attention Manipulationcited by 33
- 2025Steering MoE LLMs via Expert (De)Activationcited by 26
- 2024AdvPrefix: An Objective for Nuanced LLM Jailbreakscited by 25
- 2025Mixture of Experts Made Intrinsically Interpretablecited by 24
- 2025Understanding and Enhancing the Transferability of Jailbreaking Attackscited by 22
- 2025Pangu Pro MoE: Mixture of Grouped Experts for Efficient Sparsitycited by 18
- 2025BadMoE: Backdooring Mixture-of-Experts LLMs via Optimizing Routing Triggers and Infecting Dormant Expertscited by 14
- 2025GateBreaker: Gate-Guided Attacks on Mixture-of-Expert LLMscited by 11
- 2026Sparse Models, Sparse Safety: Unsafe Routes in Mixture-of-Experts LLMscited by 9
- 2026Large Language Lobotomy: Jailbreaking Mixture-of-Experts via Expert Silencingcited by 4
- 2025The Resurgence of GCG Adversarial Attacks on Large Language Modelscited by 3
- 2025Sparsity and Superposition in Mixture of Expertscited by 2
- 2025Progressive Behavioral Drift through Compression Valleys in Large Language Modelscited by 2
Built on by
Citing papers per year: 2026: 6.
6 papers.
- 2026RouteScan: A Non-Intrusive Approach to Auditing MoE LLMs Safety via Expert Routing Telemetrycited by 2
- 2026Securing Agentic AI: From Per-Action Checks to Trajectory Assurancecited by 1
- 2026Policy-Masked Private Experts: Auditable and Reversible Capability Access Control in Sparse MoE Modelscited by 0
- 2026NeuronFuzz: Safety Neuron Guided Fuzzing for LLM Safety Evaluationcited by 0
- 2026Frequency Is Not Sensitivity Identifying Safety-Sensitive Experts in Sparse MoE LLMcited by 0
- 2026Reading, Not Manipulating: Leveraging Router Logits for Multimodal Safety in MoE Vision-Language Modelscited by 0
- 2026Reading, Not Manipulating: Leveraging Router Logits for Multimodal Safety in MoE Vision-Language Models6 Oct 2026
- 2026Frequency Is Not Sensitivity Identifying Safety-Sensitive Experts in Sparse MoE LLM2 Oct 2026
- 2026NeuronFuzz: Safety Neuron Guided Fuzzing for LLM Safety Evaluation26 Aug 2026
- 2026Policy-Masked Private Experts: Auditable and Reversible Capability Access Control in Sparse MoE Models7 Aug 2026
- 2026Securing Agentic AI: From Per-Action Checks to Trajectory Assurance3 Aug 2026
- 2026RouteScan: A Non-Intrusive Approach to Auditing MoE LLMs Safety via Expert Routing Telemetry24 May 2026
Similar, not cited
Close in wording, no citation either way
- 2026Misrouter: Exploiting Routing Mechanisms for Input-Only Attacks on Mixture-of-Experts LLMs
- 2026SEAL: Reinforcing Global Safety in Mixture-of-Experts through Shared Expert ALignment
- 2026RASA: Routing-Aware Safety Alignment for Mixture-of-Experts Models
- 2026RASET: Router-Agnostic Safety-Critical Expert Tuning Exposes Localized Safety Enforcement Failures in Mixture-of-Experts LLMs
- 2026MESA: Improving MoE Safety Alignment via Decentralized Expertise
- 2025Defending MoE LLMs against Harmful Fine-Tuning via Safety Routing Alignment
- 2025RepetitionCurse: Measuring and Understanding Router Imbalance in Mixture-of-Experts LLMs under DoS Stress
- 2025Ban&Pick: Enhancing Performance and Efficiency of MoE-LLMs via Smarter Routing