mlsanityData to 14 Oct 2026

RouteHijack: Routing-Aware Attack on Mixture-of-Experts LLMs

arXiv 2605.02946 ↗First posted 1 May 2026cs.LG cs.AIcited by 6

On the map: LLM alignment / RLHF / preference optimisation → Safety alignment and jailbreak attacks

also in 2 more
Abstract (arXiv)

Safety alignment is critical for the responsible deployment of large language models (LLMs). As Mixture-of-Experts (MoE) architectures are increasingly adopted to scale model capacity, understanding their safety robustness becomes essential. Existing adversarial attacks, however, have notable limitations. Prompt-based jailbreaks rely on heuristic search and transfer poorly, model intervention methods require privileged access to internal representations, and optimization-based input attacks remain output-centric and are fundamentally limited to MoE models due to the non-differentiable routing mechanism. In this paper, we present RouteHijack, a routing-aware jailbreak for MoE LLMs. Our key insight is that safety behavior is concentrated in a small subset of experts, creating an opportunity to steer model behavior by influencing routing decisions through input optimization. Building on this observation, RouteHijack first performs response-driven expert localization to identify safety-critical and harmful experts by contrasting activations under safe refusals and harmful completions. It then constructs adversarial suffixes with a routing-aware objective that suppresses safety experts, promotes harmful experts, and prevents early-stage refusal during generation. At inference time, the optimized suffix is appended to a malicious prompt, requiring only input access. Across seven MoE LLMs, RouteHijack achieves a 69.3% average attack success rate (ASR), outperforming prior optimization-based attack by 3.2×. RouteHijack also transfers zero-shot across five sibling MoE variants, raising average ASR from 27.7% to 61.2%, and further generalizes to three MoE-based VLMs, increasing average ASR from 2.47% to 38.7%. These findings expose a fundamental vulnerability in sparse expert architectures and highlight the need for defenses beyond output-level alignment.

Key facts. Cited by 6 papers in the map (data through 14 Oct 2026). Placed in Safety alignment and jailbreak attacks, one of 10 directions in LLM alignment / RLHF / preference optimisation. Builds on 45 of its 80 references that are in the map. First posted on arXiv 1 May 2026.

Builds on

45 of 80 references.

Closest ancestors · 7

Same direction, newest first

  1. 2025Beyond Surface Alignment: Rebuilding LLMs Safety Mechanism via Probabilistically Ablating Refusal Direction18 Sep
  2. 2025NeuroStrike: Neuron-Level Attacks on Aligned LLMs15 Sep
  3. 2025SAFEx: Analyzing Vulnerabilities of MoE-Based LLMs via Stable Safety-critical Expert Identification20 Jun
  4. 2025The dark deep side of DeepSeek: Fine-tuning attacks against the safety alignment of CoT-enabled models3 Feb
  5. 2024Safety Alignment Should Be Made More Than Just a Few Tokens Deep10 Jun
  6. 2023AutoDAN: Generating Stealthy Jailbreak Prompts on Aligned Large Language Models3 Oct
  7. 2023Universal and Transferable Adversarial Attacks on Aligned Language Models27 Jul

Other references · 38

  1. 2024The Llama 3 Herd of Modelscited by 14,715
  2. 2025Qwen3 Technical Reportcited by 8,820
  3. 2020Scaling Laws for Neural Language Modelscited by 6,586
  4. 2018Think you have Solved Question Answering? Try ARC, the AI2 Reasoning Challengecited by 4,886
  5. 2017Outrageously Large Neural Networks: The Sparsely-Gated Mixture-of-Experts Layercited by 3,509
  6. 2016Pointer Sentinel Mixture Modelscited by 3,096
  7. 2024Phi-3 Technical Report: A Highly Capable Language Model Locally on Your Phonecited by 1,917
  8. 2023Representation Engineering: A Top-Down Approach to AI Transparencycited by 1,336
  9. 2023Steering Language Models With Activation Engineeringcited by 922
  10. 2024DeepSeekMoE: Towards Ultimate Expert Specialization in Mixture-of-Experts Language Modelscited by 867
  11. 2024DeepSeek-V3 Technical Reportcited by 811
  12. 2023Instruction Tuning with GPT-4cited by 686
26 more
  1. 2025Kimi-VL Technical Reportcited by 388
  2. 2025Persona Vectors: Monitoring and Controlling Character Traits in Language Modelscited by 345
  3. 2023Challenges and Applications of Large Language Modelscited by 254
  4. 2024Jailbreak Attacks and Defenses Against Large Language Models: A Surveycited by 230
  5. 2024An Introduction to Vision-Language Modelingcited by 178
  6. 2024Latent Adversarial Training Improves Robustness to Persistent Harmful Behaviors in LLMscited by 173
  7. 2024AmpleGCG: Learning a Universal and Transferable Generative Model of Adversarial Suffixes for Jailbreaking Both Open and Closed LLMscited by 172
  8. 2025Qwen3Guard Technical Reportcited by 155
  9. 2024Jailbreaking Attack against Multimodal Large Language Modelcited by 135
  10. 2026Emergent Introspective Awareness in Large Language Modelscited by 82
  11. 2025Attention Sinks and Compression Valleys in LLMs are Two Sides of the Same Coincited by 52
  12. 2025Understanding (Un)Reliability of Steering Vectors in Language Modelscited by 47
  13. 2025Towards Greater Leverage: Scaling Laws for Efficient Mixture-of-Experts Language Modelscited by 45
  14. 2024AttnGCG: Enhancing Jailbreaking Attacks on LLMs with Attention Manipulationcited by 33
  15. 2025Steering MoE LLMs via Expert (De)Activationcited by 26
  16. 2024AdvPrefix: An Objective for Nuanced LLM Jailbreakscited by 25
  17. 2025Mixture of Experts Made Intrinsically Interpretablecited by 24
  18. 2025Understanding and Enhancing the Transferability of Jailbreaking Attackscited by 22
  19. 2025Pangu Pro MoE: Mixture of Grouped Experts for Efficient Sparsitycited by 18
  20. 2025BadMoE: Backdooring Mixture-of-Experts LLMs via Optimizing Routing Triggers and Infecting Dormant Expertscited by 14
  21. 2025GateBreaker: Gate-Guided Attacks on Mixture-of-Expert LLMscited by 11
  22. 2026Sparse Models, Sparse Safety: Unsafe Routes in Mixture-of-Experts LLMscited by 9
  23. 2026Large Language Lobotomy: Jailbreaking Mixture-of-Experts via Expert Silencingcited by 4
  24. 2025The Resurgence of GCG Adversarial Attacks on Large Language Modelscited by 3
  25. 2025Sparsity and Superposition in Mixture of Expertscited by 2
  26. 2025Progressive Behavioral Drift through Compression Valleys in Large Language Modelscited by 2

Built on by

Cited by year (2026 to 14 Oct)

Citing papers per year: 2026: 6.

6 papers.

Similar, not cited

Close in wording, no citation either way

  1. 2026Misrouter: Exploiting Routing Mechanisms for Input-Only Attacks on Mixture-of-Experts LLMs
  2. 2026SEAL: Reinforcing Global Safety in Mixture-of-Experts through Shared Expert ALignment
  3. 2026RASA: Routing-Aware Safety Alignment for Mixture-of-Experts Models
  4. 2026RASET: Router-Agnostic Safety-Critical Expert Tuning Exposes Localized Safety Enforcement Failures in Mixture-of-Experts LLMs
  5. 2026MESA: Improving MoE Safety Alignment via Decentralized Expertise
  6. 2025Defending MoE LLMs against Harmful Fine-Tuning via Safety Routing Alignment
  7. 2025RepetitionCurse: Measuring and Understanding Router Imbalance in Mixture-of-Experts LLMs under DoS Stress
  8. 2025Ban&Pick: Enhancing Performance and Efficiency of MoE-LLMs via Smarter Routing