mlsanityData to 7 Oct 2026

Capacity Overflow: A Blind Spot for Backdoor Attacks in Vision MoE

arXiv 2608.25371 ↗First posted 26 Aug 2026cs.CV cs.CRcited by 0

On the map: Mixture-of-experts → Vision mixture-of-experts

Abstract (arXiv)

Mixture-of-Experts (MoE) has become a prevalent paradigm for scaling Vision Transformers efficiently. To ensure computational scalability and prevent expert overload, Vision MoE architectures employ a capacity-bounded token dispatch mechanism, where each expert's processing budget depends on the inference batch size. This work identifies this batch-dependent behavior as an overlooked attack surface, and proposes a stealthy supply-chain backdoor attack that exploits this property through a three-phase framework. First, we inject a backdoor into an early MoE layer. Second, we train a neutralizer in a deeper MoE layer that suppresses the backdoor under normal capacity. Third, we configure a batch-adaptive capacity factor that preserves high capacity for small batches while reducing it for large batches, naturally disabling the neutralizer via token overflow at deployment-scale batch sizes. The attack remains in dormant mode during small-batch security audits and enters activation mode during large-batch deployment. Experiments on V-MoE and Swin-MoE across ImageNet-100 and GTSRB demonstrate activation-mode attack success rates of 76-87% with dormant-mode ASR below 9%, while evading Neural Cleanse, STRIP, Fine-Pruning, and Activation Clustering. Our findings reveal a fundamental security risk arising from batch-dependent execution in scalable Vision MoE architectures.

Key facts. No citing papers in the map yet (data through 7 Oct 2026). Placed in Vision mixture-of-experts, one of 12 directions in Mixture-of-experts. Builds on 25 of its 36 references that are in the map. First posted on arXiv 26 Aug 2026.

Builds on

25 of 36 references.

Closest ancestors · 1

Same direction, newest first

  1. 2021Scaling Vision with Sparse Mixture of Experts10 Jun

Other references · 24

  1. 2020An Image is Worth 16x16 Words: Transformers for Image Recognition at Scalecited by 29,915
  2. 2015Distilling the Knowledge in a Neural Networkcited by 10,076
  3. 2014ImageNet Large Scale Visual Recognition Challengecited by 8,441
  4. 2017Outrageously Large Neural Networks: The Sparsely-Gated Mixture-of-Experts Layercited by 3,413
  5. 2021Switch Transformers: Scaling to Trillion Parameter Models with Simple and Efficient Sparsitycited by 3,014
  6. 2020GShard: Scaling Giant Models with Conditional Computation and Automatic Shardingcited by 1,601
  7. 2019Contrastive Multiview Codingcited by 1,297
  8. 2021Swin Transformer V2: Scaling Up Capacity and Resolutioncited by 1,215
  9. 2021How to train your ViT? Data, Augmentation, and Regularization in Vision Transformerscited by 562
  10. 2018Fine-Pruning: Defending Against Backdooring Attacks on Deep Neural Networkscited by 550
  11. 2019STRIP: A Defence Against Trojan Attacks on Deep Neural Networkscited by 437
  12. 2018Detecting Backdoor Attacks on Deep Neural Networks by Activation Clusteringcited by 429
12 more
  1. 2020Reflection Backdoor: A Natural Backdoor Attack on Deep Neural Networkscited by 341
  2. 2022Tutel: Adaptive Mixture-of-Experts at Scalecited by 199
  3. 2019TBT: Targeted Neural Network Attack with Bit Trojancited by 112
  4. 2025Token Reduction Should Go Beyond Efficiency in Generative Models -- From Vision, Language to Multimodalitycited by 49
  5. 2020The Deep Learning Compiler: A Comprehensive Surveycited by 46
  6. 2023UNICORN: A Unified Backdoor Trigger Inversion Frameworkcited by 44
  7. 2021Can You Hear It? Backdoor Attacks via Ultrasonic Triggerscited by 41
  8. 2025MoEcho: Exploiting Side-Channel Attacks to Compromise User Privacy in Mixture-of-Experts LLMscited by 11
  9. 2025BadMoE: Backdooring Mixture-of-Experts LLMs via Optimizing Routing Triggers and Infecting Dormant Expertscited by 8
  10. 2024BAN: Detecting Backdoors Activated by Adversarial Neuron Noisecited by 7
  11. 2021FooBaR: Fault Fooling Backdoor Attack on Neural Network Trainingcited by 6
  12. 2025BadPatches: Routing-Aware Backdoor Attacks on Vision Mixture-of-Expertscited by 1

Built on by

Not cited yet.

Similar, not cited

Close in wording, no citation either way

  1. 2026Policy-Masked Private Experts: Auditable and Reversible Capability Access Control in Sparse MoE Models
  2. 2024Buffer Overflow in Mixture of Experts
  3. 2024Revisiting Backdoor Attacks against Large Vision-Language Models from Domain Shift
  4. 2026SEAL: Reinforcing Global Safety in Mixture-of-Experts through Shared Expert ALignment
  5. 2026MoE-ViE: Mixture of Experts Vision Encoder for Efficient Image and Video Understanding
  6. 2026When Does Sparse MoE Help in Vision? The Role of Backbone Compute Leverage in Sparse Routing
  7. 2026Improving MoE Compute Efficiency by Composing Weight and Data Sparsity
  8. 2026BYORn: Bootstrap Your Own Responses to Defend Large Vision-Language Models Against Backdoor Attacks