Capacity Overflow: A Blind Spot for Backdoor Attacks in Vision MoE
On the map: Mixture-of-experts → Vision mixture-of-experts
Abstract (arXiv)
Mixture-of-Experts (MoE) has become a prevalent paradigm for scaling Vision Transformers efficiently. To ensure computational scalability and prevent expert overload, Vision MoE architectures employ a capacity-bounded token dispatch mechanism, where each expert's processing budget depends on the inference batch size. This work identifies this batch-dependent behavior as an overlooked attack surface, and proposes a stealthy supply-chain backdoor attack that exploits this property through a three-phase framework. First, we inject a backdoor into an early MoE layer. Second, we train a neutralizer in a deeper MoE layer that suppresses the backdoor under normal capacity. Third, we configure a batch-adaptive capacity factor that preserves high capacity for small batches while reducing it for large batches, naturally disabling the neutralizer via token overflow at deployment-scale batch sizes. The attack remains in dormant mode during small-batch security audits and enters activation mode during large-batch deployment. Experiments on V-MoE and Swin-MoE across ImageNet-100 and GTSRB demonstrate activation-mode attack success rates of 76-87% with dormant-mode ASR below 9%, while evading Neural Cleanse, STRIP, Fine-Pruning, and Activation Clustering. Our findings reveal a fundamental security risk arising from batch-dependent execution in scalable Vision MoE architectures.
Key facts. No citing papers in the map yet (data through 7 Oct 2026). Placed in Vision mixture-of-experts, one of 12 directions in Mixture-of-experts. Builds on 25 of its 36 references that are in the map. First posted on arXiv 26 Aug 2026.
Builds on
25 of 36 references.
Closest ancestors · 1
Same direction, newest first
Other references · 24
- 2020An Image is Worth 16x16 Words: Transformers for Image Recognition at Scalecited by 29,915
- 2015Distilling the Knowledge in a Neural Networkcited by 10,076
- 2014ImageNet Large Scale Visual Recognition Challengecited by 8,441
- 2017Outrageously Large Neural Networks: The Sparsely-Gated Mixture-of-Experts Layercited by 3,413
- 2021Switch Transformers: Scaling to Trillion Parameter Models with Simple and Efficient Sparsitycited by 3,014
- 2020GShard: Scaling Giant Models with Conditional Computation and Automatic Shardingcited by 1,601
- 2019Contrastive Multiview Codingcited by 1,297
- 2021Swin Transformer V2: Scaling Up Capacity and Resolutioncited by 1,215
- 2021How to train your ViT? Data, Augmentation, and Regularization in Vision Transformerscited by 562
- 2018Fine-Pruning: Defending Against Backdooring Attacks on Deep Neural Networkscited by 550
- 2019STRIP: A Defence Against Trojan Attacks on Deep Neural Networkscited by 437
- 2018Detecting Backdoor Attacks on Deep Neural Networks by Activation Clusteringcited by 429
12 more
- 2020Reflection Backdoor: A Natural Backdoor Attack on Deep Neural Networkscited by 341
- 2022Tutel: Adaptive Mixture-of-Experts at Scalecited by 199
- 2019TBT: Targeted Neural Network Attack with Bit Trojancited by 112
- 2025Token Reduction Should Go Beyond Efficiency in Generative Models -- From Vision, Language to Multimodalitycited by 49
- 2020The Deep Learning Compiler: A Comprehensive Surveycited by 46
- 2023UNICORN: A Unified Backdoor Trigger Inversion Frameworkcited by 44
- 2021Can You Hear It? Backdoor Attacks via Ultrasonic Triggerscited by 41
- 2025MoEcho: Exploiting Side-Channel Attacks to Compromise User Privacy in Mixture-of-Experts LLMscited by 11
- 2025BadMoE: Backdooring Mixture-of-Experts LLMs via Optimizing Routing Triggers and Infecting Dormant Expertscited by 8
- 2024BAN: Detecting Backdoors Activated by Adversarial Neuron Noisecited by 7
- 2021FooBaR: Fault Fooling Backdoor Attack on Neural Network Trainingcited by 6
- 2025BadPatches: Routing-Aware Backdoor Attacks on Vision Mixture-of-Expertscited by 1
Built on by
Not cited yet.
Similar, not cited
Close in wording, no citation either way
- 2026Policy-Masked Private Experts: Auditable and Reversible Capability Access Control in Sparse MoE Models
- 2024Buffer Overflow in Mixture of Experts
- 2024Revisiting Backdoor Attacks against Large Vision-Language Models from Domain Shift
- 2026SEAL: Reinforcing Global Safety in Mixture-of-Experts through Shared Expert ALignment
- 2026MoE-ViE: Mixture of Experts Vision Encoder for Efficient Image and Video Understanding
- 2026When Does Sparse MoE Help in Vision? The Role of Backbone Compute Leverage in Sparse Routing
- 2026Improving MoE Compute Efficiency by Composing Weight and Data Sparsity
- 2026BYORn: Bootstrap Your Own Responses to Defend Large Vision-Language Models Against Backdoor Attacks