mlsanityData to 7 Oct 2026

Robust Dynamic Expansion for Continual Learning under Backdoor Attacks via Purification and Selective Recovery

arXiv 2609.06346 ↗First posted 6 Sep 2026cs.LG cs.CRcited by 0

On the map: Mixture-of-experts → Mixture of LoRA experts

Abstract (arXiv)

Continual learning (CL) enables models to acquire new knowledge from sequentially arriving tasks while retaining previously learned knowledge. However, in practical scenarios, task streams collected from untrusted sources may contain backdoor-poisoned samples, posing a critical challenge to the stability, plasticity, and security of continual learners. In this work, we investigate a challenging setting termed Continual Learning Under Backdoor Attack (CLUBA), where each incremental task may involve a small proportion of maliciously manipulated training samples. Unlike conventional continual learning or backdoor defense scenarios, CLUBA requires models to simultaneously mitigate catastrophic forgetting, preserve adaptation capability, and prevent the absorption of malicious supervision during sequential updates. To address this challenge, we propose a robust dynamic-expansion framework that integrates sample purification, selective recovery, and robust expert routing into a unified continual learning paradigm. Specifically, we introduce Bi-Prototype Purification (BPP) to identify suspicious samples by exploiting semantic discrepancies in feature space. Based on purified data, Gradient Discrepancy-based Robustness Optimization (GDBRO) selectively recovers informative poisoned samples through pseudo-label correction and gradient consistency evaluation, improving robustness while maintaining model plasticity. Furthermore, Robust Feature Consistency-based Expert Selection (RFCBES) constructs perturbation-aware class prototypes to enable reliable expert routing under corrupted or shifted inputs.

Key facts. No citing papers in the map yet (data through 7 Oct 2026). Placed in Mixture of LoRA experts, one of 12 directions in Mixture-of-experts. Builds on 39 of its 58 references that are in the map. First posted on arXiv 6 Sep 2026.

Builds on

39 of 58 references.

References · 39

  1. 2016Overcoming catastrophic forgetting in neural networkscited by 4,718
  2. 2016Learning without Forgettingcited by 2,465
  3. 2016iCaRL: Incremental Classifier and Representation Learningcited by 2,313
  4. 2017Gradient Episodic Memory for Continual Learningcited by 1,871
  5. 2016Progressive Neural Networkscited by 1,332
  6. 2017Memory Aware Synapses: Learning what (not) to forgetcited by 1,094
  7. 2018Experience Replay for Continual Learningcited by 1,074
  8. 2018Efficient Lifelong Learning with A-GEMcited by 1,044
  9. 2017Targeted Backdoor Attacks on Deep Learning Systems Using Data Poisoningcited by 1,012
  10. 2021Learning to Prompt for Continual Learningcited by 938
  11. 2020Dark Experience for General Continual Learning: a Strong, Simple Baselinecited by 895
  12. 2017PackNet: Adding Multiple Tasks to a Single Network by Iterative Pruningcited by 882
27 more
  1. 2022DualPrompt: Complementary Prompting for Rehearsal-free Continual Learningcited by 635
  2. 2018Fine-Pruning: Defending Against Backdooring Attacks on Deep Neural Networkscited by 550
  3. 2022CODA-Prompt: COntinual Decomposed Attention-based Prompting for Rehearsal-Free Continual Learningcited by 446
  4. 2019STRIP: A Defence Against Trojan Attacks on Deep Neural Networkscited by 437
  5. 2018Detecting Backdoor Attacks on Deep Neural Networks by Activation Clusteringcited by 429
  6. 2020Backdoor Learning: A Surveycited by 412
  7. 2021Dynamic Neural Networks: A Surveycited by 405
  8. 2019Online Continual Learning with Maximally Interfered Retrievalcited by 376
  9. 2021Neural Attention Distillation: Erasing Backdoor Triggers from Deep Neural Networkscited by 313
  10. 2021DyTox: Transformers for Continual Learning with DYnamic TOken eXpansioncited by 291
  11. 2021Rainbow Memory: Continual Learning with a Memory of Diverse Samplescited by 273
  12. 2021Anti-Backdoor Learning: Training Clean Models on Poisoned Datacited by 258
  13. 2021Adversarial Neuron Pruning Purifies Backdoored Deep Modelscited by 230
  14. 2021New Insights on Reducing Abrupt Representation Change in Online Continual Learningcited by 215
  15. 2021Adversarial Unlearning of Backdoors via Implicit Hypergradientcited by 160
  16. 2022Backdoor Defense via Decoupling the Training Processcited by 149
  17. 2023A Unified Continual Learning Framework with General Parameter-Efficient Tuningcited by 124
  18. 2023Hierarchical Decomposition of Prompt-Based Continual Learning: Rethinking Obscured Sub-optimalitycited by 121
  19. 2023Enhancing Fine-Tuning Based Backdoor Defense with Sharpness-Aware Minimizationcited by 60
  20. 2024Self-Expansion of Pre-trained Models with Mixture of Adapters for Continual Learningcited by 53
  21. 2023Create Your World: Lifelong Text-to-Image Diffusioncited by 46
  22. 2022Fine-Tuning Is All You Need to Mitigate Backdoor Attackscited by 35
  23. 2025BadToken: Token-level Backdoor Attacks to Multi-modal Large Language Modelscited by 15
  24. 2024Persistent Backdoor Attacks in Continual Learningcited by 11
  25. 2021Adversarial Targeted Forgetting in Regularization and Generative Based Continual Learning Modelscited by 9
  26. 2023Adversarial Robust Memory-Based Continual Learnercited by 5
  27. 2024Defense without Forgetting: Continual Adversarial Defense with Anisotropic & Isotropic Pseudo Replaycited by 3

Built on by

Not cited yet.

Similar, not cited

Close in wording, no citation either way

  1. 2023Leveraging Diffusion-Based Image Variations for Robust Training on Poisoned Data
  2. 2026Backdoor Containment via Expert Quarantine and Shutdown in LLMs
  3. 2026CS-GBA: A Critical Sample-based Gradient-guided Backdoor Attack for Offline Reinforcement Learning
  4. 2026Anchoring Bias: A Persistent Fairness Backdoor Attack against MLLMs under Continual Learning
  5. 2023Instructions as Backdoors: Backdoor Vulnerabilities of Instruction Tuning for Large Language Models
  6. 2026STAR: Detecting Inference-time Backdoors in LLM Reasoning via State-Transition Amplification Ratio
  7. 2026COPA: Continual Preference Optimization for Adaptive Prompt Injection Defense
  8. 2025Robust Anti-Backdoor Instruction Tuning in LVLMs