Repurposing Adversarial Perturbations for Continual Learning: From Defense to Active Alignment
Not on the map. Why?
Abstract (arXiv)
In dynamic environments, large language models need to keep adapting to new tasks, but continual learning often suffers from forgetting, limited transfer, and vulnerability to adversarial perturbations. To address this, we present AdvCL, which repurposes adversarial perturbations as a geometric control signal for stable continual adaptation. AdvCL combines three plug-in modules: Intra-Smooth promotes local smoothness via small adversarial perturbations; Proto-Clip uses similarity clipping to prevent excessive alignment to current task prototype; and Inter-Align applies directional alignment toward previous task prototype to reduce representational gaps. Experiments show consistent gains in both standard performance and robustness, with lower forgetting and stronger transfer. We further analyze key mechanisms by quantifying the sensitivity of Intra-Smooth to perturbation settings and the effect of Inter-Align on task similarity and geometric distance. In summary, the modules provide complementary gains when combined, and each can also be integrated individually into diverse CL paradigms, including replay, regularization, and dynamic architectures, thereby offering a geometric control mechanism for continual learning.
Key facts. No citing papers in the map yet (data through 14 Oct 2026). Builds on 34 of its 42 references that are in the map. First posted on arXiv 1 Jun 2026.
Builds on
34 of 42 references.
References · 34
- 2014Explaining and Harnessing Adversarial Examplescited by 7,364
- 2017Towards Deep Learning Models Resistant to Adversarial Attackscited by 6,415
- 2016Overcoming catastrophic forgetting in neural networkscited by 4,787
- 2019Parameter-Efficient Transfer Learning for NLPcited by 4,236
- 2021The Power of Scale for Parameter-Efficient Prompt Tuningcited by 3,795
- 2017Outrageously Large Neural Networks: The Sparsely-Gated Mixture-of-Experts Layercited by 3,509
- 2016iCaRL: Incremental Classifier and Representation Learningcited by 2,333
- 2015Character-level Convolutional Networks for Text Classificationcited by 2,330
- 2019Theoretically Principled Trade-off between Robustness and Accuracycited by 1,517
- 2020Sharpness-Aware Minimization for Efficiently Improving Generalizationcited by 1,417
- 2016Progressive Neural Networkscited by 1,361
- 2016On Large-Batch Training for Deep Learning: Generalization Gap and Sharp Minimacited by 1,352
22 more
- 2018Don't Give Me the Details, Just the Summary! Topic-Aware Convolutional Neural Networks for Extreme Summarizationcited by 1,317
- 2017Virtual Adversarial Training: A Regularization Method for Supervised and Semi-Supervised Learningcited by 920
- 2022Super-NaturalInstructions: Generalization via Declarative Instructions on 1600+ NLP Taskscited by 868
- 2019Adversarial NLI: A New Benchmark for Natural Language Understandingcited by 807
- 2021XL-Sum: Large-Scale Multilingual Abstractive Summarization for 44 Languagescited by 347
- 2023Orthogonal Subspace Learning for Language Model Continual Learningcited by 312
- 2019FreeLB: Enhanced Adversarial Training for Natural Language Understandingcited by 264
- 2019SMART: Robust and Efficient Fine-Tuning for Pre-trained Natural Language Models through Principled Regularized Optimizationcited by 254
- 2021Co2L: Contrastive Continual Learningcited by 244
- 2019Task2Vec: Task Embedding for Meta-Learningcited by 205
- 2020Better Fine-Tuning by Reducing Representational Collapsecited by 157
- 2024Mitigating Catastrophic Forgetting in Large Language Models with Self-Synthesized Rehearsalcited by 118
- 2019Sentence Embedding Alignment for Lifelong Relation Extractioncited by 70
- 2024Language Models Resist Alignment: Evidence From Data Compressioncited by 53
- 2022The Effect of Task Ordering in Continual Learningcited by 31
- 2022Consistent Representation Learning for Continual Relation Extractioncited by 28
- 2024Rehearsal-Free Modular and Compositional Continual Learning for Language Modelscited by 27
- 2024Disentangling and Mitigating the Impact of Task Similarity for Continual Learningcited by 19
- 2024SLIM: Let LLM Learn More and Forget Less with Soft LoRA and Identity Mixturecited by 19
- 2024Learning to Route for Dynamic Adapter Composition in Continual Learning with Language Modelscited by 11
- 2025Parameter-Efficient Continual Fine-Tuning: A Surveycited by 11
- 2024Maintaining Adversarial Robustness in Continuous Learningcited by 5
Built on by
Not cited yet.
Similar, not cited
Close in wording, no citation either way
- 2026Continual Learning with Vision-Language Models via Semantic-Geometry Preservation
- 2025Continual Learning in Vision-Language Models via Aligned Model Merging
- 2025Self-Evolving LLMs via Continual Instruction Tuning
- 2025Continual Learning for VLMs: A Survey and Taxonomy Beyond Forgetting
- 2026SAMBAR: Selective Anchoring via Method of Multipliers for Balanced Knowledge Acquisition and Retention in Vision-Language-Action Models
- 2024Dual-Phase Continual Learning: Supervised Adaptation Meets Unsupervised Retention
- 2025Revisiting Replay and Gradient Alignment for Continual Pre-Training of Large Language Models
- 2021Adversarial Targeted Forgetting in Regularization and Generative Based Continual Learning Models