Shapley Neuron Values for Continual Learning: Which Neurons Matter Most?
Not on the map. Why?
Abstract (arXiv)
Continual learning enables neural networks to learn tasks sequentially without forgetting previously acquired knowledge. However, neural networks suffer from catastrophic forgetting, where learning new tasks degrades performance on earlier ones. We address this problem with Shapley Neuron Valuation (SNV), a principled framework that quantifies Neuron importance in continual learning, grounded in cooperative game theory. SNV selectively freezes important Neurons while keeping others plastic, enabling buffer-free continual learning without expanding architecture. Experiments on ImageNet-1k show that SNV consistently outperforms existing buffer-free methods. In particular, SNV improves accuracy by +2.88% in the class incremental learning and +6.46% in the task incremental learning scenarios compared to the second baseline.
Key facts. No citing papers in the map yet (data through 7 Oct 2026). Builds on 26 of its 37 references that are in the map. First posted on arXiv 15 May 2026.
Builds on
26 of 37 references.
References · 26
- 2015Deep Residual Learning for Image Recognitioncited by 51,809
- 2016Overcoming catastrophic forgetting in neural networkscited by 4,718
- 2015Delving Deep into Rectifiers: Surpassing Human-Level Performance on ImageNet Classificationcited by 3,590
- 2016Learning without Forgettingcited by 2,465
- 2016iCaRL: Incremental Classifier and Representation Learningcited by 2,313
- 2017Gradient Episodic Memory for Continual Learningcited by 1,871
- 2020Dark Experience for General Continual Learning: a Strong, Simple Baselinecited by 895
- 2023A Comprehensive Survey of Continual Learning: Theory, Method and Applicationcited by 860
- 2016Hyperband: A Novel Bandit-Based Approach to Hyperparameter Optimizationcited by 688
- 2019Linear Mode Connectivity and the Lottery Ticket Hypothesiscited by 627
- 2021DyTox: Transformers for Continual Learning with DYnamic TOken eXpansioncited by 291
- 2015Non-stochastic Best Arm Identification and Hyperparameter Optimizationcited by 219
14 more
- 2023Class-Incremental Learning: A Surveycited by 209
- 2022A Model or 603 Exemplars: Towards Memory-Efficient Class-Incremental Learningcited by 152
- 2024Continual Learning with Pre-Trained Models: A Surveycited by 151
- 2020Neuron Shapley: Discovering the Responsible Neuronscited by 98
- 2024Data Shapley in One Training Runcited by 76
- 2021Recent Advances of Continual Learning in Computer Vision: An Overviewcited by 55
- 2020SpaceNet: Make Free Space For Continual Learningcited by 53
- 2021Co-Transport for Class-Incremental Learningcited by 38
- 2022NISPA: Neuro-Inspired Stability-Plasticity Adaptation for Continual Learning in Sparse Networkscited by 38
- 2023Prediction Error-based Classification for Class-Incremental Learningcited by 14
- 2024Hyperparameters in Continual Learning: A Reality Checkcited by 11
- 2025On the Discrimination and Consistency for Exemplar-Free Class Incremental Learningcited by 8
- 2024Hyperparameter Selection in Continual Learningcited by 2
- 2025No Forgetting Learning: Buffer-free Continual Learning Classificationcited by 1
Built on by
Not cited yet.