Overcoming Catastrophic Forgetting by Neuron-level Plasticity Control
Not on the map. Why?
Abstract (arXiv)
To address the issue of catastrophic forgetting in neural networks, we propose a novel, simple, and effective solution called neuron-level plasticity control (NPC). While learning a new task, the proposed method preserves the knowledge for the previous tasks by controlling the plasticity of the network at the neuron level. NPC estimates the importance value of each neuron and consolidates important textitneurons by applying lower learning rates, rather than restricting individual connection weights to stay close to certain values. The experimental results on the incremental MNIST (iMNIST) and incremental CIFAR100 (iCIFAR100) datasets show that neuron-level consolidation is substantially more effective compared to the connection-level consolidation approaches.
Key facts. Cited by 36 papers in the map (data through 14 Oct 2026). First posted on arXiv 31 Jul 2019.
Builds on
No reference list yet.
Built on by
Citing papers per year: 2021: 3; 2022: 5; 2023: 6; 2024: 13; 2025: 5; 2026: 4.
36 papers.
Sort:
By area:
- 2023A Comprehensive Survey of Continual Learning: Theory, Method and Applicationcited by 872
- 2021Training Networks in Null Space of Feature Covariance for Continual Learningcited by 143
- 2024Continual Learning and Catastrophic Forgettingcited by 77
- 2022Don't Stop Learning: Towards Continual Learning for the CLIP Modelcited by 61
- 2025CL-MoE: Enhancing Multimodal Large Language Model with Dual Momentum Mixture-of-Experts for Continual Visual Question Answeringcited by 37
- 2022Meta-attention for ViT-backed Continual Learningcited by 29
- 2024VLM-PL: Advanced Pseudo Labeling Approach for Class Incremental Object Detection via Vision-Language Modelcited by 23
- 2021Unsupervised Continual Learning via Self-Adaptive Deep Clustering Approachcited by 19
- 2021Continual Learning via Inter-Task Synaptic Mappingcited by 14
- 2024Empowering Large Language Model for Continual Video Question Answering with Collaborative Promptingcited by 14
- 2022CNLL: A Semi-supervised Approach For Continual Noisy Label Learningcited by 8
- 2024DaCapo: Accelerating Continuous Learning in Autonomous Systems for Video Analyticscited by 8
24 more
- 2024Continual Learning with Neuromorphic Computing: Foundations, Methods, and Emerging Applicationscited by 8
- 2023Assessor-Guided Learning for Continual Environmentscited by 7
- 2022Scalable Adversarial Online Continual Learningcited by 6
- 2024Dynamic Object Queries for Transformer-based Incremental Object Detectioncited by 6
- 2023Robust Feature Learning and Global Variance-Driven Classifier Alignment for Long-Tail Class Incremental Learningcited by 5
- 2023Few-Shot Continual Learning via Flat-to-Wide Approachescited by 4
- 2024Few-Shot Class Incremental Learning via Robust Transformer Approachcited by 4
- 2024Diffusion Model Meets Non-Exemplar Class-Incremental Learning and Beyondcited by 4
- 2023IF2Net: Innately Forgetting-Free Networks for Continual Learningcited by 3
- 2025Continual Knowledge Consolidation LORA for Domain Incremental Learningcited by 2
- 2023Continual Learning through Networks Splitting and Merging with Dreaming-Meta-Weighted Model Fusioncited by 1
- 2024Cross-Domain Continual Learning via CLAMPcited by 1
- 2024Forward-Backward Knowledge Distillation for Continual Clusteringcited by 1
- 2024Decision Boundary-aware Knowledge Consolidation Generates Better Instance-Incremental Learnercited by 1
- 2024Unsupervised Few-Shot Continual Learning for Remote Sensing Image Scene Classificationcited by 1
- 2022Sketch of a novel approach to a neural modelcited by 0
- 2024One Stone, Four Birds: A Comprehensive Solution for QA System Using Supervised Contrastive Learningcited by 0
- 2025Neuron-level Balance between Stability and Plasticity in Deep Reinforcement Learningcited by 0
- 2025Index-Aligned Query Distillation for Transformer-based Incremental Object Detectioncited by 0
- 2025Source-Free Cross-Domain Continual Learningcited by 0
- 2026MacVQA: Adaptive Memory Allocation and Global Noise Filtering for Continual Visual Question Answeringcited by 0
- 2026HyLoVQA: Dynamic Hypernetwork-Generated Low-Rank Adaptation for Continual Visual Question Answeringcited by 0
- 2026Unsupervised Continual Clustering via Forward-Backward Knowledge Distillationcited by 0
- 2026Few-Shot Domain Incremental Learning via Continual Vision-Language Consolidationcited by 0
- 2026Few-Shot Domain Incremental Learning via Continual Vision-Language Consolidation29 Jun 2026
- 2026Unsupervised Continual Clustering via Forward-Backward Knowledge Distillation5 Jun 2026
- 2026HyLoVQA: Dynamic Hypernetwork-Generated Low-Rank Adaptation for Continual Visual Question Answering21 May 2026
- 2026MacVQA: Adaptive Memory Allocation and Global Noise Filtering for Continual Visual Question Answering5 Jan 2026
- 2025Continual Knowledge Consolidation LORA for Domain Incremental Learning17 Oct 2025
- 2025Source-Free Cross-Domain Continual Learning2 Oct 2025
- 2025Index-Aligned Query Distillation for Transformer-based Incremental Object Detection15 Aug 2025
- 2025Neuron-level Balance between Stability and Plasticity in Deep Reinforcement Learning9 Apr 2025
- 2025CL-MoE: Enhancing Multimodal Large Language Model with Dual Momentum Mixture-of-Experts for Continual Visual Question Answering1 Mar 2025
- 2024Continual Learning with Neuromorphic Computing: Foundations, Methods, and Emerging Applications11 Oct 2024
- 2024Empowering Large Language Model for Continual Video Question Answering with Collaborative Prompting1 Oct 2024
- 2024Diffusion Model Meets Non-Exemplar Class-Incremental Learning and Beyond6 Aug 2024
24 more
- 2024Dynamic Object Queries for Transformer-based Incremental Object Detection31 Jul 2024
- 2024One Stone, Four Birds: A Comprehensive Solution for QA System Using Supervised Contrastive Learning12 Jul 2024
- 2024Decision Boundary-aware Knowledge Consolidation Generates Better Instance-Incremental Learner5 Jun 2024
- 2024Unsupervised Few-Shot Continual Learning for Remote Sensing Image Scene Classification4 Jun 2024
- 2024Forward-Backward Knowledge Distillation for Continual Clustering29 May 2024
- 2024Cross-Domain Continual Learning via CLAMP12 May 2024
- 2024Few-Shot Class Incremental Learning via Robust Transformer Approach8 May 2024
- 2024DaCapo: Accelerating Continuous Learning in Autonomous Systems for Video Analytics21 Mar 2024
- 2024VLM-PL: Advanced Pseudo Labeling Approach for Class Incremental Object Detection via Vision-Language Model8 Mar 2024
- 2024Continual Learning and Catastrophic Forgetting8 Mar 2024
- 2023Continual Learning through Networks Splitting and Merging with Dreaming-Meta-Weighted Model Fusion12 Dec 2023
- 2023Robust Feature Learning and Global Variance-Driven Classifier Alignment for Long-Tail Class Incremental Learning2 Nov 2023
- 2023Few-Shot Continual Learning via Flat-to-Wide Approaches26 Jun 2023
- 2023IF2Net: Innately Forgetting-Free Networks for Continual Learning18 Jun 2023
- 2023Assessor-Guided Learning for Continual Environments21 Mar 2023
- 2023A Comprehensive Survey of Continual Learning: Theory, Method and Application31 Jan 2023
- 2022Sketch of a novel approach to a neural model14 Sep 2022
- 2022Scalable Adversarial Online Continual Learning4 Sep 2022
- 2022Don't Stop Learning: Towards Continual Learning for the CLIP Model19 Jul 2022
- 2022CNLL: A Semi-supervised Approach For Continual Noisy Label Learning21 Apr 2022
- 2022Meta-attention for ViT-backed Continual Learning22 Mar 2022
- 2021Unsupervised Continual Learning via Self-Adaptive Deep Clustering Approach28 Jun 2021
- 2021Continual Learning via Inter-Task Synaptic Mapping26 Jun 2021
- 2021Training Networks in Null Space of Feature Covariance for Continual Learning12 Mar 2021
- 2023A Comprehensive Survey of Continual Learning: Theory, Method and Applicationcited by 872
- 2021Training Networks in Null Space of Feature Covariance for Continual Learningcited by 143
- 2024Continual Learning and Catastrophic Forgettingcited by 77
- 2022Don't Stop Learning: Towards Continual Learning for the CLIP Modelcited by 61
- 2022Meta-attention for ViT-backed Continual Learningcited by 29
- 2021Unsupervised Continual Learning via Self-Adaptive Deep Clustering Approachcited by 19
- 2021Continual Learning via Inter-Task Synaptic Mappingcited by 14
- 2024Empowering Large Language Model for Continual Video Question Answering with Collaborative Promptingcited by 14
- 2022CNLL: A Semi-supervised Approach For Continual Noisy Label Learningcited by 8
- 2024DaCapo: Accelerating Continuous Learning in Autonomous Systems for Video Analyticscited by 8
- 2024Continual Learning with Neuromorphic Computing: Foundations, Methods, and Emerging Applicationscited by 8
- 2023Assessor-Guided Learning for Continual Environmentscited by 7
12 most cited of 29 All 29 (JSON)
- 2026Few-Shot Domain Incremental Learning via Continual Vision-Language Consolidation29 Jun 2026
- 2026HyLoVQA: Dynamic Hypernetwork-Generated Low-Rank Adaptation for Continual Visual Question Answering21 May 2026
- 2026MacVQA: Adaptive Memory Allocation and Global Noise Filtering for Continual Visual Question Answering5 Jan 2026
- 2025Continual Knowledge Consolidation LORA for Domain Incremental Learning17 Oct 2025
- 2025Source-Free Cross-Domain Continual Learning2 Oct 2025
- 2025Index-Aligned Query Distillation for Transformer-based Incremental Object Detection15 Aug 2025
- 2024Continual Learning with Neuromorphic Computing: Foundations, Methods, and Emerging Applications11 Oct 2024
- 2024Empowering Large Language Model for Continual Video Question Answering with Collaborative Prompting1 Oct 2024
- 2024Dynamic Object Queries for Transformer-based Incremental Object Detection31 Jul 2024
- 2024One Stone, Four Birds: A Comprehensive Solution for QA System Using Supervised Contrastive Learning12 Jul 2024
- 2024Unsupervised Few-Shot Continual Learning for Remote Sensing Image Scene Classification4 Jun 2024
- 2024Cross-Domain Continual Learning via CLAMP12 May 2024
12 newest of 29 All 29 (JSON)