mlsanityData to 14 Oct 2026

Overcoming Catastrophic Forgetting by XAI

arXiv 2211.14177 ↗First posted 25 Nov 2022cs.LGcited by 0

Not on the map. Why?

Abstract (arXiv)

Explaining the behaviors of deep neural networks, usually considered as black boxes, is critical especially when they are now being adopted over diverse aspects of human life. Taking the advantages of interpretable machine learning (interpretable ML), this work proposes a novel tool called Catastrophic Forgetting Dissector (or CFD) to explain catastrophic forgetting in continual learning settings. We also introduce a new method called Critical Freezing based on the observations of our tool. Experiments on ResNet articulate how catastrophic forgetting happens, particularly showing which components of this famous network are forgetting. Our new continual learning algorithm defeats various recent techniques by a significant margin, proving the capability of the investigation. Critical freezing not only attacks catastrophic forgetting but also exposes explainability.

Key facts. No citing papers in the map yet (data through 14 Oct 2026). Builds on 42 of its 48 references that are in the map. First posted on arXiv 25 Nov 2022.

Builds on

42 of 48 references.

References · 42

  1. 2015Deep Residual Learning for Image Recognitioncited by 52,096
  2. 2014Adam: A Method for Stochastic Optimizationcited by 37,240
  3. 2014Microsoft COCO: Common Objects in Contextcited by 17,608
  4. 2014ImageNet Large Scale Visual Recognition Challengecited by 8,498
  5. 2016Overcoming catastrophic forgetting in neural networkscited by 4,787
  6. 2014Going Deeper with Convolutionscited by 4,241
  7. 2016Learning without Forgettingcited by 2,496
  8. 2013Deep Inside Convolutional Networks: Visualising Image Classification Models and Saliency Mapscited by 2,371
  9. 2016iCaRL: Incremental Classifier and Representation Learningcited by 2,333
  10. 2013Visualizing and Understanding Convolutional Networkscited by 2,290
  11. 2017Gradient Episodic Memory for Continual Learningcited by 1,898
  12. 2015Microsoft COCO Captions: Data Collection and Evaluation Servercited by 1,462
30 more
  1. 2015Flickr30k Entities: Collecting Region-to-Phrase Correspondences for Richer Image-to-Sentence Modelscited by 1,362
  2. 2016Progressive Neural Networkscited by 1,361
  3. 2014Show and Tell: A Neural Image Caption Generatorcited by 879
  4. 2013An Empirical Investigation of Catastrophic Forgetting in Gradient-Based Neural Networkscited by 722
  5. 2017Network Dissection: Quantifying Interpretability of Deep Visual Representationscited by 708
  6. 2017Lifelong Learning with Dynamically Expandable Networkscited by 694
  7. 2018End-to-End Incremental Learningcited by 597
  8. 2017Measuring Catastrophic Forgetting in Neural Networkscited by 360
  9. 2017Variational Continual Learningcited by 339
  10. 2015Understanding Neural Networks Through Deep Visualizationcited by 334
  11. 2017Real Time Image Saliency for Black Box Classifierscited by 246
  12. 2017Overcoming Catastrophic Forgetting by Incremental Moment Matchingcited by 243
  13. 2017Incremental Learning of Object Detectors without Catastrophic Forgettingcited by 208
  14. 2017Visualizing Deep Neural Network Decisions: Prediction Difference Analysiscited by 166
  15. 2019Incremental Learning Techniques for Semantic Segmentationcited by 141
  16. 2018Continuous Learning in Single-Incremental-Task Scenarioscited by 109
  17. 2018Neural Baby Talkcited by 107
  18. 2021The effectiveness of feature attribution methods and its correlation with automatic evaluation scorescited by 88
  19. 2019Lifelong GAN: Continual Learning for Conditional Image Generationcited by 78
  20. 2019Toward Understanding Catastrophic Forgetting in Continual Learningcited by 68
  21. 2018Show, Control and Tell: A Framework for Generating Controllable and Grounded Captionscited by 65
  22. 2017Convolutional Image Captioningcited by 52
  23. 2017Continual Learning in Generative Adversarial Netscited by 51
  24. 2018Lifelong Learning of Spatiotemporal Representations with Dual-Memory Recurrent Self-Organizationcited by 38
  25. 2018Incremental Learning for Semantic Segmentation of Large-Scale Remote Sensing Datacited by 35
  26. 2019ContCap: A scalable framework for continual image captioningcited by 11
  27. 2020Dissecting Catastrophic Forgetting in Continual Learning by Deep Visualizationcited by 6
  28. 2020Explaining How Deep Neural Networks Forget by Deep Visualizationcited by 4
  29. 2019A Conceptual Framework for Lifelong Learningcited by 1
  30. 2020Simple Multi-Resolution Representation Learning for Human Pose Estimationcited by 1

Built on by

Not cited yet.