mlsanityData to 14 Oct 2026

Less is More: The Influence of Pruning on the Explainability of CNNs

arXiv 2302.08878 ↗First posted 17 Feb 2023cs.CV cs.AIcited by 5

Not on the map. Why?

Abstract (arXiv)

Over the last century, deep learning models have become the state-of-the-art for solving complex computer vision problems. These modern computer vision models have millions of parameters, which presents two major challenges: (1) the increased computational requirements hamper the deployment in resource-constrained environments, such as mobile or IoT devices, and (2) explaining the complex decisions of such networks to humans is challenging. Network pruning is a technical approach to reduce the complexity of models, where less important parameters are removed. The work presented in this paper investigates whether this reduction in technical complexity also helps with perceived explainability. To do so, we conducted a pre-study and two human-grounded experiments, assessing the effects of different pruning ratios on explainability. Overall, we evaluate four different compression rates (i.e., 2, 4, 8, and 32) with 37 500 tasks on Mechanical Turk. Results indicate that lower compression rates have a positive influence on explainability, while higher compression rates show negative effects. Furthermore, we were able to identify sweet spots that increase both the perceived explainability and the model's performance.

Key facts. Cited by 5 papers in the map (data through 14 Oct 2026). Builds on 51 of its 78 references that are in the map. First posted on arXiv 17 Feb 2023.

Builds on

51 of 78 references.

References · 51

  1. 2015Deep Residual Learning for Image Recognitioncited by 52,096
  2. 2020An Image is Worth 16x16 Words: Transformers for Image Recognition at Scalecited by 30,186
  3. 2014Very Deep Convolutional Networks for Large-Scale Image Recognitioncited by 15,364
  4. 2021Swin Transformer: Hierarchical Vision Transformer using Shifted Windowscited by 12,139
  5. 2016Grad-CAM: Visual Explanations from Deep Networks via Gradient-based Localizationcited by 6,733
  6. 2017A Unified Approach to Interpreting Model Predictionscited by 6,555
  7. 2019EfficientNet: Rethinking Model Scaling for Convolutional Neural Networkscited by 6,442
  8. 2016"Why Should I Trust You?": Explaining the Predictions of Any Classifiercited by 5,070
  9. 2014Going Deeper with Convolutionscited by 4,241
  10. 2017Axiomatic Attribution for Deep Networkscited by 3,384
  11. 2015Learning Deep Features for Discriminative Localizationcited by 2,436
  12. 2013Deep Inside Convolutional Networks: Visualising Image Classification Models and Saliency Mapscited by 2,371
38 more
  1. 2013Visualizing and Understanding Convolutional Networkscited by 2,290
  2. 2018The Lottery Ticket Hypothesis: Finding Sparse, Trainable Neural Networkscited by 2,262
  3. 2015Learning both Weights and Connections for Efficient Neural Networkscited by 2,031
  4. 2019Explainable Artificial Intelligence (XAI): Concepts, Taxonomies, Opportunities and Challenges toward Responsible AIcited by 1,552
  5. 2017Learning Important Features Through Propagating Activation Differencescited by 1,458
  6. 2017Towards A Rigorous Science of Interpretable Machine Learningcited by 1,416
  7. 2017Explanation in Artificial Intelligence: Insights from the Social Sciencescited by 1,206
  8. 2018Sanity Checks for Saliency Mapscited by 1,156
  9. 2018A Survey Of Methods For Explaining Black Box Modelscited by 973
  10. 2017Grad-CAM++: Improved Visual Explanations for Deep Convolutional Networkscited by 939
  11. 2018Rethinking the Value of Network Pruningcited by 599
  12. 2020What is the State of Neural Network Pruning?cited by 583
  13. 2018Explaining Explanations: An Overview of Interpretability of Machine Learningcited by 508
  14. 2018A Benchmark for Interpretability Methods in Deep Neural Networkscited by 476
  15. 2019The State of Sparsity in Deep Neural Networkscited by 476
  16. 2015Evaluating the visualization of what a Deep Neural Network has learnedcited by 419
  17. 2019A Survey on Explainable Artificial Intelligence (XAI): Towards Medical XAIcited by 404
  18. 2016European Union regulations on algorithmic decision-making and a "right to explanation"cited by 344
  19. 2018Soft Filter Pruning for Accelerating Deep Convolutional Neural Networkscited by 315
  20. 2018Techniques for Interpretable Machine Learningcited by 238
  21. 2020A Survey on the Explainability of Supervised Machine Learningcited by 227
  22. 2017Data-Driven Sparse Structure Selection for Deep Neural Networkscited by 181
  23. 2020Explainable Deep Learning: A Field Guide for the Uninitiatedcited by 127
  24. 2018A Systematic DNN Weight Pruning Framework using Alternating Direction Method of Multiplierscited by 120
  25. 2020Interpretable Machine Learning -- A Brief History, State-of-the-Art and Challengescited by 120
  26. 2015Visualizing Deep Convolutional Neural Networks Using Natural Pre-Imagescited by 93
  27. 2020The role of explainability in creating trustworthy artificial intelligence for health care: a comprehensive survey of the terminology, design choices, and evaluation strategiescited by 92
  28. 2019Pruning by Explaining: A Novel Criterion for Deep Neural Network Pruningcited by 89
  29. 2020On quantitative aspects of model interpretabilitycited by 71
  30. 2019Towards Explainable Deep Neural Networks (xDNN)cited by 61
  31. 2021Socially Responsible AI Algorithms: Issues, Purposes, and Challengescited by 56
  32. 2018Explanation Methods in Deep Learning: Users, Values, Concerns and Challengescited by 49
  33. 2019Quantifying Interpretability and Trust in Machine Learning Systemscited by 49
  34. 2018Stop Explaining Black Box Machine Learning Models for High Stakes Decisions and Use Interpretable Models Insteadcited by 40
  35. 2020Utilizing Explainable AI for Quantization and Pruning of Deep Neural Networkscited by 17
  36. 2019Improving Feature Attribution through Input-specific Network Pruningcited by 7
  37. 2017Interpreting Convolutional Neural Networks Through Compressioncited by 5
  38. 2020Streamlining Tensor and Network Pruning in PyTorchcited by 4

50 most cited of 51 All 51 (JSON)

Built on by

Cited by year (2026 to 14 Oct)

Citing papers per year: 2025: 3; 2026: 2.

5 papers.