Less is More: The Influence of Pruning on the Explainability of CNNs
Not on the map. Why?
Abstract (arXiv)
Over the last century, deep learning models have become the state-of-the-art for solving complex computer vision problems. These modern computer vision models have millions of parameters, which presents two major challenges: (1) the increased computational requirements hamper the deployment in resource-constrained environments, such as mobile or IoT devices, and (2) explaining the complex decisions of such networks to humans is challenging. Network pruning is a technical approach to reduce the complexity of models, where less important parameters are removed. The work presented in this paper investigates whether this reduction in technical complexity also helps with perceived explainability. To do so, we conducted a pre-study and two human-grounded experiments, assessing the effects of different pruning ratios on explainability. Overall, we evaluate four different compression rates (i.e., 2, 4, 8, and 32) with 37 500 tasks on Mechanical Turk. Results indicate that lower compression rates have a positive influence on explainability, while higher compression rates show negative effects. Furthermore, we were able to identify sweet spots that increase both the perceived explainability and the model's performance.
Key facts. Cited by 5 papers in the map (data through 14 Oct 2026). Builds on 51 of its 78 references that are in the map. First posted on arXiv 17 Feb 2023.
Builds on
51 of 78 references.
References · 51
- 2015Deep Residual Learning for Image Recognitioncited by 52,096
- 2020An Image is Worth 16x16 Words: Transformers for Image Recognition at Scalecited by 30,186
- 2014Very Deep Convolutional Networks for Large-Scale Image Recognitioncited by 15,364
- 2021Swin Transformer: Hierarchical Vision Transformer using Shifted Windowscited by 12,139
- 2016Grad-CAM: Visual Explanations from Deep Networks via Gradient-based Localizationcited by 6,733
- 2017A Unified Approach to Interpreting Model Predictionscited by 6,555
- 2019EfficientNet: Rethinking Model Scaling for Convolutional Neural Networkscited by 6,442
- 2016"Why Should I Trust You?": Explaining the Predictions of Any Classifiercited by 5,070
- 2014Going Deeper with Convolutionscited by 4,241
- 2017Axiomatic Attribution for Deep Networkscited by 3,384
- 2015Learning Deep Features for Discriminative Localizationcited by 2,436
- 2013Deep Inside Convolutional Networks: Visualising Image Classification Models and Saliency Mapscited by 2,371
38 more
- 2013Visualizing and Understanding Convolutional Networkscited by 2,290
- 2018The Lottery Ticket Hypothesis: Finding Sparse, Trainable Neural Networkscited by 2,262
- 2015Learning both Weights and Connections for Efficient Neural Networkscited by 2,031
- 2019Explainable Artificial Intelligence (XAI): Concepts, Taxonomies, Opportunities and Challenges toward Responsible AIcited by 1,552
- 2017Learning Important Features Through Propagating Activation Differencescited by 1,458
- 2017Towards A Rigorous Science of Interpretable Machine Learningcited by 1,416
- 2017Explanation in Artificial Intelligence: Insights from the Social Sciencescited by 1,206
- 2018Sanity Checks for Saliency Mapscited by 1,156
- 2018A Survey Of Methods For Explaining Black Box Modelscited by 973
- 2017Grad-CAM++: Improved Visual Explanations for Deep Convolutional Networkscited by 939
- 2018Rethinking the Value of Network Pruningcited by 599
- 2020What is the State of Neural Network Pruning?cited by 583
- 2018Explaining Explanations: An Overview of Interpretability of Machine Learningcited by 508
- 2018A Benchmark for Interpretability Methods in Deep Neural Networkscited by 476
- 2019The State of Sparsity in Deep Neural Networkscited by 476
- 2015Evaluating the visualization of what a Deep Neural Network has learnedcited by 419
- 2019A Survey on Explainable Artificial Intelligence (XAI): Towards Medical XAIcited by 404
- 2016European Union regulations on algorithmic decision-making and a "right to explanation"cited by 344
- 2018Soft Filter Pruning for Accelerating Deep Convolutional Neural Networkscited by 315
- 2018Techniques for Interpretable Machine Learningcited by 238
- 2020A Survey on the Explainability of Supervised Machine Learningcited by 227
- 2017Data-Driven Sparse Structure Selection for Deep Neural Networkscited by 181
- 2020Explainable Deep Learning: A Field Guide for the Uninitiatedcited by 127
- 2018A Systematic DNN Weight Pruning Framework using Alternating Direction Method of Multiplierscited by 120
- 2020Interpretable Machine Learning -- A Brief History, State-of-the-Art and Challengescited by 120
- 2015Visualizing Deep Convolutional Neural Networks Using Natural Pre-Imagescited by 93
- 2020The role of explainability in creating trustworthy artificial intelligence for health care: a comprehensive survey of the terminology, design choices, and evaluation strategiescited by 92
- 2019Pruning by Explaining: A Novel Criterion for Deep Neural Network Pruningcited by 89
- 2020On quantitative aspects of model interpretabilitycited by 71
- 2019Towards Explainable Deep Neural Networks (xDNN)cited by 61
- 2021Socially Responsible AI Algorithms: Issues, Purposes, and Challengescited by 56
- 2018Explanation Methods in Deep Learning: Users, Values, Concerns and Challengescited by 49
- 2019Quantifying Interpretability and Trust in Machine Learning Systemscited by 49
- 2018Stop Explaining Black Box Machine Learning Models for High Stakes Decisions and Use Interpretable Models Insteadcited by 40
- 2020Utilizing Explainable AI for Quantization and Pruning of Deep Neural Networkscited by 17
- 2019Improving Feature Attribution through Input-specific Network Pruningcited by 7
- 2017Interpreting Convolutional Neural Networks Through Compressioncited by 5
- 2020Streamlining Tensor and Network Pruning in PyTorchcited by 4
50 most cited of 51 All 51 (JSON)
Built on by
Citing papers per year: 2025: 3; 2026: 2.
5 papers.
- 2025When Does Pruning Benefit Vision Representations?cited by 3
- 2025Do Sparse Subnetworks Exhibit Cognitively Aligned Attention? Effects of Pruning on Saliency Map Fidelity, Sparsity, and Concept Coherencecited by 1
- 2025Smaller is Better: Enhancing Transparency in Vehicle AI Systems via Pruningcited by 0
- 2026Explainability-Inspired Layer-Wise Pruning of Deep Neural Networks for Efficient Object Detectioncited by 0
- 2026Towards Transparent Diagnostics: Investigating Architectural Trade-offs and Explainability in Malaria Detectioncited by 0
- 2026Towards Transparent Diagnostics: Investigating Architectural Trade-offs and Explainability in Malaria Detection16 Sep 2026
- 2026Explainability-Inspired Layer-Wise Pruning of Deep Neural Networks for Efficient Object Detection15 Feb 2026
- 2025Smaller is Better: Enhancing Transparency in Vehicle AI Systems via Pruning24 Sep 2025
- 2025Do Sparse Subnetworks Exhibit Cognitively Aligned Attention? Effects of Pruning on Saliency Map Fidelity, Sparsity, and Concept Coherence23 Sep 2025
- 2025When Does Pruning Benefit Vision Representations?2 Jul 2025