mlsanityData to 13 Oct 2026

Exploring Vision Neural Network Pruning via Screening Methodology

arXiv 2502.07189 ↗First posted 11 Feb 2025cs.LG stat.MLcited by 0

Not on the map. Why?

Abstract (arXiv)

The remarkable performance of modern deep neural networks (DNNs) is largely driven by their massive scale, often comprising tens to hundreds of millions-or even billions-of parameters. However, such a scale incurs substantial storage and computational costs, hindering deployment on platforms such as edge devices that require energy-efficient and real-time processing. In this paper, we propose a network pruning framework that reduces both storage and computation requirements by an order of magnitude while preserving model accuracy. Our approach eliminates non-essential parameters through a statistical analysis of component significance across classification categories. Specifically, we employ a F-statistic-based screening technique combined with a weighted evaluation scheme to quantify the contributions of connections and channels, enabling both unstructured and structured pruning within a unified framework. Extensive experiments on real-world vision datasets, covering both fully connected neural networks (FNNs) and convolutional neural networks (CNNs), demonstrate that the proposed framework produces compact and efficient models that are highly competitive with the state of art apporoaches.

Key facts. No citing papers in the map yet (data through 13 Oct 2026). Builds on 41 of its 55 references that are in the map. First posted on arXiv 11 Feb 2025.

Builds on

41 of 55 references.

References · 41

  1. 2015Deep Residual Learning for Image Recognitioncited by 51,950
  2. 2018BERT: Pre-training of Deep Bidirectional Transformers for Language Understandingcited by 40,304
  3. 2015Distilling the Knowledge in a Neural Networkcited by 10,180
  4. 2017Mask R-CNNcited by 7,266
  5. 2016Densely Connected Convolutional Networkscited by 6,707
  6. 2013Efficient Estimation of Word Representations in Vector Spacecited by 4,360
  7. 2014Sequence to Sequence Learning with Neural Networkscited by 2,981
  8. 2015Learning both Weights and Connections for Efficient Neural Networkscited by 2,017
  9. 2017Quantization and Training of Neural Networks for Efficient Integer-Arithmetic-Only Inferencecited by 1,585
  10. 2023AWQ: Activation-aware Weight Quantization for LLM Compression and Accelerationcited by 1,272
  11. 2019Temporal Fusion Transformers for Interpretable Multi-horizon Time Series Forecastingcited by 756
  12. 2019Contrastive Representation Distillationcited by 739
29 more
  1. 2017Learning Efficient Convolutional Networks through Network Slimmingcited by 675
  2. 2017DeepFM: A Factorization-Machine based Neural Network for CTR Predictioncited by 673
  3. 2017To prune, or not to prune: exploring the efficacy of pruning for model compressioncited by 602
  4. 2024A Survey on Knowledge Distillation of Large Language Modelscited by 279
  5. 2016Dynamic Network Surgery for Efficient DNNscited by 233
  6. 2023A Survey on Deep Neural Network Pruning-Taxonomy, Comparison, Analysis, and Recommendationscited by 201
  7. 2023Co-SLAM: Joint Coordinate and Sparse Parametric Encodings for Neural Real-Time SLAMcited by 183
  8. 2018Dynamic Channel Pruning: Feature Boosting and Suppressioncited by 129
  9. 2020Dynamic Model Pruning with Feedbackcited by 125
  10. 2019Winning the Lottery with Continuous Sparsificationcited by 99
  11. 2018Training and Inference with Integers in Deep Neural Networkscited by 85
  12. 2018AutoPruner: An End-to-End Trainable Filter Pruning Method for Efficient Deep Model Inferencecited by 77
  13. 2019Centripetal SGD for Pruning Very Deep Convolutional Networks with Complicated Structurecited by 76
  14. 2021Graph Neural Networks Inspired by Classical Iterative Algorithmscited by 60
  15. 2019Neural Network Pruning with Residual-Connections and Limited-Datacited by 52
  16. 2020Methods for Pruning Deep Neural Networkscited by 49
  17. 2020DSA: More Efficient Budgeted Pruning via Differentiable Sparsity Allocationcited by 47
  18. 2019XNAS: Neural Architecture Search with Expert Advicecited by 35
  19. 2018Deep k-Means: Re-Training and Parameter Sharing with Harder Cluster Assignments for Compressing Deep Convolutionscited by 33
  20. 2022DropNet: Reducing Neural Network Complexity via Iterative Pruningcited by 29
  21. 2018Structured Pruning of Neural Networks with Budget-Aware Regularizationcited by 26
  22. 2021Carrying out CNN Channel Pruning in a White Boxcited by 22
  23. 2020Single Shot Structured Pruning Before Trainingcited by 19
  24. 2019SiPPing Neural Networks: Sensitivity-informed Provable Pruning of Neural Networkscited by 17
  25. 2020Neural Rule Ensembles: Encoding Sparse Feature Interactions into Neural Networkscited by 3
  26. 2020A study of local optima for learning feature interactions using neural networkscited by 3
  27. 2018A Novel Framework for Online Supervised Learning with Feature Selectioncited by 2
  28. 2021Online Feature Screening for Data Streams with Concept Driftcited by 1
  29. 2021Evolving Transferable Neural Pruning Functionscited by 1

Built on by

Not cited yet.