Coreset-Based Neural Network Compression
Not on the map. Why?
Abstract (arXiv)
We propose a novel Convolutional Neural Network (CNN) compression algorithm based on coreset representations of filters. We exploit the redundancies extant in the space of CNN weights and neuronal activations (across samples) in order to obtain compression. Our method requires no retraining, is easy to implement, and obtains state-of-the-art compression performance across a wide variety of CNN architectures. Coupled with quantization and Huffman coding, we create networks that provide AlexNet-like accuracy, with a memory footprint that is 832× smaller than the original AlexNet, while also introducing significant reductions in inference time as well. Additionally these compressed networks when fine-tuned, successfully generalize to other domains as well.
Key facts. Cited by 27 papers in the map (data through 7 Oct 2026). First posted on arXiv 25 Jul 2018.
Builds on
No reference list yet.
Built on by
Citing papers per year: 2021: 7; 2022: 3; 2023: 7; 2024: 3; 2025: 5; 2026: 2.
27 papers.
Sort:
By area:
- 2023A Simple and Effective Pruning Approach for Large Language Modelscited by 776
- 2023Structured Pruning for Deep Convolutional Neural Networks: A surveycited by 122
- 2021Towards Compact CNNs via Collaborative Compressioncited by 36
- 2022FairGRAPE: Fairness-aware GRAdient Pruning mEthod for Face Attribute Classificationcited by 30
- 2025Finding Fantastic Experts in MoEs: A Unified Study for Expert Dropping Strategies and Observationscited by 19
- 2023Automatic Attention Pruning: Improving and Automating Model Pruning using Attentionscited by 11
- 2021Coresets for Decision Trees of Signalscited by 10
- 2025Neural Pruning for 3D Scene Reconstruction: Efficient NeRF Accelerationcited by 9
- 2022Compressing Models with Few Samples: Mimicking then Replacingcited by 8
- 2022LilNetX: Lightweight Networks with EXtreme Model Compression and Structured Sparsificationcited by 7
- 2021Training Compact CNNs for Image Classification using Dynamic-coded Filter Fusioncited by 5
- 2024Edge AI: Evaluation of Model Compression Techniques for Convolutional Neural Networkscited by 4
15 more
- 2021A Deeper Look into Convolutions via Eigenvalue-based Pruningcited by 2
- 2021Efficient Inference via Universal LSH Kernelcited by 2
- 2021Batch Normalization Tells You Which Filter is Importantcited by 2
- 2023Filter Pruning based on Information Capacity and Independencecited by 2
- 2023Tensor Factorization for Leveraging Cross-Modal Knowledge in Data-Constrained Infrared Object Detectioncited by 2
- 2024From Algorithm to Hardware: A Survey on Efficient and Safe Deployment of Deep Neural Networkscited by 2
- 2025Training-Free Restoration of Pruned Neural Networkscited by 2
- 2021Croesus: Multi-Stage Processing and Transactions for Video-Analytics in Edge-Cloud Systemscited by 1
- 2023Securing Neural Networks with Knapsack Optimizationcited by 1
- 2023A Differentiable Framework for End-to-End Learning of Hybrid Structured Compressioncited by 1
- 2025Hyperpruning: Efficient Search through Pruned Variants of Recurrent Neural Networks Leveraging Lyapunov Spectrumcited by 1
- 2025Improving Model Classification by Optimizing the Training Datasetcited by 1
- 2024A Comprehensive Study of Structural Pruning for Vision Modelscited by 0
- 2026Deterministic Coreset for Lp Subspacecited by 0
- 2026Compositionality Emerges in a Narrow Depth-Connectivity Regime: Architecture Constraints and Solution Manifoldscited by 0
- 2026Compositionality Emerges in a Narrow Depth-Connectivity Regime: Architecture Constraints and Solution Manifolds18 Jun 2026
- 2026Deterministic Coreset for Lp Subspace1 Jan 2026
- 2025Improving Model Classification by Optimizing the Training Dataset22 Jul 2025
- 2025Hyperpruning: Efficient Search through Pruned Variants of Recurrent Neural Networks Leveraging Lyapunov Spectrum9 Jun 2025
- 2025Finding Fantastic Experts in MoEs: A Unified Study for Expert Dropping Strategies and Observations8 Apr 2025
- 2025Neural Pruning for 3D Scene Reconstruction: Efficient NeRF Acceleration1 Apr 2025
- 2025Training-Free Restoration of Pruned Neural Networks6 Feb 2025
- 2024Edge AI: Evaluation of Model Compression Techniques for Convolutional Neural Networks2 Sep 2024
- 2024A Comprehensive Study of Structural Pruning for Vision Models18 Jun 2024
- 2024From Algorithm to Hardware: A Survey on Efficient and Safe Deployment of Deep Neural Networks9 May 2024
- 2023Tensor Factorization for Leveraging Cross-Modal Knowledge in Data-Constrained Infrared Object Detection28 Sep 2023
- 2023A Differentiable Framework for End-to-End Learning of Hybrid Structured Compression21 Sep 2023
15 more
- 2023A Simple and Effective Pruning Approach for Large Language Models20 Jun 2023
- 2023Securing Neural Networks with Knapsack Optimization20 Apr 2023
- 2023Automatic Attention Pruning: Improving and Automating Model Pruning using Attentions14 Mar 2023
- 2023Filter Pruning based on Information Capacity and Independence7 Mar 2023
- 2023Structured Pruning for Deep Convolutional Neural Networks: A survey1 Mar 2023
- 2022FairGRAPE: Fairness-aware GRAdient Pruning mEthod for Face Attribute Classification22 Jul 2022
- 2022LilNetX: Lightweight Networks with EXtreme Model Compression and Structured Sparsification6 Apr 2022
- 2022Compressing Models with Few Samples: Mimicking then Replacing7 Jan 2022
- 2021Croesus: Multi-Stage Processing and Transactions for Video-Analytics in Edge-Cloud Systems31 Dec 2021
- 2021Batch Normalization Tells You Which Filter is Important2 Dec 2021
- 2021Coresets for Decision Trees of Signals7 Oct 2021
- 2021Training Compact CNNs for Image Classification using Dynamic-coded Filter Fusion14 Jul 2021
- 2021Efficient Inference via Universal LSH Kernel21 Jun 2021
- 2021Towards Compact CNNs via Collaborative Compression24 May 2021
- 2021A Deeper Look into Convolutions via Eigenvalue-based Pruning4 Feb 2021
- 2023A Simple and Effective Pruning Approach for Large Language Modelscited by 776
- 2023Structured Pruning for Deep Convolutional Neural Networks: A surveycited by 122
- 2021Towards Compact CNNs via Collaborative Compressioncited by 36
- 2022FairGRAPE: Fairness-aware GRAdient Pruning mEthod for Face Attribute Classificationcited by 30
- 2023Automatic Attention Pruning: Improving and Automating Model Pruning using Attentionscited by 11
- 2021Coresets for Decision Trees of Signalscited by 10
- 2025Neural Pruning for 3D Scene Reconstruction: Efficient NeRF Accelerationcited by 9
- 2022Compressing Models with Few Samples: Mimicking then Replacingcited by 8
- 2022LilNetX: Lightweight Networks with EXtreme Model Compression and Structured Sparsificationcited by 7
- 2021Training Compact CNNs for Image Classification using Dynamic-coded Filter Fusioncited by 5
- 2024Edge AI: Evaluation of Model Compression Techniques for Convolutional Neural Networkscited by 4
- 2021A Deeper Look into Convolutions via Eigenvalue-based Pruningcited by 2
12 most cited of 26 All 26 (JSON)
- 2026Compositionality Emerges in a Narrow Depth-Connectivity Regime: Architecture Constraints and Solution Manifolds18 Jun 2026
- 2026Deterministic Coreset for Lp Subspace1 Jan 2026
- 2025Improving Model Classification by Optimizing the Training Dataset22 Jul 2025
- 2025Hyperpruning: Efficient Search through Pruned Variants of Recurrent Neural Networks Leveraging Lyapunov Spectrum9 Jun 2025
- 2025Neural Pruning for 3D Scene Reconstruction: Efficient NeRF Acceleration1 Apr 2025
- 2025Training-Free Restoration of Pruned Neural Networks6 Feb 2025
- 2024Edge AI: Evaluation of Model Compression Techniques for Convolutional Neural Networks2 Sep 2024
- 2024A Comprehensive Study of Structural Pruning for Vision Models18 Jun 2024
- 2024From Algorithm to Hardware: A Survey on Efficient and Safe Deployment of Deep Neural Networks9 May 2024
- 2023Tensor Factorization for Leveraging Cross-Modal Knowledge in Data-Constrained Infrared Object Detection28 Sep 2023
- 2023A Differentiable Framework for End-to-End Learning of Hybrid Structured Compression21 Sep 2023
- 2023A Simple and Effective Pruning Approach for Large Language Models20 Jun 2023
12 newest of 26 All 26 (JSON)