PerforatedCNNs: Acceleration through Elimination of Redundant Convolutions
Not on the map. Why?
Abstract (arXiv)
We propose a novel approach to reduce the computational cost of evaluation of convolutional neural networks, a factor that has hindered their deployment in low-power devices such as mobile phones. Inspired by the loop perforation technique from source code optimization, we speed up the bottleneck convolutional layers by skipping their evaluation in some of the spatial positions. We propose and analyze several strategies of choosing these positions. We demonstrate that perforation can accelerate modern convolutional networks such as AlexNet and VGG-16 by a factor of 2x - 4x. Additionally, we show that perforation is complementary to the recently proposed acceleration method of Zhang et al.
Key facts. Cited by 17 papers in the map (data through 7 Oct 2026). First posted on arXiv 30 Apr 2015.
Builds on
No reference list yet.
Built on by
Citing papers per year: 2021: 8; 2022: 3; 2023: 2; 2024: 3; 2025: 1.
17 papers.
Sort:
- 2021Zero-Cost Proxies for Lightweight NAScited by 194
- 2024AtP*: An efficient and scalable method for localizing LLM behaviour to componentscited by 100
- 2021Spatially-Adaptive Image Restoration using Distortion-Guided Networkscited by 77
- 2021QueryDet: Cascaded Sparse Query for Accelerating High-Resolution Small Object Detectioncited by 70
- 2021PnP-DETR: Towards Efficient Visual Analysis with Transformerscited by 52
- 2021Stealthy Backdoors as Compression Artifactscited by 17
- 2024ESOD: Efficient Small Object Detection on High-Resolution Imagescited by 15
- 2023Tensor Decomposition for Model Reduction in Neural Networks: A Reviewcited by 14
- 2024ShadowLLM: Predictor-based Contextual Sparsity for Large Language Modelscited by 13
- 2022Towards Efficient Use of Multi-Scale Features in Transformer-Based Object Detectorscited by 10
- 2021Manipulating Identical Filter Redundancy for Efficient Pruning on Deep and Complicated CNNcited by 9
- 2021Neural Architecture Search as Program Transformation Explorationcited by 8
5 more
- 2022Survey: Exploiting Data Redundancy for Optimization of Deep Learningcited by 6
- 2021Learning Versatile Convolution Filters for Efficient Visual Recognitioncited by 3
- 2025GLASS: Global-Local Aggregation for Inference-time Sparsification of LLMscited by 1
- 2022Mixture-of-Rookies: Saving DNN Computations by Predicting ReLU Outputscited by 0
- 2023Mobiprox: Supporting Dynamic Approximate Computing on Mobilescited by 0
- 2025GLASS: Global-Local Aggregation for Inference-time Sparsification of LLMs19 Aug 2025
- 2024ESOD: Efficient Small Object Detection on High-Resolution Images23 Jul 2024
- 2024ShadowLLM: Predictor-based Contextual Sparsity for Large Language Models24 Jun 2024
- 2024AtP*: An efficient and scalable method for localizing LLM behaviour to components1 Mar 2024
- 2023Tensor Decomposition for Model Reduction in Neural Networks: A Review26 Apr 2023
- 2023Mobiprox: Supporting Dynamic Approximate Computing on Mobiles16 Mar 2023
- 2022Survey: Exploiting Data Redundancy for Optimization of Deep Learning29 Aug 2022
- 2022Towards Efficient Use of Multi-Scale Features in Transformer-Based Object Detectors24 Aug 2022
- 2022Mixture-of-Rookies: Saving DNN Computations by Predicting ReLU Outputs10 Feb 2022
- 2021Learning Versatile Convolution Filters for Efficient Visual Recognition20 Sep 2021
- 2021PnP-DETR: Towards Efficient Visual Analysis with Transformers15 Sep 2021
- 2021Spatially-Adaptive Image Restoration using Distortion-Guided Networks19 Aug 2021
5 more
- 2021Manipulating Identical Filter Redundancy for Efficient Pruning on Deep and Complicated CNN30 Jul 2021
- 2021Stealthy Backdoors as Compression Artifacts30 Apr 2021
- 2021QueryDet: Cascaded Sparse Query for Accelerating High-Resolution Small Object Detection16 Mar 2021
- 2021Neural Architecture Search as Program Transformation Exploration12 Feb 2021
- 2021Zero-Cost Proxies for Lightweight NAS20 Jan 2021
- 2021Zero-Cost Proxies for Lightweight NAScited by 194
- 2024AtP*: An efficient and scalable method for localizing LLM behaviour to componentscited by 100
- 2021Spatially-Adaptive Image Restoration using Distortion-Guided Networkscited by 77
- 2021QueryDet: Cascaded Sparse Query for Accelerating High-Resolution Small Object Detectioncited by 70
- 2021PnP-DETR: Towards Efficient Visual Analysis with Transformerscited by 52
- 2021Stealthy Backdoors as Compression Artifactscited by 17
- 2024ESOD: Efficient Small Object Detection on High-Resolution Imagescited by 15
- 2023Tensor Decomposition for Model Reduction in Neural Networks: A Reviewcited by 14
- 2024ShadowLLM: Predictor-based Contextual Sparsity for Large Language Modelscited by 13
- 2022Towards Efficient Use of Multi-Scale Features in Transformer-Based Object Detectorscited by 10
- 2021Manipulating Identical Filter Redundancy for Efficient Pruning on Deep and Complicated CNNcited by 9
- 2021Neural Architecture Search as Program Transformation Explorationcited by 8
12 most cited of 17 All 17 (JSON)
- 2025GLASS: Global-Local Aggregation for Inference-time Sparsification of LLMs19 Aug 2025
- 2024ESOD: Efficient Small Object Detection on High-Resolution Images23 Jul 2024
- 2024ShadowLLM: Predictor-based Contextual Sparsity for Large Language Models24 Jun 2024
- 2024AtP*: An efficient and scalable method for localizing LLM behaviour to components1 Mar 2024
- 2023Tensor Decomposition for Model Reduction in Neural Networks: A Review26 Apr 2023
- 2023Mobiprox: Supporting Dynamic Approximate Computing on Mobiles16 Mar 2023
- 2022Survey: Exploiting Data Redundancy for Optimization of Deep Learning29 Aug 2022
- 2022Towards Efficient Use of Multi-Scale Features in Transformer-Based Object Detectors24 Aug 2022
- 2022Mixture-of-Rookies: Saving DNN Computations by Predicting ReLU Outputs10 Feb 2022
- 2021Learning Versatile Convolution Filters for Efficient Visual Recognition20 Sep 2021
- 2021PnP-DETR: Towards Efficient Visual Analysis with Transformers15 Sep 2021
- 2021Spatially-Adaptive Image Restoration using Distortion-Guided Networks19 Aug 2021
12 newest of 17 All 17 (JSON)