mlsanityData to 14 Oct 2026

Adaptive Signal Resuscitation: Channel-wise Post-Pruning Repair for Sparse Vision Networks

arXiv 2605.21426 ↗First posted 20 May 2026cs.LGcited by 1

Not on the map. Why?

Abstract (arXiv)

One-shot magnitude pruning can cause severe accuracy collapse in the high-sparsity regime, even when the pruning mask preserves the largest weights. We argue that this failure reflects a granularity mismatch in post-pruning repair. Under global magnitude pruning, nearly collapsed channels can coexist with channels that retain informative activation variance within the same layer. Existing layer-wise activation repair methods apply a single correction to the whole layer, and can therefore over-amplify damaged channels while trying to restore the layer-level signal. We propose Adaptive Signal Resuscitation (ASR), a training-free channel-wise repair method that matches the granularity of repair to the granularity of damage. ASR estimates a variance-matching correction for each output channel and stabilizes it with a data-driven shrinkage rule, suppressing unreliable corrections for channels with weak post-pruning signal while preserving corrections for healthier channels. Applied before BatchNorm recalibration, ASR requires only forward passes on a small calibration set and no retraining. Across three datasets, four convolutional architectures, and both unstructured and structured sparsity settings, ASR generally improves over layer-wise repair, with the clearest gains in high-sparsity regimes. On ResNet-50 at 90% sparsity, ASR recovers 55.6% top-1 accuracy on CIFAR-10, compared with 41.0% for layer-wise repair and 28.0% for BatchNorm-only recalibration. Ablations show that naive channel-wise variance matching is insufficient, and that shrinkage stabilizes post-pruning repair.

Key facts. Cited by 1 paper in the map (data through 14 Oct 2026). Builds on 36 of its 46 references that are in the map. First posted on arXiv 20 May 2026.

Builds on

36 of 46 references.

References · 36

  1. 2015Deep Residual Learning for Image Recognitioncited by 52,096
  2. 2014Very Deep Convolutional Networks for Large-Scale Image Recognitioncited by 15,364
  3. 2015Batch Normalization: Accelerating Deep Network Training by Reducing Internal Covariate Shiftcited by 7,005
  4. 2016Densely Connected Convolutional Networkscited by 6,720
  5. 2015Deep Compression: Compressing Deep Neural Networks with Pruning, Trained Quantization and Huffman Codingcited by 2,329
  6. 2018The Lottery Ticket Hypothesis: Finding Sparse, Trainable Neural Networkscited by 2,262
  7. 2015Learning both Weights and Connections for Efficient Neural Networkscited by 2,031
  8. 2016Pruning Filters for Efficient ConvNetscited by 1,143
  9. 2023SparseGPT: Massive Language Models Can Be Accurately Pruned in One-Shotcited by 1,121
  10. 2023A Simple and Effective Pruning Approach for Large Language Modelscited by 800
  11. 2017Channel Pruning for Accelerating Very Deep Neural Networkscited by 702
  12. 2017Learning Efficient Convolutional Networks through Network Slimmingcited by 676
24 more
  1. 2020Up or Down? Adaptive Rounding for Post-Training Quantizationcited by 621
  2. 2018Rethinking the Value of Network Pruningcited by 599
  3. 2020What is the State of Neural Network Pruning?cited by 583
  4. 2016Learning Structured Sparsity in Deep Neural Networkscited by 541
  5. 2019Importance Estimation for Neural Network Pruningcited by 541
  6. 2017ThiNet: A Filter Level Pruning Method for Deep Neural Network Compressioncited by 442
  7. 2019Data-Free Quantization Through Weight Equalization and Bias Correctioncited by 336
  8. 2022Optimal Brain Compression: A Framework for Accurate Post-Training Quantization and Pruningcited by 322
  9. 2018Soft Filter Pruning for Accelerating Deep Convolutional Neural Networkscited by 315
  10. 2020ZeroQ: A Novel Zero Shot Quantization Frameworkcited by 269
  11. 2017Variational Dropout Sparsifies Deep Neural Networkscited by 265
  12. 2020Comparing Rewinding and Fine-tuning in Neural Network Pruningcited by 240
  13. 2021Accelerating Sparse Deep Neural Networkscited by 223
  14. 2023A Survey on Deep Neural Network Pruning-Taxonomy, Comparison, Analysis, and Recommendationscited by 202
  15. 2021Learning N:M Fine-grained Structured Sparse Neural Networks From Scratchcited by 179
  16. 2018NetAdapt: Platform-Aware Neural Network Adaptation for Mobile Applicationscited by 147
  17. 2019Towards Optimal Structured CNN Pruning via Generative Adversarial Learningcited by 146
  18. 2020Layer-adaptive sparsity for the Magnitude-based Pruningcited by 126
  19. 2022REPAIR: REnormalizing Permuted Activations for Interpolation Repaircited by 120
  20. 2017Bayesian Compression for Deep Learningcited by 116
  21. 2021Accelerated Sparse Neural Training: A Provable and Efficient Method to Find N:M Transposable Maskscited by 103
  22. 2020EagleEye: Fast Sub-net Evaluation for Efficient Neural Network Pruningcited by 80
  23. 2021Post-training deep neural network pruning via layer-wise calibrationcited by 24
  24. 2025Signal Collapse in One-Shot Pruning: When Sparse Models Fail to Distinguish Neural Representationscited by 5

Built on by

Cited by year (2026 to 14 Oct)

Citing papers per year: 2026: 1.

1 paper.