mlsanityData to 14 Oct 2026

How Sparsity Allocation Shapes Label-Free Post-Pruning Recoverability

arXiv 2605.21972 ↗First posted 21 May 2026cs.LGcited by 0

Not on the map. Why?

Abstract (arXiv)

Unstructured magnitude pruning at high sparsity can reduce neural network accuracy to near-random performance, while labeled retraining may be unavailable in practical deployment settings. Label-free post-pruning repair methods can partially recover collapsed sparse models, but their effectiveness depends on the sparse model left by the upstream pruning allocation. This paper studies how sparsity allocation shapes post-repair recoverability under a fixed activation-statistic repair backend. We compare ERK and LAMP allocations under the same label-free repair protocol across CIFAR-10, CIFAR-100, and Imagenette with ResNet-18, ResNet-34, and ResNet-50 at sparsities from 90% to 95.5%. The results show that allocation choice can substantially change post-repair accuracy at the same global sparsity, and that the preferred allocation varies with architecture, dataset difficulty, and sparsity level. We identify a repair-sensitive transition regime in which BatchNorm recalibration begins to fail, while activation-statistic repair still recovers nontrivial accuracy. Additional validation on ImageNet-100 and DenseNet-121 shows that the location and width of this recoverable regime depend on data scale and connectivity structure. These findings suggest that pruning allocation and post-pruning repair should be studied jointly, since the allocation determines how much activation signal remains available for label-free recovery.

Key facts. No citing papers in the map yet (data through 14 Oct 2026). Builds on 8 of its 12 references that are in the map. First posted on arXiv 21 May 2026.

Builds on

8 of 12 references.

References · 8

  1. 2018The Lottery Ticket Hypothesis: Finding Sparse, Trainable Neural Networkscited by 2,262
  2. 2015Learning both Weights and Connections for Efficient Neural Networkscited by 2,031
  3. 2020Up or Down? Adaptive Rounding for Post-Training Quantizationcited by 621
  4. 2019Rigging the Lottery: Making All Tickets Winnerscited by 495
  5. 2019Data-Free Quantization Through Weight Equalization and Bias Correctioncited by 336
  6. 2022REPAIR: REnormalizing Permuted Activations for Interpolation Repaircited by 120
  7. 2021Post-training deep neural network pruning via layer-wise calibrationcited by 24
  8. 2026Adaptive Signal Resuscitation: Channel-wise Post-Pruning Repair for Sparse Vision Networkscited by 1

Built on by

Not cited yet.