Breaking the Compression Barrier: Cross-Architecture Compression Boundary Learning via Reverse Regrowth
Not on the map. Why?
Abstract (arXiv)
Model compression is critical for deploying networks on resource-constrained edge devices. While pruning-based methods can significantly reduce model size, they often suffer from abrupt performance collapse beyond a sparsity thresh-old, making it difficult to identify the feasible compression limit of the model. To address this challenge, we propose a boundary-Learning reverse regrowth framework, BRIDGE, that reformulates compression as a constructive boundary-search problem. Unlike forward pruning, our method first drives the model to an extremely sparse state to expose the collapse region, and then selectively regenerates the critical structure to restore performance. The proposed framework employs a hierarchical regeneration strategy, including coarse-grained layer selection and fine-grained regeneration parameter selection, to accurately identify which parameters require recovery. Experiments show that our method can recover models from the brink of collapse on both CNNs and Transformer architectures, demonstrating its architecture in-dependence. BRIDGE achieves a performance improvement of up to 1.49% in unstructured pruning and up to 4.77% in structured pruning. These results demonstrate that reverse regeneration can effectively extend the compression limit while maintaining stable performance. The source code is available at https://github.com/EnumaCaliber/BRIDGE.
Key facts. No citing papers in the map yet (data through 14 Oct 2026). Builds on 29 of its 51 references that are in the map. First posted on arXiv 17 Aug 2026.
Builds on
29 of 51 references.
References · 29
- 2017Attention Is All You Needcited by 60,361
- 2020An Image is Worth 16x16 Words: Transformers for Image Recognition at Scalecited by 30,186
- 2014Very Deep Convolutional Networks for Large-Scale Image Recognitioncited by 15,364
- 2015Distilling the Knowledge in a Neural Networkcited by 10,324
- 2019EfficientNet: Rethinking Model Scaling for Convolutional Neural Networkscited by 6,442
- 2018MobileNetV2: Inverted Residuals and Linear Bottleneckscited by 4,795
- 2019Similarity of Neural Network Representations Revisitedcited by 1,755
- 2016Neural Architecture Search with Reinforcement Learningcited by 1,499
- 2016Pruning Filters for Efficient ConvNetscited by 1,143
- 2018ShuffleNet V2: Practical Guidelines for Efficient CNN Architecture Designcited by 1,136
- 2021DynamicViT: Efficient Vision Transformers with Dynamic Token Sparsificationcited by 864
- 2018Efficient Neural Architecture Search via Parameter Sharingcited by 837
17 more
- 2018SNIP: Single-shot Network Pruning based on Connection Sensitivitycited by 812
- 2017Learning Efficient Convolutional Networks through Network Slimmingcited by 676
- 2021Sparsity in Deep Learning: Pruning and growth for efficient inference and training in neural networkscited by 527
- 2019Rigging the Lottery: Making All Tickets Winnerscited by 495
- 2020Pruning neural networks without any data by iteratively conserving synaptic flowcited by 479
- 2020Picking Winning Tickets Before Training by Preserving Gradient Flowcited by 471
- 2017Scalable Training of Artificial Neural Networks with Adaptive Sparse Connectivity inspired by Network Sciencecited by 328
- 2020MCUNet: Tiny Deep Learning on IoT Devicescited by 273
- 2017Variational Dropout Sparsifies Deep Neural Networkscited by 265
- 2016Dynamic Network Surgery for Efficient DNNscited by 233
- 2021Chasing Sparsity in Vision Transformers: An End-to-End Explorationcited by 183
- 2020Pruning Neural Networks at Initialization: Why are We Missing the Mark?cited by 182
- 2018NetAdapt: Platform-Aware Neural Network Adaptation for Mobile Applicationscited by 147
- 2024SGLP: A Similarity Guided Fast Layer Partition Pruning for Compressing Large Deep Modelscited by 25
- 2023How Sparse Can We Prune A Deep Network: A Fundamental Limit Perspectivecited by 9
- 2025NIRVANA: Structured Pruning Reimagined for Large Language Model Compressioncited by 6
- 2024Comb, Prune, Distill: Towards Unified Pruning for Vision Model Compressioncited by 1
Built on by
Not cited yet.