mlsanityData to 13 Oct 2026

Pruning as a Game: Equilibrium-Driven Sparsification of Neural Networks

arXiv 2512.22106 ↗First posted 26 Dec 2025cs.AIcited by 0

Not on the map. Why?

Abstract (arXiv)

Neural network pruning is widely used to reduce model size and computational cost. Yet, most existing methods treat sparsity as an externally imposed constraint, enforced through heuristic importance scores or training-time regularization. In this work, we propose a fundamentally different perspective: pruning as an equilibrium outcome of strategic interaction among model components. We model parameter groups such as weights, neurons, or filters as players in a continuous non-cooperative game, where each player selects its level of participation in the network to balance contribution against redundancy and competition. Within this formulation, sparsity emerges naturally when continued participation becomes a dominated strategy at equilibrium. We analyze the resulting game and show that dominated players collapse to zero participation under mild conditions, providing a principled explanation for pruning behavior. Building on this insight, we derive a simple equilibrium-driven pruning algorithm that jointly updates network parameters and participation variables without relying on explicit importance scores. This work focuses on establishing a principled formulation and empirical validation of pruning as an equilibrium phenomenon, rather than exhaustive architectural or large-scale benchmarking. Experiments on standard benchmarks demonstrate that the proposed approach achieves competitive sparsity-accuracy trade-offs while offering an interpretable, theory-grounded alternative to existing pruning methods.

Key facts. No citing papers in the map yet (data through 13 Oct 2026). Builds on 13 of its 21 references that are in the map. First posted on arXiv 26 Dec 2025.

Builds on

13 of 21 references.

References · 13

  1. 2015Learning both Weights and Connections for Efficient Neural Networkscited by 2,017
  2. 2017Multi-Agent Actor-Critic for Mixed Cooperative-Competitive Environmentscited by 1,525
  3. 2016Pruning Filters for Efficient ConvNetscited by 1,138
  4. 2023SparseGPT: Massive Language Models Can Be Accurately Pruned in One-Shotcited by 1,103
  5. 2023A Simple and Effective Pruning Approach for Large Language Modelscited by 787
  6. 2017Learning Sparse Neural Networks through L0 Regularizationcited by 574
  7. 2017Scalable Training of Artificial Neural Networks with Adaptive Sparse Connectivity inspired by Network Sciencecited by 326
  8. 2018Soft Filter Pruning for Accelerating Deep Convolutional Neural Networkscited by 315
  9. 2021The Distributed Discrete Gaussian Mechanism for Federated Learning with Secure Aggregationcited by 128
  10. 2021A Unified Lottery Ticket Hypothesis for Graph Neural Networkscited by 118
  11. 2023LoSparse: Structured Compression of Large Language Models based on Low-Rank and Sparse Approximationcited by 104
  12. 2020Gradient Flow in Sparse Neural Networks and How Lottery Tickets Wincited by 77
1 more
  1. 2021Why Lottery Ticket Wins? A Theoretical Perspective of Sample Complexity on Pruned Neural Networkscited by 14

Built on by

Not cited yet.