mlsanityData to 14 Oct 2026

A Generalized Lottery Ticket Hypothesis

arXiv 2107.06825 ↗First posted 3 Jul 2021cs.LG cs.CVcited by 5

Not on the map. Why?

Abstract (arXiv)

We introduce a generalization to the lottery ticket hypothesis in which the notion of "sparsity" is relaxed by choosing an arbitrary basis in the space of parameters. We present evidence that the original results reported for the canonical basis continue to hold in this broader setting. We describe how structured pruning methods, including pruning units or factorizing fully-connected layers into products of low-rank matrices, can be cast as particular instances of this "generalized" lottery ticket hypothesis. The investigations reported here are preliminary and are provided to encourage further research along this direction.

Key facts. Cited by 5 papers in the map (data through 14 Oct 2026). Builds on 13 of its 13 references that are in the map. First posted on arXiv 3 Jul 2021.

Builds on

13 of 13 references.

References · 13

  1. 2020Scaling Laws for Neural Language Modelscited by 6,586
  2. 2018The Lottery Ticket Hypothesis: Finding Sparse, Trainable Neural Networkscited by 2,262
  3. 2018Gradient Descent Provably Optimizes Over-parameterized Neural Networkscited by 659
  4. 2018Rethinking the Value of Network Pruningcited by 599
  5. 2016Learning Structured Sparsity in Deep Neural Networkscited by 541
  6. 2021Sparsity in Deep Learning: Pruning and growth for efficient inference and training in neural networkscited by 527
  7. 2018Measuring the Intrinsic Dimension of Objective Landscapescited by 370
  8. 2016EIE: Efficient Inference Engine on Compressed Deep Neural Networkcited by 295
  9. 2021Deep learning: a statistical viewpointcited by 240
  10. 2013Predicting Parameters in Deep Learningcited by 224
  11. 2019Drawing Early-Bird Tickets: Towards More Efficient Training of Deep Networkscited by 160
  12. 2019Global Sparse Momentum SGD for Pruning Very Deep Neural Networkscited by 70
1 more
  1. 2018Full deep neural network training on a pruned weight budgetcited by 11

Built on by

Cited by year (2026 to 14 Oct)

Citing papers per year: 2021: 1; 2022: 2; 2023: 0; 2024: 1; 2025: 0; 2026: 1.

5 papers.

  1. 2022Coarsening the Granularity: Towards Structurally Sparse Lottery Ticketscited by 27
  2. 2024A Survey of Lottery Ticket Hypothesiscited by 24
  3. 2022Depth Pruning with Auxiliary Networks for TinyMLcited by 4
  4. 2021Juvenile state hypothesis: What we can learn from lottery ticket hypothesis researches?cited by 0
  5. 2026Toy Combinatorial Interpretability Models Reveal Lottery Tickets in Early Feature Spacecited by 0