mlsanityData to 14 Oct 2026

Multi-trial Neural Architecture Search with Lottery Tickets

arXiv 2203.04300 ↗First posted 8 Mar 2022cs.LG cs.CV cs.NEcited by 0

Not on the map. Why?

Abstract (arXiv)

Neural architecture search (NAS) has brought significant progress in recent image recognition tasks. Most existing NAS methods apply restricted search spaces, which limits the upper-bound performance of searched models. To address this issue, we propose a new search space named MobileNet3-MT. By reducing human-prior knowledge in omni dimensions of networks, MobileNet3-MT accommodates more potential candidates. For searching in this challenging search space, we present an efficient Multi-trial Evolution-based NAS method termed MENAS. Specifically, we accelerate the evolutionary search process by gradually pruning models in the population. Each model is trained with an early stop and replaced by its Lottery Tickets (the explored optimal pruned network).In this way, the full training pipeline of cumbersome networks is prevented and more efficient networks are automatically generated. Extensive experimental results on ImageNet-1K, CIFAR-10, and CIFAR-100 demonstrate that MENAS achieves state-of-the-art performance.

Key facts. No citing papers in the map yet (data through 14 Oct 2026). Builds on 37 of its 51 references that are in the map. First posted on arXiv 8 Mar 2022.

Builds on

37 of 51 references.

References · 37

  1. 2015Deep Residual Learning for Image Recognitioncited by 52,096
  2. 2020An Image is Worth 16x16 Words: Transformers for Image Recognition at Scalecited by 30,186
  3. 2015Distilling the Knowledge in a Neural Networkcited by 10,324
  4. 2014ImageNet Large Scale Visual Recognition Challengecited by 8,498
  5. 2019EfficientNet: Rethinking Model Scaling for Convolutional Neural Networkscited by 6,442
  6. 2018MobileNetV2: Inverted Residuals and Linear Bottleneckscited by 4,795
  7. 2017Squeeze-and-Excitation Networkscited by 4,789
  8. 2022A ConvNet for the 2020scited by 3,579
  9. 2019RandAugment: Practical automated data augmentation with a reduced search spacecited by 2,269
  10. 2018The Lottery Ticket Hypothesis: Finding Sparse, Trainable Neural Networkscited by 2,262
  11. 2019Searching for MobileNetV3cited by 1,994
  12. 2018DARTS: Differentiable Architecture Searchcited by 1,798
25 more
  1. 2016Neural Architecture Search with Reinforcement Learningcited by 1,499
  2. 2017Learning Transferable Architectures for Scalable Image Recognitioncited by 1,101
  3. 2020Designing Network Design Spacescited by 960
  4. 2018MnasNet: Platform-Aware Neural Architecture Search for Mobilecited by 943
  5. 2018Regularized Evolution for Image Classifier Architecture Searchcited by 909
  6. 2019Once-for-All: Train One Network and Specialize it for Efficient Deploymentcited by 787
  7. 2018ProxylessNAS: Direct Neural Architecture Search on Target Task and Hardwarecited by 673
  8. 2018Rethinking the Value of Network Pruningcited by 599
  9. 2018BOHB: Robust and Efficient Hyperparameter Optimization at Scalecited by 470
  10. 2019Single Path One-Shot Neural Architecture Search with Uniform Samplingcited by 414
  11. 2021ResNet strikes back: An improved training procedure in timmcited by 368
  12. 2021ResMLP: Feedforward networks for image classification with data-efficient trainingcited by 339
  13. 2019MetaPruning: Meta Learning for Automatic Neural Network Channel Pruningcited by 227
  14. 2021AutoFormer: Searching Transformers for Visual Recognitioncited by 188
  15. 2019Understanding and Robustifying Differentiable Architecture Searchcited by 178
  16. 2019Drawing Early-Bird Tickets: Towards More Efficient Training of Deep Networkscited by 160
  17. 2017Genetic CNNcited by 124
  18. 2019Exploring Randomly Wired Neural Networks for Image Recognitioncited by 103
  19. 2020NATS-Bench: Benchmarking NAS Algorithms for Architecture Topology and Sizecited by 98
  20. 2020EagleEye: Fast Sub-net Evaluation for Efficient Neural Network Pruningcited by 80
  21. 2019CARS: Continuous Evolution for Efficient Neural Architecture Searchcited by 79
  22. 2020Can weight sharing outperform random architecture search? An investigation with TuNAScited by 68
  23. 2019Densely Connected Search Space for More Flexible Neural Architecture Searchcited by 52
  24. 2018You Only Search Once: Single Shot Neural Architecture Search via Direct Sparse Optimizationcited by 23
  25. 2022B2EA: An Evolutionary Algorithm Assisted by Two Bayesian Optimization Modules for Neural Architecture Searchcited by 3

Built on by

Not cited yet.