Mutation is all you need
Not on the map. Why?
Abstract (arXiv)
Neural architecture search (NAS) promises to make deep learning accessible to non-experts by automating architecture engineering of deep neural networks. BANANAS is one state-of-the-art NAS method that is embedded within the Bayesian optimization framework. Recent experimental findings have demonstrated the strong performance of BANANAS on the NAS-Bench-101 benchmark being determined by its path encoding and not its choice of surrogate model. We present experimental results suggesting that the performance of BANANAS on the NAS-Bench-301 benchmark is determined by its acquisition function optimizer, which minimally mutates the incumbent.
Key facts. Cited by 3 papers in the map (data through 7 Oct 2026). Builds on 18 of its 39 references that are in the map. First posted on arXiv 4 Jul 2021.
Builds on
18 of 39 references.
References · 18
- 2018DARTS: Differentiable Architecture Searchcited by 1,782
- 2016Neural Architecture Search with Reinforcement Learningcited by 1,489
- 2017Learning Transferable Architectures for Scalable Image Recognitioncited by 1,097
- 2018Regularized Evolution for Image Classifier Architecture Searchcited by 902
- 2018Efficient Neural Architecture Search via Parameter Sharingcited by 831
- 2017Large-Scale Evolution of Image Classifierscited by 348
- 2019NAS-Bench-101: Towards Reproducible Neural Architecture Searchcited by 340
- 2018Neural Architecture Search with Bayesian Optimisation and Optimal Transportcited by 192
- 2017Hierarchical Representations for Efficient Architecture Searchcited by 188
- 2019BANANAS: Bayesian Optimization with Neural Architectures for Neural Architecture Searchcited by 175
- 2015ranger: A Fast Implementation of Random Forests for High Dimensional Data in C++ and Rcited by 171
- 2018Efficient Multi-objective Neural Architecture Search via Lamarckian Evolutioncited by 151
6 more
- 2021How Powerful are Performance Predictors in Neural Architecture Search?cited by 88
- 2019Best Practices for Scientific Research on Neural Architecture Searchcited by 53
- 2020A Study on Encodings for Neural Architecture Searchcited by 37
- 2019BOAH: A Tool Suite for Multi-Fidelity Bayesian Optimization & Analysis of Hyperparameterscited by 25
- 2021Bag of Baselines for Multi-objective Joint Neural Architecture Search and Hyperparameter Optimizationcited by 19
- 2020A Unifying Framework for Parallel and Distributed Processing in R using Futurescited by 9
Built on by
Citing papers per year: 2022: 2; 2023: 1.
3 papers.