mlsanityData to 7 Oct 2026

Scalable Reinforcement Learning-based Neural Architecture Search

arXiv 2410.01431 ↗First posted 2 Oct 2024cs.LGcited by 5

Not on the map. Why?

Abstract (arXiv)

In this publication, we assess the ability of a novel Reinforcement Learning-based solution to the problem of Neural Architecture Search, where a Reinforcement Learning (RL) agent learns to search for good architectures, rather than to return a single optimal architecture. We consider both the NAS-Bench-101 and NAS- Bench-301 settings, and compare against various known strong baselines, such as local search and random search. We conclude that our Reinforcement Learning agent displays strong scalability with regards to the size of the search space, but limited robustness to hyperparameter changes.

Key facts. Cited by 5 papers in the map (data through 7 Oct 2026). Builds on 32 of its 47 references that are in the map. First posted on arXiv 2 Oct 2024.

Builds on

32 of 47 references.

References · 32

  1. 2017Attention Is All You Needcited by 59,932
  2. 2015Deep Residual Learning for Image Recognitioncited by 51,809
  3. 2020An Image is Worth 16x16 Words: Transformers for Image Recognition at Scalecited by 29,915
  4. 2016Layer Normalizationcited by 5,579
  5. 2014Going Deeper with Convolutionscited by 4,231
  6. 2013Playing Atari with Deep Reinforcement Learningcited by 3,211
  7. 2018DARTS: Differentiable Architecture Searchcited by 1,782
  8. 2016Neural Architecture Search with Reinforcement Learningcited by 1,489
  9. 2017Learning Transferable Architectures for Scalable Image Recognitioncited by 1,097
  10. 2015Prioritized Experience Replaycited by 1,070
  11. 2018Efficient Neural Architecture Search via Parameter Sharingcited by 831
  12. 2015Dueling Network Architectures for Deep Reinforcement Learningcited by 769
20 more
  1. 2017Large-Scale Evolution of Image Classifierscited by 348
  2. 2019NAS-Bench-101: Towards Reproducible Neural Architecture Searchcited by 340
  3. 2016Designing Neural Network Architectures using Reinforcement Learningcited by 277
  4. 2018Distributed Prioritized Experience Replaycited by 260
  5. 2020Neural Architecture Search without Trainingcited by 241
  6. 2019BANANAS: Bayesian Optimization with Neural Architectures for Neural Architecture Searchcited by 175
  7. 2018Efficient Multi-objective Neural Architecture Search via Lamarckian Evolutioncited by 151
  8. 2023Neural Architecture Search: Insights from 1000 Paperscited by 136
  9. 2019Fair DARTS: Eliminating Unfair Advantages in Differentiable Architecture Searchcited by 129
  10. 2017A Deeper Look at Experience Replaycited by 104
  11. 2019Auto-GNN: Neural Architecture Search of Graph Neural Networkscited by 73
  12. 2017Time Limits in Reinforcement Learningcited by 72
  13. 2020Semi-Supervised Neural Architecture Searchcited by 45
  14. 2020Exploring the Loss Landscape in Neural Architecture Searchcited by 20
  15. 2022Demystifying the Neural Tangent Kernel from a Practical Perspective: Can it be trusted for Neural Architecture Search without training?cited by 18
  16. 2018Neural Architecture Search using Deep Neural Networks and Monte Carlo Tree Searchcited by 17
  17. 2020Local Search is a Remarkably Strong Baseline for Neural Architecture Searchcited by 15
  18. 2024Surprisingly Strong Performance Prediction with Neural Graph Featurescited by 11
  19. 2022GraphPNAS: Learning Distribution of Good Neural Architectures via Deep Graph Generative Modelscited by 5
  20. 2022CR-LSO: Convex Neural Architecture Optimization in the Latent Space of Graph Variational Autoencoder with Input Convex Neural Networkscited by 2

Built on by

Cited by year

Citing papers per year: 2024: 1; 2025: 4.

5 papers.

  1. 2024Designing a Classifier for Active Fire Detection from Multispectral Satellite Imagery Using Neural Architecture Searchcited by 2
  2. 2025DDS-NAS: Dynamic Data Selection within Neural Architecture Search via On-line Hard Example Mining applied to Image Classificationcited by 1
  3. 2025Evolution Meets Diffusion: Efficient Neural Architecture Generationcited by 0
  4. 2025An Integrated Approach to Neural Architecture Search for Deep Q-Networkscited by 0
  5. 2025Dynamic Rank Reinforcement Learning for Adaptive Low-Rank Multi-Head Self Attention in Large Language Modelscited by 0