mlsanityData to 7 Oct 2026

Best Practices for Scientific Research on Neural Architecture Search

arXiv 1909.02453 ↗First posted 5 Sep 2019cs.LG stat.MLcited by 53

Not on the map. Why?

Abstract (arXiv)

Finding a well-performing architecture is often tedious for both DL practitioners and researchers, leading to tremendous interest in the automation of this task by means of neural architecture search (NAS). Although the community has made major strides in developing better NAS methods, the quality of scientific empirical evaluations in the young field of NAS is still lacking behind that of other areas of machine learning. To address this issue, we describe a set of possible issues and ways to avoid them, leading to the NAS best practices checklist available at http://automl.org/nas_checklist.pdf.

Key facts. Cited by 53 papers in the map (data through 7 Oct 2026). First posted on arXiv 5 Sep 2019.

Builds on

No reference list yet.

Built on by

Cited by year (2026 to 7 Oct)

Citing papers per year: 2021: 16; 2022: 11; 2023: 10; 2024: 8; 2025: 5; 2026: 3.

53 papers.

Sort:

By area:

  1. 2021Hyperparameter Optimization: Foundations, Algorithms, Best Practices and Open Challengescited by 143
  2. 2023Neural Architecture Search: Insights from 1000 Paperscited by 136
  3. 2021HPOBench: A Collection of Reproducible Multi-Fidelity Benchmark Problems for HPOcited by 111
  4. 2025MLGym: A New Framework and Benchmark for Advancing AI Research Agentscited by 111
  5. 2021How Powerful are Performance Predictors in Neural Architecture Search?cited by 88
  6. 2022Automated Reinforcement Learning (AutoRL): A Survey and Open Problemscited by 69
  7. 2023Hyperparameters in Reinforcement Learning and How To Tune Themcited by 58
  8. 2022NAS-Bench-Suite: NAS Evaluation is (Now) Surprisingly Easycited by 36
  9. 2022NAS-Bench-Suite-Zero: Accelerating Research on Zero Cost Proxiescited by 36
  10. 2023AutoML in the Age of Large Language Models: Current Challenges, Future Opportunities and Riskscited by 34
  11. 2024Quantum Architecture Search: A Surveycited by 31
  12. 2021CLEVA-Compass: A Continual Learning EValuation Assessment Compass to Promote Research Transparency and Comparabilitycited by 28
38 more
  1. 2022NAS-Bench-Graph: Benchmarking Graph Neural Architecture Searchcited by 25
  2. 2021EPE-NAS: Efficient Performance Estimation Without Training for Neural Architecture Searchcited by 24
  3. 2021NAS-Bench-x11 and the Power of Learning Curvescited by 20
  4. 2023DiffusionNAG: Predictor-guided Neural Architecture Generation with Diffusion Modelscited by 15
  5. 2022DeepCAVE: An Interactive Analysis Tool for Automated Machine Learningcited by 14
  6. 2021Automated Deep Learning: Neural Architecture Search Is Not the Endcited by 13
  7. 2023SoK: Pragmatic Assessment of Machine Learning for Network Intrusion Detectioncited by 13
  8. 2024Surprisingly Strong Performance Prediction with Neural Graph Featurescited by 11
  9. 2022Construction of Hierarchical Neural Architecture Search Spaces based on Context-free Grammarscited by 9
  10. 2024NACHOS: Neural Architecture Search for Hardware Constrained Early Exit Neural Networkscited by 9
  11. 2024Encodings for Prediction-based Neural Architecture Searchcited by 9
  12. 2024On Latency Predictors for Neural Architecture Searchcited by 7
  13. 2021Bag of Tricks for Neural Architecture Searchcited by 4
  14. 2021Fitness Landscape Footprint: A Framework to Compare Neural Architecture Search Problemscited by 4
  15. 2022Towards Less Constrained Macro-Neural Architecture Searchcited by 4
  16. 2021FEAR: A Simple Lightweight Method to Rank Architecturescited by 3
  17. 2021Mutation is all you needcited by 3
  18. 2022Posterior temperature optimized Bayesian models for inverse problems in medical imagingcited by 3
  19. 2022B2EA: An Evolutionary Algorithm Assisted by Two Bayesian Optimization Modules for Neural Architecture Searchcited by 3
  20. 2023Are Neural Architecture Search Benchmarks Well Designed? A Deeper Look Into Operation Importancecited by 3
  21. 2024AutoGCN -- Towards Generic Human Activity Recognition with Neural Architecture Searchcited by 3
  22. 2021Improving the sample-efficiency of neural architecture search with reinforcement learningcited by 2
  23. 2023Rethink DARTS Search Space and Renovate a New Benchmarkcited by 2
  24. 2025MONAQ: Multi-Objective Neural Architecture Querying for Time-Series Analysis on Resource-Constrained Devicescited by 2
  25. 2025How NOT to benchmark your SITE metric: Beyond Static Leaderboards and Towards Realistic Evaluationcited by 2
  26. 2021Recovering Quantitative Models of Human Information Processing with Differentiable Architecture Searchcited by 1
  27. 2021Evaluating Generic Auto-ML Tools for Computational Pathologycited by 1
  28. 2022Landscape of Neural Architecture Search across sensors: how much do they differ ?cited by 1
  29. 2022Long-term Reproducibility for Neural Architecture Searchcited by 1
  30. 2023Accurate Detection of Paroxysmal Atrial Fibrillation with Certified-GAN and Neural Architecture Searchcited by 1
  31. 2026Advancing Automated Algorithm Design via Evolutionary Stagewise Design with LLMscited by 1
  32. 2021GPNAS: A Neural Network Architecture Search Framework Based on Graphical Predictorcited by 0
  33. 2021Poisoning the Search Space in Neural Architecture Searchcited by 0
  34. 2023A Survey on Multi-Objective Neural Architecture Searchcited by 0
  35. 2023Machine learning's own Industrial Revolutioncited by 0
  36. 2024ECToNAS: Evolutionary Cross-Topology Neural Architecture Searchcited by 0
  37. 2024Efficient Deep Learning Board: Training Feedback Is Not All You Needcited by 0
  38. 2025Efficient Global Neural Architecture Searchcited by 0

50 most cited of 53 All 53 (JSON)