mlsanityData to 7 Oct 2026

XNAS: Neural Architecture Search with Expert Advice

arXiv 1906.08031 ↗First posted 19 Jun 2019cs.LG cs.CV math.OCcited by 35

Not on the map. Why?

Abstract (arXiv)

This paper introduces a novel optimization method for differential neural architecture search, based on the theory of prediction with expert advice. Its optimization criterion is well fitted for an architecture-selection, i.e., it minimizes the regret incurred by a sub-optimal selection of operations. Unlike previous search relaxations, that require hard pruning of architectures, our method is designed to dynamically wipe out inferior architectures and enhance superior ones. It achieves an optimal worst-case regret bound and suggests the use of multiple learning-rates, based on the amount of information carried by the backward gradients. Experiments show that our algorithm achieves a strong performance over several image classification datasets. Specifically, it obtains an error rate of 1.6% for CIFAR-10, 24% for ImageNet under mobile settings, and achieves state-of-the-art results on three additional datasets.

Key facts. Cited by 35 papers in the map (data through 7 Oct 2026). First posted on arXiv 19 Jun 2019.

Builds on

No reference list yet.

Built on by

Cited by year (2026 to 7 Oct)

Citing papers per year: 2021: 19; 2022: 8; 2023: 3; 2024: 2; 2025: 2; 2026: 1.

35 papers.

Sort:

By area:

  1. 2023Neural Architecture Search: Insights from 1000 Paperscited by 136
  2. 2021A Comprehensive Survey on Hardware-Aware Neural Architecture Searchcited by 60
  3. 2021iDARTS: Differentiable Architecture Search with Stochastic Implicit Gradientscited by 51
  4. 2022Revisiting Random Channel Pruning for Neural Network Compressioncited by 50
  5. 2021DiNTS: Differentiable Neural Network Topology Search for 3D Medical Image Segmentationcited by 47
  6. 2021Searching the Search Space of Vision Transformercited by 39
  7. 2021HardCoRe-NAS: Hard Constrained diffeRentiable Neural Architecture Searchcited by 20
  8. 2021BatchQuant: Quantized-for-all Architecture Search with Robust Quantizercited by 19
  9. 2021One-Shot Neural Ensemble Architecture Search by Diversity-Guided Search Space Shrinkingcited by 12
  10. 2022DropNAS: Grouped Operation Dropout for Differentiable Architecture Searchcited by 12
  11. 2021iDARTS: Improving DARTS by Node Normalization and Decorrelation Discretizationcited by 10
  12. 2021Landmark Regularization: Ranking Guided Super-Net Training in Neural Architecture Searchcited by 8
23 more
  1. 2021Search For Deep Graph Neural Networkscited by 6
  2. 2021BaLeNAS: Differentiable Architecture Search via the Bayesian Learning Rulecited by 5
  3. 2021Manas: Mining Software Repositories to Assist AutoMLcited by 5
  4. 2021A Convergence Theory Towards Practical Over-parameterized Deep Neural Networkscited by 4
  5. 2021Multiplicative Reweighting for Robust Neural Network Optimizationcited by 4
  6. 2022Learn Basic Skills and Reuse: Modularized Adaptive Neural Architecture Search (MANAS)cited by 4
  7. 2023Video Action Recognition Collaborative Learning with Dynamics via PSO-ConvNet Transformercited by 4
  8. 2023Weight-Entanglement Meets Gradient-Based Neural Architecture Searchcited by 4
  9. 2024FreeAugment: Data Augmentation Search Across All Degrees of Freedomcited by 3
  10. 2021Integrating Large Circular Kernels into CNNs through Neural Architecture Searchcited by 2
  11. 2021An Analysis of Super-Net Heuristics in Weight-Sharing NAScited by 2
  12. 2021BINAS: Bilinear Interpretable Neural Architecture Searchcited by 2
  13. 2022U-Boost NAS: Utilization-Boosted Differentiable Neural Architecture Searchcited by 2
  14. 2024ApproxDARTS: Differentiable Neural Architecture Search with Approximate Multiplierscited by 1
  15. 2021Advances in Electron Microscopy with Deep Learningcited by 0
  16. 2021MS-DARTS: Mean-Shift Based Differentiable Architecture Searchcited by 0
  17. 2022Neural Architecture Search for Inversioncited by 0
  18. 2022Approximating Permutations with Neural Network Components for Travelling Photographer Problemcited by 0
  19. 2022UnrealNAS: Can We Search Neural Architectures with Unreal Data?cited by 0
  20. 2022NEON: Enabling Efficient Support for Nonlinear Operations in Resistive RAM-based Neural Network Acceleratorscited by 0
  21. 2025Exploring Vision Neural Network Pruning via Screening Methodologycited by 0
  22. 2025FX-DARTS: Designing Topology-unconstrained Architectures with Differentiable Architecture Search and Entropy-based Super-network Shrinkingcited by 0
  23. 2026Structure Aware Neural Architecture Search for Mixture of Expertscited by 0