FENAS: A Few-Shot Meta-Ensembling Framework for Efficient Neural Architecture Search with Synergized Zero-Cost Proxies
Not on the map. Why?
Abstract (arXiv)
Efficient neural architecture search (NAS) requires accurate performance estimation under limited evaluation budgets. Existing zero-cost proxies (ZCPs) provide fast training-free signals, but each proxy usually captures only a partial property of an architecture, leading to unstable rankings across datasets and search spaces. In contrast, GNN-based predictors can improve accuracy, but often depend on labeled architectures, graph encoders, and costly representation learning, which makes them less suitable for extreme few-shot settings. We propose FENAS, a topology-agnostic few-shot prediction framework that turns complementary initialization priors into robust ranking signals. Its core component, CAST, is a feature pipeline that combines copula alignment and synergy transformation. CAST maps heterogeneous ZCPs into a compact feature manifold, enabling lightweight meta-learners to produce reliable rankings from scarce supervision. On NAS-Bench-201, with only 0.5% labeled samples, FENAS achieves a Kendall's Tau (τ) of 0.70, outperforming representative topology-based few-shot predictors in this low-label regime. In closed-domain search, FENAS evaluates the NAS-Bench-201 space in approximately 1138 seconds and achieves competitive test accuracy. By providing a fast, reliable, and structurally simple evaluation mechanism, FENAS supports the design of automated neural architectures under limited evaluation budgets.
Key facts. No citing papers in the map yet (data through 14 Oct 2026). Builds on 30 of its 36 references that are in the map. First posted on arXiv 11 Oct 2026.
Builds on
30 of 36 references.
References · 30
- 2017A Unified Approach to Interpreting Model Predictionscited by 6,555
- 2016XGBoost: A Scalable Tree Boosting Systemcited by 5,166
- 2018DARTS: Differentiable Architecture Searchcited by 1,798
- 2016Neural Architecture Search with Reinforcement Learningcited by 1,499
- 2018Regularized Evolution for Image Classifier Architecture Searchcited by 909
- 2020Pruning neural networks without any data by iteratively conserving synaptic flowcited by 479
- 2014New insights and perspectives on the natural gradient methodcited by 443
- 2020NAS-Bench-201: Extending the Scope of Reproducible Neural Architecture Searchcited by 416
- 2017A Downsampled Variant of ImageNet as an Alternative to the CIFAR datasetscited by 377
- 2019NAS-Bench-101: Towards Reproducible Neural Architecture Searchcited by 344
- 2016On the Expressive Power of Deep Neural Networkscited by 306
- 2020Neural Architecture Search without Trainingcited by 244
18 more
- 2021Zero-Cost Proxies for Lightweight NAScited by 199
- 2019BANANAS: Bayesian Optimization with Neural Architectures for Neural Architecture Searchcited by 179
- 2019Understanding and Robustifying Differentiable Architecture Searchcited by 178
- 2018Neural Architecture Optimizationcited by 167
- 2019Fair DARTS: Eliminating Unfair Advantages in Differentiable Architecture Searchcited by 131
- 2019Neural Predictor for Neural Architecture Searchcited by 118
- 2020BRP-NAS: Prediction-based NAS using GCNscited by 111
- 2018Universal Statistics of Fisher Information in Deep Neural Networks: Mean Field Approachcited by 91
- 2021How Powerful are Performance Predictors in Neural Architecture Search?cited by 90
- 2020Does Unsupervised Architecture Representation Learning Help Neural Architecture Search?cited by 59
- 2020A Generic Graph-based Neural Architecture Encoding Scheme for Predictor-based NAScited by 55
- 2020Evaluating Efficient Performance Estimators of Neural Architecturescited by 55
- 2019ReNAS:Relativistic Evaluation of Neural Architecture Searchcited by 37
- 2021Contrastive Neural Architecture Search with Neural Architecture Comparatorscited by 34
- 2024AZ-NAS: Assembling Zero-Cost Proxies for Network Architecture Searchcited by 28
- 2024CAP: A Context-Aware Neural Predictor for NAScited by 5
- 2024NEAR: A Training-Free Pre-Estimator of Machine Learning Model Performancecited by 1
- 2025Evolutionary Neural Architecture Search with Dual Contrastive Learningcited by 1
Built on by
Not cited yet.