RiPPLE: Cross-Space Performance Prediction from Early Training for Neural Architecture Search
Not on the map. Why?
Abstract (arXiv)
Neural architecture search (NAS) evaluates candidate networks, but fully training enough architectures to rank an entire space is expensive. Zero-cost proxies score architectures at initialization, yet their ranking quality varies across search spaces. Learned predictors reduce evaluation cost but typically require fully trained labels or partial-training features for individual candidates. We introduce RiPPLE, underlineRanking vunderlineia underlinePrefix-underlinePropagated underlineLabel underlineExtrapolation, which treats partial training as a source of labels for a small coverage set of anchors. RiPPLE trains these anchors to an early prefix, extrapolates their learning curves to surrogate labels, and propagates the labels over label-free architecture features. The early-training signal remains a label on the anchors rather than a per-candidate feature. Feature, readout, and encoding rules are selected without held-out accuracy and reused across search spaces. We evaluate the method on twelve benchmark cells from four search-space families and on the larger DARTS space. The results examine ranking quality, label efficiency, architecture selection, and the roles of readout, coverage, and propagation. RiPPLE provides a whole-space ranking from a fractional anchor-training budget, with comparisons interpreted under their respective evaluation and cost protocols.
Key facts. No citing papers in the map yet (data through 7 Oct 2026). Builds on 38 of its 47 references that are in the map. First posted on arXiv 11 Sep 2026.
Builds on
38 of 47 references.
References · 38
- 2018DARTS: Differentiable Architecture Searchcited by 1,782
- 2018Efficient Neural Architecture Search via Parameter Sharingcited by 831
- 2016Hyperband: A Novel Bandit-Based Approach to Hyperparameter Optimizationcited by 688
- 2018BOHB: Robust and Efficient Hyperparameter Optimization at Scalecited by 466
- 2020NAS-Bench-201: Extending the Scope of Reproducible Neural Architecture Searchcited by 412
- 2019Single Path One-Shot Neural Architecture Search with Uniform Samplingcited by 411
- 2019NAS-Bench-101: Towards Reproducible Neural Architecture Searchcited by 340
- 2021Do Transformers Really Perform Bad for Graph Representation?cited by 318
- 2021Zero-Cost Proxies for Lightweight NAScited by 194
- 2022Representing Long-Range Context for Graph Neural Networks with Global Attentioncited by 193
- 2018Neural Architecture Optimizationcited by 164
- 2023Neural Architecture Search: Insights from 1000 Paperscited by 136
26 more
- 2019Neural Predictor for Neural Architecture Searchcited by 116
- 2020BRP-NAS: Prediction-based NAS using GCNscited by 109
- 2020NATS-Bench: Benchmarking NAS Algorithms for Architecture Topology and Sizecited by 98
- 2021How Powerful are Performance Predictors in Neural Architecture Search?cited by 88
- 2020NAS-Bench-NLP: Neural Architecture Search Benchmark for Natural Language Processingcited by 60
- 2021TransNAS-Bench-101: Improving Transferability and Generalizability of Cross-Task Neural Architecture Searchcited by 57
- 2023ZiCo: Zero-shot NAS via Inverse Coefficient of Variation on Gradientscited by 57
- 2020A Generic Graph-based Neural Architecture Encoding Scheme for Predictor-based NAScited by 53
- 2020Semi-Supervised Neural Architecture Searchcited by 45
- 2023Efficient Bayesian Learning Curve Extrapolation using Prior-Data Fitted Networkscited by 37
- 2022NAS-Bench-Suite-Zero: Accelerating Research on Zero Cost Proxiescited by 36
- 2019ReNAS:Relativistic Evaluation of Neural Architecture Searchcited by 35
- 2024AZ-NAS: Assembling Zero-Cost Proxies for Network Architecture Searchcited by 25
- 2020Speedy Performance Estimation for Neural Architecture Searchcited by 24
- 2022NAR-Former: Neural Architecture Representation Learning towards Holistic Attributes Predictioncited by 12
- 2024SWAP-NAS: Sample-Wise Activation Patterns for Ultra-fast NAScited by 11
- 2024FlowerFormer: Empowering Neural Architecture Encoding using a Flow-aware Graph Transformercited by 9
- 2026Breaking Semantic-Aware Watermarks via LLM-Guided Coherence-Preserving Semantic Injectioncited by 7
- 2023PA&DA: Jointly Sampling PAth and DAta for Consistent NAScited by 6
- 2023NAR-Former V2: Rethinking Transformer for Universal Neural Network Representation Learningcited by 6
- 2025L-SWAG: Layer-Sample Wise Activation with Gradients information for Zero-Shot NAS on Vision Transformerscited by 5
- 2026SLICE: Semantic Latent Injection via Compartmentalized Embedding for Image Watermarkingcited by 5
- 2026SHIFT: Stochastic Hidden-Trajectory Deflection for Removing Diffusion-based Watermarkcited by 3
- 2026LAVA: Layered Audio-Visual Anti-tampering Watermarking for Robust Deepfake Detection and Localizationcited by 3
- 2025NN-Former: Rethinking Graph Structure in Neural Architecture Representationcited by 2
- 2026CoRA-NAS: Coarse Ranking and Anchor-Residual Refinement for Neural Architecture Searchcited by 1
Built on by
Not cited yet.