mlsanityData to 7 Oct 2026

RiPPLE: Cross-Space Performance Prediction from Early Training for Neural Architecture Search

arXiv 2609.12418 ↗First posted 11 Sep 2026cs.LG cs.CVcited by 0

Not on the map. Why?

Abstract (arXiv)

Neural architecture search (NAS) evaluates candidate networks, but fully training enough architectures to rank an entire space is expensive. Zero-cost proxies score architectures at initialization, yet their ranking quality varies across search spaces. Learned predictors reduce evaluation cost but typically require fully trained labels or partial-training features for individual candidates. We introduce RiPPLE, underlineRanking vunderlineia underlinePrefix-underlinePropagated underlineLabel underlineExtrapolation, which treats partial training as a source of labels for a small coverage set of anchors. RiPPLE trains these anchors to an early prefix, extrapolates their learning curves to surrogate labels, and propagates the labels over label-free architecture features. The early-training signal remains a label on the anchors rather than a per-candidate feature. Feature, readout, and encoding rules are selected without held-out accuracy and reused across search spaces. We evaluate the method on twelve benchmark cells from four search-space families and on the larger DARTS space. The results examine ranking quality, label efficiency, architecture selection, and the roles of readout, coverage, and propagation. RiPPLE provides a whole-space ranking from a fractional anchor-training budget, with comparisons interpreted under their respective evaluation and cost protocols.

Key facts. No citing papers in the map yet (data through 7 Oct 2026). Builds on 38 of its 47 references that are in the map. First posted on arXiv 11 Sep 2026.

Builds on

38 of 47 references.

References · 38

  1. 2018DARTS: Differentiable Architecture Searchcited by 1,782
  2. 2018Efficient Neural Architecture Search via Parameter Sharingcited by 831
  3. 2016Hyperband: A Novel Bandit-Based Approach to Hyperparameter Optimizationcited by 688
  4. 2018BOHB: Robust and Efficient Hyperparameter Optimization at Scalecited by 466
  5. 2020NAS-Bench-201: Extending the Scope of Reproducible Neural Architecture Searchcited by 412
  6. 2019Single Path One-Shot Neural Architecture Search with Uniform Samplingcited by 411
  7. 2019NAS-Bench-101: Towards Reproducible Neural Architecture Searchcited by 340
  8. 2021Do Transformers Really Perform Bad for Graph Representation?cited by 318
  9. 2021Zero-Cost Proxies for Lightweight NAScited by 194
  10. 2022Representing Long-Range Context for Graph Neural Networks with Global Attentioncited by 193
  11. 2018Neural Architecture Optimizationcited by 164
  12. 2023Neural Architecture Search: Insights from 1000 Paperscited by 136
26 more
  1. 2019Neural Predictor for Neural Architecture Searchcited by 116
  2. 2020BRP-NAS: Prediction-based NAS using GCNscited by 109
  3. 2020NATS-Bench: Benchmarking NAS Algorithms for Architecture Topology and Sizecited by 98
  4. 2021How Powerful are Performance Predictors in Neural Architecture Search?cited by 88
  5. 2020NAS-Bench-NLP: Neural Architecture Search Benchmark for Natural Language Processingcited by 60
  6. 2021TransNAS-Bench-101: Improving Transferability and Generalizability of Cross-Task Neural Architecture Searchcited by 57
  7. 2023ZiCo: Zero-shot NAS via Inverse Coefficient of Variation on Gradientscited by 57
  8. 2020A Generic Graph-based Neural Architecture Encoding Scheme for Predictor-based NAScited by 53
  9. 2020Semi-Supervised Neural Architecture Searchcited by 45
  10. 2023Efficient Bayesian Learning Curve Extrapolation using Prior-Data Fitted Networkscited by 37
  11. 2022NAS-Bench-Suite-Zero: Accelerating Research on Zero Cost Proxiescited by 36
  12. 2019ReNAS:Relativistic Evaluation of Neural Architecture Searchcited by 35
  13. 2024AZ-NAS: Assembling Zero-Cost Proxies for Network Architecture Searchcited by 25
  14. 2020Speedy Performance Estimation for Neural Architecture Searchcited by 24
  15. 2022NAR-Former: Neural Architecture Representation Learning towards Holistic Attributes Predictioncited by 12
  16. 2024SWAP-NAS: Sample-Wise Activation Patterns for Ultra-fast NAScited by 11
  17. 2024FlowerFormer: Empowering Neural Architecture Encoding using a Flow-aware Graph Transformercited by 9
  18. 2026Breaking Semantic-Aware Watermarks via LLM-Guided Coherence-Preserving Semantic Injectioncited by 7
  19. 2023PA&DA: Jointly Sampling PAth and DAta for Consistent NAScited by 6
  20. 2023NAR-Former V2: Rethinking Transformer for Universal Neural Network Representation Learningcited by 6
  21. 2025L-SWAG: Layer-Sample Wise Activation with Gradients information for Zero-Shot NAS on Vision Transformerscited by 5
  22. 2026SLICE: Semantic Latent Injection via Compartmentalized Embedding for Image Watermarkingcited by 5
  23. 2026SHIFT: Stochastic Hidden-Trajectory Deflection for Removing Diffusion-based Watermarkcited by 3
  24. 2026LAVA: Layered Audio-Visual Anti-tampering Watermarking for Robust Deepfake Detection and Localizationcited by 3
  25. 2025NN-Former: Rethinking Graph Structure in Neural Architecture Representationcited by 2
  26. 2026CoRA-NAS: Coarse Ranking and Anchor-Residual Refinement for Neural Architecture Searchcited by 1

Built on by

Not cited yet.