A Generic Graph-based Neural Architecture Encoding Scheme for Predictor-based NAS
Not on the map. Why?
Abstract (arXiv)
This work proposes a novel Graph-based neural ArchiTecture Encoding Scheme, a.k.a. GATES, to improve the predictor-based neural architecture search. Specifically, different from existing graph-based schemes, GATES models the operations as the transformation of the propagating information, which mimics the actual data processing of neural architecture. GATES is a more reasonable modeling of the neural architectures, and can encode architectures from both the "operation on node" and "operation on edge" cell search spaces consistently. Experimental results on various search spaces confirm GATES's effectiveness in improving the performance predictor. Furthermore, equipped with the improved performance predictor, the sample efficiency of the predictor-based neural architecture search (NAS) flow is boosted. Codes are available at https://github.com/walkerning/aw_nas.
Key facts. Cited by 53 papers in the map (data through 7 Oct 2026). First posted on arXiv 4 Apr 2020.
Builds on
No reference list yet.
Built on by
Citing papers per year: 2021: 14; 2022: 9; 2023: 10; 2024: 6; 2025: 10; 2026: 4.
53 papers.
Sort:
By area:
- 2023Neural Architecture Search: Insights from 1000 Paperscited by 136
- 2021How Powerful are Performance Predictors in Neural Architecture Search?cited by 88
- 2023OMS-DPM: Optimizing the Model Schedule for Diffusion Probabilistic Modelscited by 44
- 2021Topology-Aware Network Pruning using Multi-stage Graph Embedding and Reinforcement Learningcited by 30
- 2021Stronger NAS with Weaker Predictorscited by 28
- 2021CATE: Computation-aware Neural Architecture Encoding with Transformerscited by 21
- 2021GradSign: Model Performance Inference with Theoretical Insightscited by 18
- 2023DiffusionNAG: Predictor-guided Neural Architecture Generation with Diffusion Modelscited by 15
- 2023A Unified Sampling Framework for Solver Searching of Diffusion Probabilistic Modelscited by 14
- 2021RankNAS: Efficient Neural Architecture Search by Pairwise Rankingcited by 12
- 2022A Survey on Computationally Efficient Neural Architecture Searchcited by 12
- 2022NAR-Former: Neural Architecture Representation Learning towards Holistic Attributes Predictioncited by 12
38 more
- 2021FLASH: Fast Neural Architecture Search with Hardware Optimizationcited by 11
- 2023AnalogNAS: A Neural Network Design Framework for Accurate Inference with Analog In-Memory Computingcited by 10
- 2025Regression Language Models for Codecited by 10
- 2021RANK-NOSH: Efficient Predictor-Based Architecture Search via Non-Uniform Successive Halvingcited by 9
- 2022Arch-Graph: Acyclic Architecture Relation Predictor for Task-Transferable Neural Architecture Searchcited by 9
- 2024FlowerFormer: Empowering Neural Architecture Encoding using a Flow-aware Graph Transformercited by 9
- 2023GP-NAS-ensemble: a model for NAS Performance Predictioncited by 7
- 2023NAR-Former V2: Rethinking Transformer for Universal Neural Network Representation Learningcited by 6
- 2024Linear Combination of Saved Checkpoints Makes Consistency and Diffusion Models Bettercited by 6
- 20213D-ANAS: 3D Asymmetric Neural Architecture Search for Fast Hyperspectral Image Classificationcited by 5
- 2021Graph-based Neural Architecture Search with Operation Embeddingscited by 5
- 2022CLOSE: Curriculum Learning On the Sharing Extent Towards Better One-shot NAScited by 5
- 2022CODEBench: A Neural Architecture and Hardware Accelerator Co-Design Frameworkcited by 5
- 2024ParZC: Parametric Zero-Cost Proxies for Efficient NAScited by 5
- 2024Architecture-Aware Learning Curve Extrapolation via Graph Ordinary Differential Equationcited by 5
- 2024CAP: A Context-Aware Neural Predictor for NAScited by 4
- 2021Accelerating Multi-Objective Neural Architecture Search by Random-Weight Evaluationcited by 3
- 2022Bi-fidelity Evolutionary Multiobjective Search for Adversarially Robust Deep Neural Architecturescited by 3
- 2022Visual Analysis of Neural Architecture Spaces for Summarizing Design Principlescited by 3
- 2023Dynamic Ensemble of Low-fidelity Experts: Mitigating NAS "Cold-Start"cited by 3
- 2023DCLP: Neural Architecture Predictor with Curriculum Contrastive Learningcited by 3
- 2021A Data-driven Approach to Neural Architecture Search Initializationcited by 2
- 2022CR-LSO: Convex Neural Architecture Optimization in the Latent Space of Graph Variational Autoencoder with Input Convex Neural Networkscited by 2
- 2025CARL: Causality-guided Architecture Representation Learning for an Interpretable Performance Predictorcited by 2
- 2025NN-Former: Rethinking Graph Structure in Neural Architecture Representationcited by 2
- 2026GraphIR: Architecture-Level Search States for LLM-Guided Neural Architecture Evolutioncited by 2
- 2021Cascade Bagging for Accuracy Prediction with Few Training Samplescited by 1
- 2024GRASP-GCN: Graph-Shape Prioritization for Neural Architecture Search under Distribution Shiftscited by 1
- 2025GATES: Cost-aware Dynamic Workflow Scheduling via Graph Attention Networks and Evolution Strategycited by 1
- 2025Loss Functions for Predictor-based Neural Architecture Searchcited by 1
- 2025Zero-Shot Neural Architecture Search with Weighted Response Correlationcited by 1
- 2025ESM: A Framework for Building Effective Surrogate Models for Hardware-Aware Neural Architecture Searchcited by 1
- 2025Learning to Flow from Generative Pretext Tasks for Neural Architecture Encodingcited by 1
- 2021Pretraining Neural Architecture Search Controllers with Locality-based Self-Supervised Learningcited by 0
- 2022WPNAS: Neural Architecture Search by jointly using Weight Sharing and Predictorcited by 0
- 2023Efficacy of Neural Prediction-Based Zero-Shot NAScited by 0
- 2025Neural Architecture Search by Learning a Hierarchical Search Spacecited by 0
- 2025Language Embedding Meets Dynamic Graph: A New Exploration for Neural Architecture Representation Learningcited by 0
50 most cited of 53 All 53 (JSON)
- 2026RiPPLE: Cross-Space Performance Prediction from Early Training for Neural Architecture Search11 Sep 2026
- 2026GraphIR: Architecture-Level Search States for LLM-Guided Neural Architecture Evolution3 Aug 2026
- 2026Towards Code-Oriented LM Embeddings for Surrogate-Assisted Neural Architecture Search15 May 2026
- 2026From Regression to Inference: Meta-Learning Predictors for Neural Architecture Search10 May 2026
- 2025Learning to Flow from Generative Pretext Tasks for Neural Architecture Encoding21 Oct 2025
- 2025Regression Language Models for Code30 Sep 2025
- 2025ESM: A Framework for Building Effective Surrogate Models for Hardware-Aware Neural Architecture Search2 Aug 2025
- 2025Zero-Shot Neural Architecture Search with Weighted Response Correlation8 Jul 2025
- 2025NN-Former: Rethinking Graph Structure in Neural Architecture Representation1 Jul 2025
- 2025Language Embedding Meets Dynamic Graph: A New Exploration for Neural Architecture Representation Learning9 Jun 2025
- 2025Loss Functions for Predictor-based Neural Architecture Search6 Jun 2025
- 2025CARL: Causality-guided Architecture Representation Learning for an Interpretable Performance Predictor4 Jun 2025
38 more
- 2025GATES: Cost-aware Dynamic Workflow Scheduling via Graph Attention Networks and Evolution Strategy18 May 2025
- 2025Neural Architecture Search by Learning a Hierarchical Search Space27 Mar 2025
- 2024Architecture-Aware Learning Curve Extrapolation via Graph Ordinary Differential Equation20 Dec 2024
- 2024CAP: A Context-Aware Neural Predictor for NAS4 Jun 2024
- 2024GRASP-GCN: Graph-Shape Prioritization for Neural Architecture Search under Distribution Shifts11 May 2024
- 2024Linear Combination of Saved Checkpoints Makes Consistency and Diffusion Models Better2 Apr 2024
- 2024FlowerFormer: Empowering Neural Architecture Encoding using a Flow-aware Graph Transformer19 Mar 2024
- 2024ParZC: Parametric Zero-Cost Proxies for Efficient NAS3 Feb 2024
- 2023A Unified Sampling Framework for Solver Searching of Diffusion Probabilistic Models12 Dec 2023
- 2023Efficacy of Neural Prediction-Based Zero-Shot NAS31 Aug 2023
- 2023NAR-Former V2: Rethinking Transformer for Universal Neural Network Representation Learning19 Jun 2023
- 2023OMS-DPM: Optimizing the Model Schedule for Diffusion Probabilistic Models15 Jun 2023
- 2023DiffusionNAG: Predictor-guided Neural Architecture Generation with Diffusion Models26 May 2023
- 2023AnalogNAS: A Neural Network Design Framework for Accurate Inference with Analog In-Memory Computing17 May 2023
- 2023DCLP: Neural Architecture Predictor with Curriculum Contrastive Learning25 Feb 2023
- 2023Dynamic Ensemble of Low-fidelity Experts: Mitigating NAS "Cold-Start"2 Feb 2023
- 2023GP-NAS-ensemble: a model for NAS Performance Prediction23 Jan 2023
- 2023Neural Architecture Search: Insights from 1000 Papers20 Jan 2023
- 2022CODEBench: A Neural Architecture and Hardware Accelerator Co-Design Framework7 Dec 2022
- 2022NAR-Former: Neural Architecture Representation Learning towards Holistic Attributes Prediction15 Nov 2022
- 2022CR-LSO: Convex Neural Architecture Optimization in the Latent Space of Graph Variational Autoencoder with Input Convex Neural Networks11 Nov 2022
- 2022Visual Analysis of Neural Architecture Spaces for Summarizing Design Principles20 Aug 2022
- 2022CLOSE: Curriculum Learning On the Sharing Extent Towards Better One-shot NAS16 Jul 2022
- 2022Bi-fidelity Evolutionary Multiobjective Search for Adversarially Robust Deep Neural Architectures12 Jul 2022
- 2022A Survey on Computationally Efficient Neural Architecture Search3 Jun 2022
- 2022Arch-Graph: Acyclic Architecture Relation Predictor for Task-Transferable Neural Architecture Search12 Apr 2022
- 2022WPNAS: Neural Architecture Search by jointly using Weight Sharing and Predictor4 Mar 2022
- 2021A Data-driven Approach to Neural Architecture Search Initialization5 Nov 2021
- 2021GradSign: Model Performance Inference with Theoretical Insights16 Oct 2021
- 2021Accelerating Multi-Objective Neural Architecture Search by Random-Weight Evaluation8 Oct 2021
- 2021RankNAS: Efficient Neural Architecture Search by Pairwise Ranking15 Sep 2021
- 2021RANK-NOSH: Efficient Predictor-Based Architecture Search via Non-Uniform Successive Halving18 Aug 2021
- 2021Cascade Bagging for Accuracy Prediction with Few Training Samples12 Aug 2021
- 2021FLASH: Fast Neural Architecture Search with Hardware Optimization1 Aug 2021
- 2021Graph-based Neural Architecture Search with Operation Embeddings11 May 2021
- 2021How Powerful are Performance Predictors in Neural Architecture Search?2 Apr 2021
- 2021Pretraining Neural Architecture Search Controllers with Locality-based Self-Supervised Learning15 Mar 2021
- 2021Stronger NAS with Weaker Predictors21 Feb 2021
50 newest of 53 All 53 (JSON)
- 2023OMS-DPM: Optimizing the Model Schedule for Diffusion Probabilistic Modelscited by 44
- 2023DiffusionNAG: Predictor-guided Neural Architecture Generation with Diffusion Modelscited by 15
- 2023A Unified Sampling Framework for Solver Searching of Diffusion Probabilistic Modelscited by 14
- 2024Linear Combination of Saved Checkpoints Makes Consistency and Diffusion Models Bettercited by 6
- 2024Linear Combination of Saved Checkpoints Makes Consistency and Diffusion Models Better2 Apr 2024
- 2023A Unified Sampling Framework for Solver Searching of Diffusion Probabilistic Models12 Dec 2023
- 2023OMS-DPM: Optimizing the Model Schedule for Diffusion Probabilistic Models15 Jun 2023
- 2023DiffusionNAG: Predictor-guided Neural Architecture Generation with Diffusion Models26 May 2023
- 2023Neural Architecture Search: Insights from 1000 Paperscited by 136
- 2021How Powerful are Performance Predictors in Neural Architecture Search?cited by 88
- 2021Topology-Aware Network Pruning using Multi-stage Graph Embedding and Reinforcement Learningcited by 30
- 2021Stronger NAS with Weaker Predictorscited by 28
- 2021CATE: Computation-aware Neural Architecture Encoding with Transformerscited by 21
- 2021GradSign: Model Performance Inference with Theoretical Insightscited by 18
- 2021RankNAS: Efficient Neural Architecture Search by Pairwise Rankingcited by 12
- 2022A Survey on Computationally Efficient Neural Architecture Searchcited by 12
- 2022NAR-Former: Neural Architecture Representation Learning towards Holistic Attributes Predictioncited by 12
- 2021FLASH: Fast Neural Architecture Search with Hardware Optimizationcited by 11
- 2023AnalogNAS: A Neural Network Design Framework for Accurate Inference with Analog In-Memory Computingcited by 10
- 2025Regression Language Models for Codecited by 10
12 most cited of 49 All 49 (JSON)
- 2026RiPPLE: Cross-Space Performance Prediction from Early Training for Neural Architecture Search11 Sep 2026
- 2026GraphIR: Architecture-Level Search States for LLM-Guided Neural Architecture Evolution3 Aug 2026
- 2026Towards Code-Oriented LM Embeddings for Surrogate-Assisted Neural Architecture Search15 May 2026
- 2026From Regression to Inference: Meta-Learning Predictors for Neural Architecture Search10 May 2026
- 2025Learning to Flow from Generative Pretext Tasks for Neural Architecture Encoding21 Oct 2025
- 2025Regression Language Models for Code30 Sep 2025
- 2025ESM: A Framework for Building Effective Surrogate Models for Hardware-Aware Neural Architecture Search2 Aug 2025
- 2025Zero-Shot Neural Architecture Search with Weighted Response Correlation8 Jul 2025
- 2025NN-Former: Rethinking Graph Structure in Neural Architecture Representation1 Jul 2025
- 2025Language Embedding Meets Dynamic Graph: A New Exploration for Neural Architecture Representation Learning9 Jun 2025
- 2025Loss Functions for Predictor-based Neural Architecture Search6 Jun 2025
- 2025CARL: Causality-guided Architecture Representation Learning for an Interpretable Performance Predictor4 Jun 2025
12 newest of 49 All 49 (JSON)