Grid Search, Random Search, Genetic Algorithm: A Big Comparison for NAS
Not on the map. Why?
Abstract (arXiv)
In this paper, we compare the three most popular algorithms for hyperparameter optimization (Grid Search, Random Search, and Genetic Algorithm) and attempt to use them for neural architecture search (NAS). We use these algorithms for building a convolutional neural network (search architecture). Experimental results on CIFAR-10 dataset further demonstrate the performance difference between compared algorithms. The comparison results are based on the execution time of the above algorithms and accuracy of the proposed models.
Key facts. Cited by 83 papers in the map (data through 14 Oct 2026). First posted on arXiv 12 Dec 2019.
Builds on
No reference list yet.
Built on by
Citing papers per year: 2021: 6; 2022: 12; 2023: 16; 2024: 19; 2025: 20; 2026: 10.
83 papers.
Sort:
By area:
- 2023AdaMerging: Adaptive Model Merging for Multi-Task Learningcited by 252
- 2021Multi-Objective Loss Balancing for Physics-Informed Deep Learningcited by 87
- 2022Aligning Eyes between Humans and Deep Neural Network through Interactive Attention Alignmentcited by 27
- 2024Data Contamination Calibration for Black-box LLMscited by 24
- 2025Optimas: Optimizing Compound AI Systems with Globally Aligned Local Rewardscited by 24
- 2024Unlocking the Potential of Model Merging for Low-Resource Languagescited by 19
- 2023Uncovering Energy-Efficient Practices in Deep Learning Training: Preliminary Steps Towards Green AIcited by 16
- 2021Utilizing XAI technique to improve autoencoder based model for computer network anomaly detection with shapley additive explanation(SHAP)cited by 15
- 2025A Quality-Guided Mixture of Score-Fusion Experts Framework for Human Recognitioncited by 11
- 2023Adv3D: Generating Safety-Critical 3D Objects through Closed-Loop Simulationcited by 10
- 2024On Giant's Shoulders: Effortless Weak to Strong by Dynamic Logits Fusioncited by 9
- 2026State Backdoor: Towards Stealthy Real-world Poisoning Attack on Vision-Language-Action Model in State Spacecited by 9
38 more
- 2023Untargeted White-box Adversarial Attack with Heuristic Defence Methods in Real-time Deep Learning based Network Intrusion Detection Systemcited by 8
- 2022AutoKE: An automatic knowledge embedding framework for scientific machine learningcited by 6
- 2022MetaGL: Evaluation-Free Selection of Graph Learning Models via Meta-Learningcited by 6
- 2024Improving Domain Generalization in Self-supervised Monocular Depth Estimation via Stabilized Adversarial Trainingcited by 5
- 2024Explanatory Debiasing: Involving Domain Experts in the Data Generation Process to Mitigate Representation Bias in AI Systemscited by 5
- 2021CONetV2: Efficient Auto-Channel Size Optimization for CNNscited by 4
- 2022Exploring the Intersection between Neural Architecture Search and Continual Learningcited by 4
- 2023DQNAS: Neural Architecture Search using Reinforcement Learningcited by 4
- 2023A Natural Language Processing Approach to Malware Classificationcited by 4
- 2023A Co-design Study for Multi-Stakeholder Job Recommender System Explanationscited by 4
- 2024Wave-Mask/Mix: Exploring Wavelet-Based Augmentations for Time Series Forecastingcited by 4
- 2022Evaluation of Contrastive Learning with Various Code Representations for Code Clone Detectioncited by 3
- 2023TraVaG: Differentially Private Trace Variant Generation Using GANscited by 3
- 2023MLOps Spanning Whole Machine Learning Life Cycle: A Surveycited by 3
- 2024Day-ahead regional solar power forecasting with hierarchical temporal convolutional neural networks using historical power generation and weather datacited by 3
- 2024rule4ml: An Open-Source Tool for Resource Utilization and Latency Estimation for ML Models on FPGAcited by 3
- 2024Fall Leaf Adversarial Attack on Traffic Sign Classificationcited by 3
- 2026TextResNet: Decoupling and Routing Optimization Signals in Compound AI Systems via Deep Residual Tuningcited by 3
- 2021GNN-Geo: A Graph Neural Network-based Fine-grained IP geolocation Frameworkcited by 2
- 2022Reinforcement Learning-based Defect Mitigation for Quality Assurance of Additive Manufacturingcited by 2
- 2023A Novel Deep Learning based Model to Defend Network Intrusion Detection System against Adversarial Attackscited by 2
- 2024GLEMOS: Benchmark for Instantaneous Graph Learning Model Selectioncited by 2
- 2024UnifiedRL: A Reinforcement Learning Algorithm Tailored for Multi-Task Fusion in Large-Scale Recommender Systemscited by 2
- 2025Rumor Detection by Multi-task Suffix Learning based on Time-series Dual Sentimentscited by 2
- 2025Automated Business Process Analysis: An LLM-Based Approach to Value Assessmentcited by 2
- 2025Interpretable Low-Dimensional Modeling of Spatiotemporal Agent States for Decision Making in Football Tacticscited by 2
- 2025DaMo: Data Mixing Optimizer in Fine-tuning Multimodal LLMs for Mobile Phone Agentscited by 2
- 2021Calibrating Over-Parametrized Simulation Models: A Framework via Eligibility Setcited by 1
- 2022Representing Camera Response Function by a Single Latent Variable and Fully Connected Neural Networkcited by 1
- 2024SincVAE: A new semi-supervised approach to improve anomaly detection on EEG data using SincNet and variational autoencodercited by 1
- 2025Are We There Yet? Unraveling the State-of-the-Art Graph Network Intrusion Detection Systemscited by 1
- 2025TurnGuide: Enhancing Meaningful Full Duplex Spoken Interactions via Dynamic Turn-Level Text-Speech Interleavingcited by 1
- 2025GRADE: Personalized Multi-Task Fusion via Group-relative Reinforcement Learning with Adaptive Dirichlet Explorationcited by 1
- 2025AnchorGK: Anchor-based Incremental and Stratified Graph Learning Framework for Inductive Spatio-Temporal Krigingcited by 1
- 2021COVID-19 Electrocardiograms Classification using CNN Modelscited by 0
- 2022Survival Prediction of Children Undergoing Hematopoietic Stem Cell Transplantation Using Different Machine Learning Classifiers by Performing Chi-squared Test and Hyper-parameter Optimization: A Retrospective Analysiscited by 0
- 2022An optimized hybrid solution for IoT based lifestyle disease classification using stress datacited by 0
- 2022DeepProphet2 -- A Deep Learning Gene Recommendation Enginecited by 0
50 most cited of 83 All 83 (JSON)
- 2026Joint Remaining Useful Life Prediction and Capacity Estimation of Lithium-Ion Batteries Using Partial-Charging Data18 Sep 2026
- 2026LSEAD: A Privacy-Preserving LLM-Based Speech Analysis Framework for Early Alzheimer's Disease Screening7 Aug 2026
- 2026Toward Generalizable Cognitive Impairment Detection with Speech-Based Multimodal Large Language Models23 Jul 2026
- 2026Exploiting Structural Properties for Efficient Constraint-Aware HNSW Hyperparameter Tuning6 Jul 2026
- 2026Machine learning enables roughness-driven inverse design of milling processes14 Jun 2026
- 2026Curation of a Cardiology Interface Terminology for Highlighting Electronic Health Records using Machine Learning6 Jun 2026
- 2026Bringing Order to Asynchronous SGD: Towards Optimality under Data-Dependent Delays with Momentum3 May 2026
- 2026TextResNet: Decoupling and Routing Optimization Signals in Compound AI Systems via Deep Residual Tuning9 Feb 2026
- 2026Hyperparameter Optimization of Constraint Programming Solvers16 Jan 2026
- 2026State Backdoor: Towards Stealthy Real-world Poisoning Attack on Vision-Language-Action Model in State Space7 Jan 2026
- 2025AnchorGK: Anchor-based Incremental and Stratified Graph Learning Framework for Inductive Spatio-Temporal Kriging25 Dec 2025
- 2025DaMo: Data Mixing Optimizer in Fine-tuning Multimodal LLMs for Mobile Phone Agents22 Oct 2025
38 more
- 2025A Unified Perspective on Optimization in Machine Learning and Neuroscience: From Gradient Descent to Neural Adaptation21 Oct 2025
- 2025GRADE: Personalized Multi-Task Fusion via Group-relative Reinforcement Learning with Adaptive Dirichlet Exploration9 Oct 2025
- 2025Bridging Computational Social Science and Deep Learning: Cultural Dissemination-Inspired Graph Neural Networks23 Sep 2025
- 2025SeqBattNet: A Discrete-State Physics-Informed Neural Network with Aging Adaptation for Battery Modeling22 Sep 2025
- 2025Language-Guided Tuning: Configuration Optimization for Automated ML Research21 Aug 2025
- 2025TurnGuide: Enhancing Meaningful Full Duplex Spoken Interactions via Dynamic Turn-Level Text-Speech Interleaving10 Aug 2025
- 2025A Quality-Guided Mixture of Score-Fusion Experts Framework for Human Recognition31 Jul 2025
- 2025Optimas: Optimizing Compound AI Systems with Globally Aligned Local Rewards3 Jul 2025
- 2025Interpretable Low-Dimensional Modeling of Spatiotemporal Agent States for Decision Making in Football Tactics20 Jun 2025
- 2025AIMatDesign: Knowledge-Augmented Reinforcement Learning for Inverse Materials Design under Data Scarcity17 Jun 2025
- 2025Automated Business Process Analysis: An LLM-Based Approach to Value Assessment9 Apr 2025
- 2025Releasing Differentially Private Event Logs Using Generative Models8 Apr 2025
- 2025Graph Classification and Radiomics Signature for Identification of Tuberculous Meningitis1 Apr 2025
- 2025Are We There Yet? Unraveling the State-of-the-Art Graph Network Intrusion Detection Systems26 Mar 2025
- 2025Machine Learning-Based Model for Postoperative Stroke Prediction in Coronary Artery Disease15 Mar 2025
- 2025Sentiment Analysis in SemEval: A Review of Sentiment Identification Approaches13 Mar 2025
- 2025Rumor Detection by Multi-task Suffix Learning based on Time-series Dual Sentiments20 Feb 2025
- 2025Automating Credit Card Limit Adjustments Using Machine Learning14 Jan 2025
- 2024Explanatory Debiasing: Involving Domain Experts in the Data Generation Process to Mitigate Representation Bias in AI Systems26 Dec 2024
- 2024Malware Classification using a Hybrid Hidden Markov Model-Convolutional Neural Network25 Dec 2024
- 2024Fall Leaf Adversarial Attack on Traffic Sign Classification27 Nov 2024
- 2024Time-Efficient Hybrid Hyperparameter Tuning Approach for Cardiovascular Disease Classification27 Nov 2024
- 2024Improving Domain Generalization in Self-supervised Monocular Depth Estimation via Stabilized Adversarial Training4 Nov 2024
- 2024rECGnition_v1.0: Arrhythmia detection using cardiologist-inspired multi-modal architecture incorporating demographic attributes in ECG9 Oct 2024
- 2024EnhancedRL: An Enhanced-State Reinforcement Learning Algorithm for Multi-Task Fusion in Recommender Systems18 Sep 2024
- 2024Wave-Mask/Mix: Exploring Wavelet-Based Augmentations for Time Series Forecasting20 Aug 2024
- 2024rule4ml: An Open-Source Tool for Resource Utilization and Latency Estimation for ML Models on FPGA9 Aug 2024
- 2024Unlocking the Potential of Model Merging for Low-Resource Languages4 Jul 2024
- 2024IVCA: Inter-Relation-Aware Video Complexity Analyzer29 Jun 2024
- 2024SincVAE: A new semi-supervised approach to improve anomaly detection on EEG data using SincNet and variational autoencoder25 Jun 2024
- 2024On Giant's Shoulders: Effortless Weak to Strong by Dynamic Logits Fusion17 Jun 2024
- 2024Data Contamination Calibration for Black-box LLMs20 May 2024
- 2024UnifiedRL: A Reinforcement Learning Algorithm Tailored for Multi-Task Fusion in Large-Scale Recommender Systems19 Apr 2024
- 2024Kinematics Modeling of Peroxy Free Radicals: A Deep Reinforcement Learning Approach12 Apr 2024
- 2024GLEMOS: Benchmark for Instantaneous Graph Learning Model Selection2 Apr 2024
- 2024Cost-Effective Methodology for Complex Tuning Searches in HPC: Navigating Interdependencies and Dimensionality12 Mar 2024
- 2024Day-ahead regional solar power forecasting with hierarchical temporal convolutional neural networks using historical power generation and weather data4 Mar 2024
- 2023Determination of toxic comments and unintended model bias minimization using Deep learning approach8 Nov 2023
50 newest of 83 All 83 (JSON)
- 2025GRADE: Personalized Multi-Task Fusion via Group-relative Reinforcement Learning with Adaptive Dirichlet Explorationcited by 1
- 2024EnhancedRL: An Enhanced-State Reinforcement Learning Algorithm for Multi-Task Fusion in Recommender Systemscited by 0
- 2025AIMatDesign: Knowledge-Augmented Reinforcement Learning for Inverse Materials Design under Data Scarcitycited by 0
- 2025GRADE: Personalized Multi-Task Fusion via Group-relative Reinforcement Learning with Adaptive Dirichlet Exploration9 Oct 2025
- 2025AIMatDesign: Knowledge-Augmented Reinforcement Learning for Inverse Materials Design under Data Scarcity17 Jun 2025
- 2024EnhancedRL: An Enhanced-State Reinforcement Learning Algorithm for Multi-Task Fusion in Recommender Systems18 Sep 2024
- 2021CONetV2: Efficient Auto-Channel Size Optimization for CNNs13 Oct 2021
- 2023AdaMerging: Adaptive Model Merging for Multi-Task Learningcited by 252
- 2021Multi-Objective Loss Balancing for Physics-Informed Deep Learningcited by 87
- 2022Aligning Eyes between Humans and Deep Neural Network through Interactive Attention Alignmentcited by 27
- 2024Data Contamination Calibration for Black-box LLMscited by 24
- 2025Optimas: Optimizing Compound AI Systems with Globally Aligned Local Rewardscited by 24
- 2024Unlocking the Potential of Model Merging for Low-Resource Languagescited by 19
- 2023Uncovering Energy-Efficient Practices in Deep Learning Training: Preliminary Steps Towards Green AIcited by 16
- 2021Utilizing XAI technique to improve autoencoder based model for computer network anomaly detection with shapley additive explanation(SHAP)cited by 15
- 2025A Quality-Guided Mixture of Score-Fusion Experts Framework for Human Recognitioncited by 11
- 2023Adv3D: Generating Safety-Critical 3D Objects through Closed-Loop Simulationcited by 10
- 2024On Giant's Shoulders: Effortless Weak to Strong by Dynamic Logits Fusioncited by 9
- 2023Untargeted White-box Adversarial Attack with Heuristic Defence Methods in Real-time Deep Learning based Network Intrusion Detection Systemcited by 8
12 most cited of 73 All 73 (JSON)
- 2026Joint Remaining Useful Life Prediction and Capacity Estimation of Lithium-Ion Batteries Using Partial-Charging Data18 Sep 2026
- 2026LSEAD: A Privacy-Preserving LLM-Based Speech Analysis Framework for Early Alzheimer's Disease Screening7 Aug 2026
- 2026Machine learning enables roughness-driven inverse design of milling processes14 Jun 2026
- 2026Curation of a Cardiology Interface Terminology for Highlighting Electronic Health Records using Machine Learning6 Jun 2026
- 2026Bringing Order to Asynchronous SGD: Towards Optimality under Data-Dependent Delays with Momentum3 May 2026
- 2026TextResNet: Decoupling and Routing Optimization Signals in Compound AI Systems via Deep Residual Tuning9 Feb 2026
- 2026Hyperparameter Optimization of Constraint Programming Solvers16 Jan 2026
- 2025AnchorGK: Anchor-based Incremental and Stratified Graph Learning Framework for Inductive Spatio-Temporal Kriging25 Dec 2025
- 2025A Unified Perspective on Optimization in Machine Learning and Neuroscience: From Gradient Descent to Neural Adaptation21 Oct 2025
- 2025Bridging Computational Social Science and Deep Learning: Cultural Dissemination-Inspired Graph Neural Networks23 Sep 2025
- 2025SeqBattNet: A Discrete-State Physics-Informed Neural Network with Aging Adaptation for Battery Modeling22 Sep 2025
- 2025Language-Guided Tuning: Configuration Optimization for Automated ML Research21 Aug 2025
12 newest of 73 All 73 (JSON)