A Genetic Programming Approach to Designing Convolutional Neural Network Architectures
Not on the map. Why?
Abstract (arXiv)
The convolutional neural network (CNN), which is one of the deep learning models, has seen much success in a variety of computer vision tasks. However, designing CNN architectures still requires expert knowledge and a lot of trial and error. In this paper, we attempt to automatically construct CNN architectures for an image classification task based on Cartesian genetic programming (CGP). In our method, we adopt highly functional modules, such as convolutional blocks and tensor concatenation, as the node functions in CGP. The CNN structure and connectivity represented by the CGP encoding method are optimized to maximize the validation accuracy. To evaluate the proposed method, we constructed a CNN architecture for the image classification task with the CIFAR-10 dataset. The experimental result shows that the proposed method can be used to automatically find the competitive CNN architecture compared with state-of-the-art models.
Key facts. Cited by 59 papers in the map (data through 7 Oct 2026). First posted on arXiv 3 Apr 2017.
Builds on
No reference list yet.
Built on by
Citing papers per year: 2021: 18; 2022: 18; 2023: 10; 2024: 5; 2025: 3; 2026: 5.
59 papers.
Sort:
- 2023Neural Architecture Search: Insights from 1000 Paperscited by 136
- 2022Neural Architecture Search as Multiobjective Optimization Benchmarks: Problem Formulation and Performance Assessmentcited by 17
- 2024Knowledge Fusion By Evolving Weights of Language Modelscited by 16
- 2021One-Shot Neural Ensemble Architecture Search by Diversity-Guided Search Space Shrinkingcited by 12
- 2022A Survey on Computationally Efficient Neural Architecture Searchcited by 12
- 2021iDARTS: Improving DARTS by Node Normalization and Decorrelation Discretizationcited by 10
- 2021NAS-HPO-Bench-II: A Benchmark Dataset on Joint Optimization of Convolutional Neural Network Architecture and Training Hyperparameterscited by 9
- 2022Less is More: Proxy Datasets in NAS approachescited by 9
- 2022A Survey on Evolutionary Computation for Computer Vision and Image Analysis: Past, Present, and Future Trendscited by 9
- 2023Dynamic Neural Network for Multi-Task Learning Searching across Diverse Network Topologiescited by 9
- 2022PRE-NAS: Predictor-assisted Evolutionary Neural Architecture Searchcited by 8
- 2021A Novel Genetic Algorithm with Hierarchical Evaluation Strategy for Hyperparameter Optimisation of Graph Neural Networkscited by 7
38 more
- 2021Search For Deep Graph Neural Networkscited by 6
- 2024Robust NAS under adversarial training: benchmark, theory, and beyondcited by 6
- 2021Enhanced Gradient for Differentiable Architecture Searchcited by 5
- 2021Graph-based Neural Architecture Search with Operation Embeddingscited by 5
- 2021Manas: Mining Software Repositories to Assist AutoMLcited by 5
- 2022Quant 4.0: Engineering Quantitative Investment with Automated, Explainable and Knowledge-driven Artificial Intelligencecited by 5
- 2022Exploring the Intersection between Neural Architecture Search and Continual Learningcited by 4
- 2022ObfuNAS: A Neural Architecture Search-based DNN Obfuscation Approachcited by 4
- 2022AutoQML: Automatic Generation and Training of Robust Quantum-Inspired Classifiers by Using Genetic Algorithms on Grayscale Imagescited by 4
- 2023DQNAS: Neural Architecture Search using Reinforcement Learningcited by 4
- 2023AutoML for Large Capacity Modeling of Meta's Ranking Systemscited by 4
- 2023Divide-and-Conquer the NAS puzzle in Resource Constrained Federated Learning Systemscited by 3
- 2021A Novel Framework for Neural Architecture Search in the Hill Climbing Domaincited by 2
- 2021HALF: Holistic Auto Machine Learning for FPGAscited by 2
- 2021Experiments on Properties of Hidden Structures of Sparse Neural Networkscited by 2
- 2022PSO-Convolutional Neural Networks with Heterogeneous Learning Ratecited by 2
- 2022An Adaptive and Stability-Promoting Layerwise Training Approach for Sparse Deep Neural Network Architecturecited by 2
- 2023A Survey on Multi-Objective based Parameter Optimization for Deep Learningcited by 2
- 2025Topological derivative approach for deep neural network architecture adaptationcited by 2
- 2026Bilevel Optimization for Neural Architecture Searchcited by 2
- 2021Differentiable Neural Architecture Search with Morphism-based Transformable Backbone Architecturescited by 1
- 2021Evolving Architectures with Gradient Misalignment toward Low Adversarial Transferabilitycited by 1
- 2021Evolving Transferable Neural Pruning Functionscited by 1
- 2022Efficient Search of Multiple Neural Architectures with Different Complexities via Importance Samplingcited by 1
- 2023Continuous Cartesian Genetic Programming based representation for Multi-Objective Neural Architecture Searchcited by 1
- 2023DREAM: Debugging and Repairing AutoML Pipelinescited by 1
- 2024Random forests for detecting weak signals and extracting physical information: a case study of magnetic navigationcited by 1
- 2024ApproxDARTS: Differentiable Neural Architecture Search with Approximate Multiplierscited by 1
- 2021Genetic Algorithm based hyper-parameters optimization for transfer Convolutional Neural Networkcited by 0
- 2021Trainless Model Performance Estimation for Neural Architecture Searchcited by 0
- 2021Multi-objective Evolutionary Approach for Efficient Kernel Size and Shape for CNNcited by 0
- 2021ConAM: Confidence Attention Module for Convolutional Neural Networkscited by 0
- 2022HDAM: Heuristic Difference Attention Module for Convolutional Neural Networkscited by 0
- 2022ERNAS: An Evolutionary Neural Architecture Search for Magnetic Resonance Image Reconstructionscited by 0
- 2022Adversarial Robustness Assessment of NeuroEvolution Approachescited by 0
- 2022MEESO: A Multi-objective End-to-End Self-Optimized Approach for Automatically Building Deep Learning Modelscited by 0
- 2022An Efficient Evolutionary Deep Learning Framework Based on Multi-source Transfer Learning to Evolve Deep Convolutional Neural Networkscited by 0
- 2022Single Cell Training on Architecture Search for Image Denoisingcited by 0
50 most cited of 59 All 59 (JSON)
- 2026An optimal control approach for neural network architecture adaptation with a posteriori error estimation8 Jul 2026
- 2026Bilevel Optimization for Neural Architecture Search28 Jun 2026
- 2026Neural Architecture Search of Sample Reweighting Networks for Complex Distribution Shift22 Jun 2026
- 2026Structuring Open-Ended NAS: Semi-Automated Design Knowledge Structuring with LLMs for Efficient Neural Architecture Search19 May 2026
- 2026NERO-Net: A Neuroevolutionary Approach for the Design of Adversarially Robust CNNs26 Mar 2026
- 2025Decoupling Representation and Learning in Genetic Programming: the LaSER Approach22 May 2025
- 2025Topological derivative approach for deep neural network architecture adaptation8 Feb 2025
- 2025Efficient Global Neural Architecture Search5 Feb 2025
- 2024Knowledge Fusion By Evolving Weights of Language Models18 Jun 2024
- 2024ApproxDARTS: Differentiable Neural Architecture Search with Approximate Multipliers8 Apr 2024
- 2024Robust NAS under adversarial training: benchmark, theory, and beyond19 Mar 2024
- 2024Random forests for detecting weak signals and extracting physical information: a case study of magnetic navigation21 Feb 2024
38 more
- 2024A Novel Paradigm for Neural Computation: X-Net with Learnable Neurons and Adaptable Structure3 Jan 2024
- 2023DREAM: Debugging and Repairing AutoML Pipelines31 Dec 2023
- 2023AutoML for Large Capacity Modeling of Meta's Ranking Systems14 Nov 2023
- 2023A Survey on Multi-Objective Neural Architecture Search18 Jul 2023
- 2023Continuous Cartesian Genetic Programming based representation for Multi-Objective Neural Architecture Search5 Jun 2023
- 2023A Survey on Multi-Objective based Parameter Optimization for Deep Learning17 May 2023
- 2023Divide-and-Conquer the NAS puzzle in Resource Constrained Federated Learning Systems11 May 2023
- 2023Evolution under Length Constraints for CNN Architecture design5 May 2023
- 2023Dynamic Neural Network for Multi-Task Learning Searching across Diverse Network Topologies13 Mar 2023
- 2023Neural Architecture Search: Insights from 1000 Papers20 Jan 2023
- 2023DQNAS: Neural Architecture Search using Reinforcement Learning17 Jan 2023
- 2022Quant 4.0: Engineering Quantitative Investment with Automated, Explainable and Knowledge-driven Artificial Intelligence13 Dec 2022
- 2022Single Cell Training on Architecture Search for Image Denoising13 Dec 2022
- 2022An Efficient Evolutionary Deep Learning Framework Based on Multi-source Transfer Learning to Evolve Deep Convolutional Neural Networks7 Dec 2022
- 2022MEESO: A Multi-objective End-to-End Self-Optimized Approach for Automatically Building Deep Learning Models20 Nov 2022
- 2022An Adaptive and Stability-Promoting Layerwise Training Approach for Sparse Deep Neural Network Architecture13 Nov 2022
- 2022A Survey on Evolutionary Computation for Computer Vision and Image Analysis: Past, Present, and Future Trends14 Sep 2022
- 2022AutoQML: Automatic Generation and Training of Robust Quantum-Inspired Classifiers by Using Genetic Algorithms on Grayscale Images28 Aug 2022
- 2022ObfuNAS: A Neural Architecture Search-based DNN Obfuscation Approach17 Aug 2022
- 2022Neural Architecture Search as Multiobjective Optimization Benchmarks: Problem Formulation and Performance Assessment8 Aug 2022
- 2022Efficient Search of Multiple Neural Architectures with Different Complexities via Importance Sampling21 Jul 2022
- 2022Adversarial Robustness Assessment of NeuroEvolution Approaches12 Jul 2022
- 2022ERNAS: An Evolutionary Neural Architecture Search for Magnetic Resonance Image Reconstructions15 Jun 2022
- 2022Exploring the Intersection between Neural Architecture Search and Continual Learning11 Jun 2022
- 2022A Survey on Computationally Efficient Neural Architecture Search3 Jun 2022
- 2022PSO-Convolutional Neural Networks with Heterogeneous Learning Rate20 May 2022
- 2022PRE-NAS: Predictor-assisted Evolutionary Neural Architecture Search27 Apr 2022
- 2022Less is More: Proxy Datasets in NAS approaches14 Mar 2022
- 2022HDAM: Heuristic Difference Attention Module for Convolutional Neural Networks19 Feb 2022
- 2021Manas: Mining Software Repositories to Assist AutoML6 Dec 2021
- 2021ConAM: Confidence Attention Module for Convolutional Neural Networks27 Oct 2021
- 2021Evolving Transferable Neural Pruning Functions21 Oct 2021
- 2021NAS-HPO-Bench-II: A Benchmark Dataset on Joint Optimization of Convolutional Neural Network Architecture and Training Hyperparameters19 Oct 2021
- 2021Search For Deep Graph Neural Networks21 Sep 2021
- 2021Evolving Architectures with Gradient Misalignment toward Low Adversarial Transferability13 Sep 2021
- 2021iDARTS: Improving DARTS by Node Normalization and Decorrelation Discretization25 Aug 2021
- 2021Experiments on Properties of Hidden Structures of Sparse Neural Networks27 Jul 2021
- 2021Multi-objective Evolutionary Approach for Efficient Kernel Size and Shape for CNN28 Jun 2021
50 newest of 59 All 59 (JSON)
- 2023Neural Architecture Search: Insights from 1000 Paperscited by 136
- 2022Neural Architecture Search as Multiobjective Optimization Benchmarks: Problem Formulation and Performance Assessmentcited by 17
- 2024Knowledge Fusion By Evolving Weights of Language Modelscited by 16
- 2021One-Shot Neural Ensemble Architecture Search by Diversity-Guided Search Space Shrinkingcited by 12
- 2022A Survey on Computationally Efficient Neural Architecture Searchcited by 12
- 2021iDARTS: Improving DARTS by Node Normalization and Decorrelation Discretizationcited by 10
- 2021NAS-HPO-Bench-II: A Benchmark Dataset on Joint Optimization of Convolutional Neural Network Architecture and Training Hyperparameterscited by 9
- 2022Less is More: Proxy Datasets in NAS approachescited by 9
- 2022A Survey on Evolutionary Computation for Computer Vision and Image Analysis: Past, Present, and Future Trendscited by 9
- 2023Dynamic Neural Network for Multi-Task Learning Searching across Diverse Network Topologiescited by 9
- 2022PRE-NAS: Predictor-assisted Evolutionary Neural Architecture Searchcited by 8
- 2021A Novel Genetic Algorithm with Hierarchical Evaluation Strategy for Hyperparameter Optimisation of Graph Neural Networkscited by 7
12 most cited of 59 All 59 (JSON)
- 2026An optimal control approach for neural network architecture adaptation with a posteriori error estimation8 Jul 2026
- 2026Bilevel Optimization for Neural Architecture Search28 Jun 2026
- 2026Neural Architecture Search of Sample Reweighting Networks for Complex Distribution Shift22 Jun 2026
- 2026Structuring Open-Ended NAS: Semi-Automated Design Knowledge Structuring with LLMs for Efficient Neural Architecture Search19 May 2026
- 2026NERO-Net: A Neuroevolutionary Approach for the Design of Adversarially Robust CNNs26 Mar 2026
- 2025Decoupling Representation and Learning in Genetic Programming: the LaSER Approach22 May 2025
- 2025Topological derivative approach for deep neural network architecture adaptation8 Feb 2025
- 2025Efficient Global Neural Architecture Search5 Feb 2025
- 2024Knowledge Fusion By Evolving Weights of Language Models18 Jun 2024
- 2024ApproxDARTS: Differentiable Neural Architecture Search with Approximate Multipliers8 Apr 2024
- 2024Robust NAS under adversarial training: benchmark, theory, and beyond19 Mar 2024
- 2024Random forests for detecting weak signals and extracting physical information: a case study of magnetic navigation21 Feb 2024
12 newest of 59 All 59 (JSON)