# Evolving Deep Convolutional Neural Networks for Image Classification

arXiv: https://arxiv.org/abs/1710.10741 · HTML: https://mlsanity.com/paper/1710.10741/

## Key facts

- Cited by 55 papers in the map (data through 14 Oct 2026).
- First posted on arXiv 30 Oct 2017.

## Built on by (most cited first, 30 of 55)

- [Neural Architecture Search: Insights from 1000 Papers](https://mlsanity.com/paper/2301.08727/) (2023)
- [Neural Architecture Search as Multiobjective Optimization Benchmarks: Problem Formulation and Performance Assessment](https://mlsanity.com/paper/2208.04321/) (2022)
- [Homogeneous Architecture Augmentation for Neural Predictor](https://mlsanity.com/paper/2107.13153/) (2021)
- [Exploring the Synergies of Hybrid CNNs and ViTs Architectures for Computer Vision: A survey](https://mlsanity.com/paper/2402.02941/) (2024)
- [A Survey on Computationally Efficient Neural Architecture Search](https://mlsanity.com/paper/2206.01520/) (2022)
- [Accelerating Evolutionary Neural Architecture Search via Multi-Fidelity Evaluation](https://mlsanity.com/paper/2108.04541/) (2021)
- [Randomly Initialized Convolutional Neural Network for the Recognition of COVID-19 using X-ray Images](https://mlsanity.com/paper/2105.08199/) (2021)
- [A Survey on Evolutionary Computation for Computer Vision and Image Analysis: Past, Present, and Future Trends](https://mlsanity.com/paper/2209.06399/) (2022)
- [Ensemble neuroevolution based approach for multivariate time series anomaly detection](https://mlsanity.com/paper/2108.03585/) (2021)
- [Partial Connection Based on Channel Attention for Differentiable Neural Architecture Search](https://mlsanity.com/paper/2208.00791/) (2022)
- [EGANS: Evolutionary Generative Adversarial Network Search for Zero-Shot Learning](https://mlsanity.com/paper/2308.09915/) (2023)
- [Surrogate-assisted Multi-objective Neural Architecture Search for Real-time Semantic Segmentation](https://mlsanity.com/paper/2208.06820/) (2022)
- [CAP: A Context-Aware Neural Predictor for NAS](https://mlsanity.com/paper/2406.02056/) (2024)
- [Genetic Programming-Based Evolutionary Deep Learning for Data-Efficient Image Classification](https://mlsanity.com/paper/2209.13233/) (2022)
- [Differentiable Genetic Programming for High-dimensional Symbolic Regression](https://mlsanity.com/paper/2304.08915/) (2023)
- [Attention-Guided Black-box Adversarial Attacks with Large-Scale Multiobjective Evolutionary Optimization](https://mlsanity.com/paper/2101.07512/) (2021)
- [Impacts of Darwinian Evolution on Pre-trained Deep Neural Networks](https://mlsanity.com/paper/2408.05563/) (2024)
- [Brain Programming is Immune to Adversarial Attacks: Towards Accurate and Robust Image Classification using Symbolic Learning](https://mlsanity.com/paper/2103.01359/) (2021)
- [Efficient Neural Architecture Search with Performance Prediction](https://mlsanity.com/paper/2108.01854/) (2021)
- [Optimal Actor-Critic Policy with Optimized Training Datasets](https://mlsanity.com/paper/2108.06911/) (2021)
- [Fast and scalable neuroevolution deep learning architecture search for multivariate anomaly detection](https://mlsanity.com/paper/2112.05640/) (2021)
- [Direct evaluation of progression or regression of disease burden in brain metastatic disease with Deep Neuroevolution](https://mlsanity.com/paper/2203.12853/) (2022)
- [PSO-Convolutional Neural Networks with Heterogeneous Learning Rate](https://mlsanity.com/paper/2205.10456/) (2022)
- [Shortest Edit Path Crossover: A Theory-driven Solution to the Permutation Problem in Evolutionary Neural Architecture Search](https://mlsanity.com/paper/2210.14016/) (2022)
- [A Survey on Multi-Objective based Parameter Optimization for Deep Learning](https://mlsanity.com/paper/2305.10014/) (2023)
- [Chain-structured neural architecture search for financial time series forecasting](https://mlsanity.com/paper/2403.14695/) (2024)
- [NeuroLGP-SM: A Surrogate-assisted Neuroevolution Approach using Linear Genetic Programming](https://mlsanity.com/paper/2403.19459/) (2024)
- [A Decade of Deep Learning for Remote Sensing Spatiotemporal Fusion: Advances, Challenges, and Opportunities](https://mlsanity.com/paper/2504.00901/) (2025)
- [TND-NAS: Towards Non-differentiable Objectives in Progressive Differentiable NAS Framework](https://mlsanity.com/paper/2111.03892/) (2021)
- [Neural Architecture Search Using Genetic Algorithm for Facial Expression Recognition](https://mlsanity.com/paper/2304.12194/) (2023)

## Abstract (arXiv)

Evolutionary computation methods have been successfully applied to neural networks since two decades ago, while those methods cannot scale well to the modern deep neural networks due to the complicated architectures and large quantities of connection weights. In this paper, we propose a new method using genetic algorithms for evolving the architectures and connection weight initialization values of a deep convolutional neural network to address image classification problems. In the proposed algorithm, an efficient variable-length gene encoding strategy is designed to represent the different building blocks and the unpredictable optimal depth in convolutional neural networks. In addition, a new representation scheme is developed for effectively initializing connection weights of deep convolutional neural networks, which is expected to avoid networks getting stuck into local minima which is typically a major issue in the backward gradient-based optimization. Furthermore, a novel fitness evaluation method is proposed to speed up the heuristic search with substantially less computational resource. The proposed algorithm is examined and compared with 22 existing algorithms on nine widely used image classification tasks, including the state-of-the-art methods. The experimental results demonstrate the remarkable superiority of the proposed algorithm over the state-of-the-art algorithms in terms of classification error rate and the number of parameters (weights).