# The Relative Performance of Ensemble Methods with Deep Convolutional Neural Networks for Image Classification

arXiv: https://arxiv.org/abs/1704.01664 · HTML: https://mlsanity.com/paper/1704.01664/

## Key facts

- Cited by 50 papers in the map (data through 14 Oct 2026).
- First posted on arXiv 5 Apr 2017.

## Built on by (most cited first, 30 of 50)

- [Ensemble deep learning: A review](https://mlsanity.com/paper/2104.02395/) (2021)
- [Blending Is All You Need: Cheaper, Better Alternative to Trillion-Parameters LLM](https://mlsanity.com/paper/2401.02994/) (2024)
- [Empirical Analysis of Model Selection for Heterogeneous Causal Effect Estimation](https://mlsanity.com/paper/2211.01939/) (2022)
- [MyoPS-Net: Myocardial Pathology Segmentation with Flexible Combination of Multi-Sequence CMR Images](https://mlsanity.com/paper/2211.03062/) (2022)
- [Deep Learning for Brain Age Estimation: A Systematic Review](https://mlsanity.com/paper/2212.03868/) (2022)
- [Efficient Diversity-Driven Ensemble for Deep Neural Networks](https://mlsanity.com/paper/2112.13316/) (2021)
- [AWSnet: An Auto-weighted Supervision Attention Network for Myocardial Scar and Edema Segmentation in Multi-sequence Cardiac Magnetic Resonance Images](https://mlsanity.com/paper/2201.05344/) (2022)
- [A Learnable Prior Improves Inverse Tumor Growth Modeling](https://mlsanity.com/paper/2403.04500/) (2024)
- [An Analysis on Ensemble Learning optimized Medical Image Classification with Deep Convolutional Neural Networks](https://mlsanity.com/paper/2201.11440/) (2022)
- [Optimized ensemble deep learning framework for scalable forecasting of dynamics containing extreme events](https://mlsanity.com/paper/2106.08968/) (2021)
- [Deep Neural Network Based Ensemble learning Algorithms for the healthcare system (diagnosis of chronic diseases)](https://mlsanity.com/paper/2103.08182/) (2021)
- [Deep interpretable ensembles](https://mlsanity.com/paper/2205.12729/) (2022)
- [Differentiable Model Selection for Ensemble Learning](https://mlsanity.com/paper/2211.00251/) (2022)
- [Propagation of Chaos for Mean-Field Langevin Dynamics and its Application to Model Ensemble](https://mlsanity.com/paper/2502.05784/) (2025)
- [Similarity of Neural Architectures using Adversarial Attack Transferability](https://mlsanity.com/paper/2210.11407/) (2022)
- [Contrastive Classification and Representation Learning with Probabilistic Interpretation](https://mlsanity.com/paper/2211.03646/) (2022)
- [Minimum Bayes' Risk Decoding for System Combination of Grammatical Error Correction Systems](https://mlsanity.com/paper/2309.06520/) (2023)
- [Improved Crop and Weed Detection with Diverse Data Ensemble Learning](https://mlsanity.com/paper/2310.01055/) (2023)
- [Hierarchical Pruning of Deep Ensembles with Focal Diversity](https://mlsanity.com/paper/2311.10293/) (2023)
- [Automatic Semantic Segmentation of the Lumbar Spine: Clinical Applicability in a Multi-parametric and Multi-centre Study on Magnetic Resonance Images](https://mlsanity.com/paper/2111.08712/) (2021)
- [Modularity in Deep Learning: A Survey](https://mlsanity.com/paper/2310.01154/) (2023)
- [Generalized super-resolution 4D Flow MRI unicodex2013 using ensemble learning to extend across the cardiovascular system](https://mlsanity.com/paper/2311.11819/) (2023)
- [FedSC: Federated Learning with Semantic-Aware Collaboration](https://mlsanity.com/paper/2506.21012/) (2025)
- [FedDifRC: Unlocking the Potential of Text-to-Image Diffusion Models in Heterogeneous Federated Learning](https://mlsanity.com/paper/2507.06482/) (2025)
- [Automated Olfactory Bulb Segmentation on High Resolutional T2-Weighted MRI](https://mlsanity.com/paper/2108.04267/) (2021)
- [Pediatric Automatic Sleep Staging: A comparative study of state-of-the-art deep learning methods](https://mlsanity.com/paper/2108.10211/) (2021)
- [Model and Data Agreement for Learning with Noisy Labels](https://mlsanity.com/paper/2212.01054/) (2022)
- [Asymmetric Image Retrieval with Cross Model Compatible Ensembles](https://mlsanity.com/paper/2303.17531/) (2023)
- [Synergy and Diversity in CLIP: Enhancing Performance Through Adaptive Backbone Ensembling](https://mlsanity.com/paper/2405.17139/) (2024)
- [Metacognitive Sensitivity for Test-Time Dynamic Model Selection](https://mlsanity.com/paper/2512.10451/) (2025)

## Abstract (arXiv)

Artificial neural networks have been successfully applied to a variety of machine learning tasks, including image recognition, semantic segmentation, and machine translation. However, few studies fully investigated ensembles of artificial neural networks. In this work, we investigated multiple widely used ensemble methods, including unweighted averaging, majority voting, the Bayes Optimal Classifier, and the (discrete) Super Learner, for image recognition tasks, with deep neural networks as candidate algorithms. We designed several experiments, with the candidate algorithms being the same network structure with different model checkpoints within a single training process, networks with same structure but trained multiple times stochastically, and networks with different structure. In addition, we further studied the over-confidence phenomenon of the neural networks, as well as its impact on the ensemble methods. Across all of our experiments, the Super Learner achieved best performance among all the ensemble methods in this study.