mlsanityData to 14 Oct 2026

Deep Sub-Ensembles for Fast Uncertainty Estimation in Image Classification

arXiv 1910.08168 ↗First posted 17 Oct 2019cs.LG cs.CV stat.MLcited by 36

Not on the map. Why?

Abstract (arXiv)

Fast estimates of model uncertainty are required for many robust robotics applications. Deep Ensembles provides state of the art uncertainty without requiring Bayesian methods, but still it is computationally expensive. In this paper we propose deep sub-ensembles, an approximation to deep ensembles where the core idea is to ensemble only the layers close to the output, and not the whole model. With ResNet-20 on the CIFAR10 dataset, we obtain 1.5-2.5 speedup over a Deep Ensemble, with a small increase in error and NLL, and similarly up to 5-15 speedup with a VGG-like network on the SVHN dataset. Our results show that this idea enables a trade-off between error and uncertainty quality versus computational performance.

Key facts. Cited by 36 papers in the map (data through 14 Oct 2026). First posted on arXiv 17 Oct 2019.

Builds on

No reference list yet.

Built on by

Cited by year (2026 to 14 Oct)

Citing papers per year: 2021: 4; 2022: 9; 2023: 8; 2024: 6; 2025: 7; 2026: 2.

36 papers.

Sort:

By area:

  1. 2021A Survey of Uncertainty in Deep Neural Networkscited by 680
  2. 2024A Comprehensive Survey on Evidential Deep Learning and Its Applicationscited by 25
  3. 2024Are Uncertainty Quantification Capabilities of Evidential Deep Learning a Mirage?cited by 18
  4. 2022Hyperbolic Uncertainty Aware Semantic Segmentationcited by 17
  5. 2021Gradient-Based Quantification of Epistemic Uncertainty for Deep Object Detectorscited by 16
  6. 2022Layer Ensembles: A Single-Pass Uncertainty Estimation in Deep Learning for Segmentationcited by 15
  7. 2022Active Learning of Discrete-Time Dynamics for Uncertainty-Aware Model Predictive Controlcited by 13
  8. 2023Beyond Unimodal: Generalising Neural Processes for Multimodal Uncertainty Estimationcited by 11
  9. 2022Uncertainty Estimation for Multi-view Data: The Power of Seeing the Whole Picturecited by 10
  10. 2023Gradient-based Uncertainty Attribution for Explainable Bayesian Deep Learningcited by 8
  11. 2024SSE: Multimodal Semantic Data Selection and Enrichment for Industrial-scale Data Assimilationcited by 7
  12. 2024Regularized Multi-Decoder Ensemble for an Error-Aware Scene Representation Networkcited by 6
24 more
  1. 2025OCCUQ: Exploring Efficient Uncertainty Quantification for 3D Occupancy Predictioncited by 6
  2. 2023Compensation Learning in Semantic Segmentationcited by 5
  3. 2023Building a Winning Team: Selecting Source Model Ensembles using a Submodular Transferability Estimation Approachcited by 5
  4. 2022TEDL: A Two-stage Evidential Deep Learning Method for Classification Uncertainty Quantificationcited by 3
  5. 2022Layer Ensemblescited by 3
  6. 2023Uncertainty-Aware AB3DMOT by Variational 3D Object Detectioncited by 3
  7. 2025Efficient Post-Hoc Uncertainty Calibration via Variance-Based Smoothingcited by 3
  8. 2025Mimir: Hierarchical Goal-Driven Diffusion with Uncertainty Propagation for End-to-End Autonomous Drivingcited by 3
  9. 2022Selective classification using a robust meta-learning approachcited by 2
  10. 2025Quantifying Uncertainty in the Presence of Distribution Shiftscited by 2
  11. 2025Intra-Class Probabilistic Embeddings for Uncertainty Estimation in Vision-Language Modelscited by 2
  12. 2021Gated Linear Model induced U-net for surrogate modeling and uncertainty quantificationcited by 1
  13. 2022Transfer learning for ensembles: reducing computation time and keeping the diversitycited by 1
  14. 2023Secure Deep Learning-based Distributed Intelligence on Pocket-sized Dronescited by 1
  15. 2026Efficient Credal Prediction through Decalibrationcited by 1
  16. 2021Dropout Prediction Uncertainty Estimation Using Neuron Activation Strengthcited by 0
  17. 2022SoftDropConnect (SDC) -- Effective and Efficient Quantification of the Network Uncertainty in Deep MR Image Analysiscited by 0
  18. 2023Variational Voxel Pseudo Image Trackingcited by 0
  19. 2023Uncertainty Quantification using Generative Approachcited by 0
  20. 2024Customer Lifetime Value Prediction with Uncertainty Estimation Using Monte Carlo Dropoutcited by 0
  21. 2024U-FaceBP: Uncertainty-aware Bayesian Ensemble Deep Learning for Face Video-based Blood Pressure Estimationcited by 0
  22. 2025Variational Graph Convolutional Neural Networkscited by 0
  23. 2025Ensemble Distribution Distillation for Self-Supervised Human Activity Recognitioncited by 0
  24. 2026Uncertainty quantification for trustworthy deep learning: Methods and measurescited by 0