mlsanityData to 14 Oct 2026

MetaErr: Towards Predicting Error Patterns in Deep Neural Networks

arXiv 2604.23289 ↗First posted 25 Apr 2026cs.CV cs.AI cs.LGcited by 0

Not on the map. Why?

Abstract (arXiv)

Due to the unprecedented success of deep learning, it has become an integral component in several multimedia computing applications in todays world. Unfortunately, deep learning systems are not perfect and can fail, sometimes abruptly, without prior warning or explanation. While reducing the error rate of deep neural networks has been the primary focus of the multimedia community, the problem of predicting when a deep learning system is going to fail has received significantly less research attention. In this paper, we propose a simple yet effective framework, MetaErr, to address this under-explored problem in deep learning research. We train a meta-model whose goal is to predict whether a base deep neural network will succeed or fail in predicting a particular data sample, by observing the base models performance on a given learning task. The meta-model is completely agnostic of the architecture and training parameters of the base model. Such an error prediction system can be immensely useful in a variety of smart multimedia applications. Our empirical studies corroborate the promise and potential of our framework against competing baselines. We further demonstrate the usefulness of our framework to improve the performance of pseudo-labeling-based semi-supervised learning, and show that MetaErr outperforms several strong baselines on three benchmark computer vision datasets.

Key facts. No citing papers in the map yet (data through 14 Oct 2026). Builds on 33 of its 55 references that are in the map. First posted on arXiv 25 Apr 2026.

Builds on

33 of 55 references.

References · 33

  1. 2017On Calibration of Modern Neural Networkscited by 4,960
  2. 2015Dropout as a Bayesian Approximation: Representing Model Uncertainty in Deep Learningcited by 4,448
  3. 2016The Cityscapes Dataset for Semantic Urban Scene Understandingcited by 4,444
  4. 2017Fashion-MNIST: a Novel Image Dataset for Benchmarking Machine Learning Algorithmscited by 4,349
  5. 2016Simple and Scalable Predictive Uncertainty Estimation using Deep Ensemblescited by 3,926
  6. 2018Encoder-Decoder with Atrous Separable Convolution for Semantic Image Segmentationcited by 3,223
  7. 2017What Uncertainties Do We Need in Bayesian Deep Learning for Computer Vision?cited by 2,352
  8. 2020Energy-based Out-of-distribution Detectioncited by 1,299
  9. 2016End to End Learning for Self-Driving Carscited by 1,009
  10. 2017Virtual Adversarial Training: A Regularization Method for Supervised and Semi-Supervised Learningcited by 920
  11. 2017Selective Classification for Deep Neural Networkscited by 852
  12. 2017Deep Bayesian Active Learning with Image Datacited by 819
21 more
  1. 2018Object Detection with Deep Learning: A Reviewcited by 528
  2. 2019Pseudo-Labeling and Confirmation Bias in Deep Semi-Supervised Learningcited by 510
  3. 2017Age Progression/Regression by Conditional Adversarial Autoencodercited by 429
  4. 2019SelectiveNet: A Deep Neural Network with an Integrated Reject Optioncited by 350
  5. 2019Learning Loss for Active Learningcited by 336
  6. 2019On Mixup Training: Improved Calibration and Predictive Uncertainty for Deep Neural Networkscited by 305
  7. 2019Label Propagation for Deep Semi-supervised Learningcited by 289
  8. 2019Interpolation Consistency Training for Semi-Supervised Learningcited by 251
  9. 2021Deep Deterministic Uncertainty: A Simple Baselinecited by 200
  10. 2020Are Labels Always Necessary for Classifier Accuracy Evaluation?cited by 104
  11. 2016Structured and Efficient Variational Deep Learning with Matrix Gaussian Posteriorscited by 82
  12. 2019Association of genomic subtypes of lower-grade gliomas with shape features automatically extracted by a deep learning algorithmcited by 77
  13. 2018Bayesian Uncertainty Estimation for Batch Normalized Deep Networkscited by 70
  14. 2021What Does Rotation Prediction Tell Us about Classifier Accuracy under Varying Testing Environments?cited by 63
  15. 2020Understanding Failures of Deep Networks via Robust Feature Extractioncited by 56
  16. 2018Towards Accountable AI: Hybrid Human-Machine Analyses for Characterizing System Failurecited by 49
  17. 2018Classification Uncertainty of Deep Neural Networks Based on Gradient Informationcited by 43
  18. 2017Estimating Accuracy from Unlabeled Data: A Probabilistic Logic Approachcited by 27
  19. 2018Confidence Scoring Using Whitebox Meta-models with Linear Classifier Probescited by 21
  20. 2020Single Shot MC Dropout Approximationcited by 10
  21. 2020Learning Prediction Intervals for Model Performancecited by 9

Built on by

Not cited yet.