mlsanityData to 7 Oct 2026

RADMI: Latent Information Aggregation as a Proxy for Model Uncertainty

arXiv 2605.01502 ↗First posted 2 May 2026cs.CVcited by 0

Not on the map. Why?

Abstract (arXiv)

Epistemic uncertainty estimation is essential for identifying regions where deep learning system outputs may be unreliable. However, existing approaches require computationally expensive ensemble methods or multiple stochastic forward passes, limiting their scalability to dense prediction tasks like segmentation. We propose Resolution-Aggregated Decoder Mutual Information (RADMI), a single-pass method that estimates prediction uncertainty by measuring mutual information (MI) between consecutive decoder layers in segmentation networks. We observe that elevated inter-layer MI correlates with prediction uncertainty, as the network must integrate conflicting contextual information at ambiguous regions such as class boundaries. Evaluating on a seismic facies segmentation benchmark, RADMI achieves the highest correlation with deep ensemble uncertainty among all single-pass methods, outperforming the next-best baselines by 5.5% in Pearson and 10.7% in Spearman correlation coefficients. Compared to baselines that either lack spatial precision or demand significant computational overhead, RADMI yields sharp, boundary-localized uncertainty maps without architectural modifications. Our results suggest that linear aggregation of normalized information flow provides a principled and efficient proxy for prediction uncertainty in encoder-decoder architectures.

Key facts. No citing papers in the map yet (data through 7 Oct 2026). Builds on 15 of its 21 references that are in the map. First posted on arXiv 2 May 2026.

Builds on

15 of 21 references.

References · 15

  1. 2015U-Net: Convolutional Networks for Biomedical Image Segmentationcited by 19,604
  2. 2017On Calibration of Modern Neural Networkscited by 4,860
  3. 2015Dropout as a Bayesian Approximation: Representing Model Uncertainty in Deep Learningcited by 4,416
  4. 2016Simple and Scalable Predictive Uncertainty Estimation using Deep Ensemblescited by 3,888
  5. 2016A Baseline for Detecting Misclassified and Out-of-Distribution Examples in Neural Networkscited by 2,362
  6. 2017What Uncertainties Do We Need in Bayesian Deep Learning for Computer Vision?cited by 2,335
  7. 2015Deep Learning and the Information Bottleneck Principlecited by 793
  8. 2017Opening the Black Box of Deep Neural Networks via Informationcited by 494
  9. 2019A Machine Learning Benchmark for Facies Classificationcited by 27
  10. 2022Man-recon: manifold learning for reconstruction with deep autoencoder for smart seismic interpretationcited by 7
  11. 2018Subsurface structure analysis using computational interpretation and learning: A visual signal processing perspectivecited by 5
  12. 2025A Large-scale Benchmark on Geological Fault Delineation Models: Domain Shift, Training Dynamics, Generalizability, Evaluation and Inferential Behaviorcited by 4
3 more
  1. 2024VOICE: Variance of Induced Contrastive Explanations to quantify Uncertainty in Neural Network Interpretabilitycited by 3
  2. 2024Counterfactual Gradients-based Quantification of Prediction Trust in Neural Networkscited by 2
  3. 2026A unified framework for evaluating the robustness of machine-learning interpretability for prospect riskingcited by 1

Built on by

Not cited yet.