Bayesian SegNet: Model Uncertainty in Deep Convolutional Encoder-Decoder Architectures for Scene Understanding
Not on the map. Why?
Abstract (arXiv)
We present a deep learning framework for probabilistic pixel-wise semantic segmentation, which we term Bayesian SegNet. Semantic segmentation is an important tool for visual scene understanding and a meaningful measure of uncertainty is essential for decision making. Our contribution is a practical system which is able to predict pixel-wise class labels with a measure of model uncertainty. We achieve this by Monte Carlo sampling with dropout at test time to generate a posterior distribution of pixel class labels. In addition, we show that modelling uncertainty improves segmentation performance by 2-3% across a number of state of the art architectures such as SegNet, FCN and Dilation Network, with no additional parametrisation. We also observe a significant improvement in performance for smaller datasets where modelling uncertainty is more effective. We benchmark Bayesian SegNet on the indoor SUN Scene Understanding and outdoor CamVid driving scenes datasets.
Key facts. Cited by 218 papers in the map (data through 14 Oct 2026). First posted on arXiv 9 Nov 2015.
Builds on
No reference list yet.
Built on by
Citing papers per year: 2019: 2; 2020: 0; 2021: 72; 2022: 50; 2023: 31; 2024: 36; 2025: 17; 2026: 10.
218 papers.
Sort:
By area:
- 2021FIERY: Future Instance Prediction in Bird's-Eye View from Surround Monocular Camerascited by 239
- 2021Diffusion Models for Implicit Image Segmentation Ensemblescited by 198
- 2024Deep Time Series Models: A Comprehensive Survey and Benchmarkcited by 197
- 2022MedSegDiff: Medical Image Segmentation with Diffusion Probabilistic Modelcited by 180
- 2021SegmentMeIfYouCan: A Benchmark for Anomaly Segmentationcited by 150
- 2021Pixel-wise Anomaly Detection in Complex Driving Scenescited by 109
- 2023Ambiguous Medical Image Segmentation using Diffusion Modelscited by 92
- 2022Benchmarking Bayesian Deep Learning on Diabetic Retinopathy Detection Taskscited by 49
- 2021Semi-Supervised Domain Generalization with Stochastic StyleMatchcited by 43
- 2021Triggering Failures: Out-Of-Distribution detection by learning from local adversarial attacks in Semantic Segmentationcited by 40
- 2021Uncertainty-Aware Machine Translation Evaluationcited by 35
- 2022GIPSO: Geometrically Informed Propagation for Online Adaptation in 3D LiDAR Segmentationcited by 35
38 more
- 2022Probabilistic Representations for Video Contrastive Learningcited by 34
- 2021Uncertainty Estimation via Response Scaling for Pseudo-mask Noise Mitigation in Weakly-supervised Semantic Segmentationcited by 29
- 2021QU-BraTS: MICCAI BraTS 2020 Challenge on Quantifying Uncertainty in Brain Tumor Segmentation - Analysis of Ranking Scores and Benchmarking Resultscited by 28
- 2021Corner Cases for Visual Perception in Automated Driving: Some Guidance on Detection Approachescited by 27
- 2022PMAL: Open Set Recognition via Robust Prototype Miningcited by 27
- 2021Deep Deterministic Uncertainty for Semantic Segmentationcited by 24
- 2022BayesCap: Bayesian Identity Cap for Calibrated Uncertainty in Frozen Neural Networkscited by 23
- 2021A Weakly Supervised Amodal Segmenter with Boundary Uncertainty Estimationcited by 21
- 2022Region-Based Evidential Deep Learning to Quantify Uncertainty and Improve Robustness of Brain Tumor Segmentationcited by 21
- 2019Uncertainty-Aware Data Aggregation for Deep Imitation Learningcited by 20
- 2021Modality specific U-Net variants for biomedical image segmentation: A surveycited by 20
- 2021Dual Spoof Disentanglement Generation for Face Anti-spoofing with Depth Uncertainty Learningcited by 20
- 2022Learning Probabilistic Topological Representations Using Discrete Morse Theorycited by 20
- 2024Tyche: Stochastic In-Context Learning for Medical Image Segmentationcited by 20
- 2024Conformal Semantic Image Segmentation: Post-hoc Quantification of Predictive Uncertaintycited by 20
- 2022Two Video Data Sets for Tracking and Retrieval of Out of Distribution Objectscited by 19
- 2023Unsupervised Self-Driving Attention Prediction via Uncertainty Mining and Knowledge Embeddingcited by 19
- 2021Using Soft Labels to Model Uncertainty in Medical Image Segmentationcited by 18
- 2021Auto-Encoding Score Distribution Regression for Action Quality Assessmentcited by 18
- 2021Ensemble Quantile Networks: Uncertainty-Aware Reinforcement Learning with Applications in Autonomous Drivingcited by 17
- 2022Hyperbolic Uncertainty Aware Semantic Segmentationcited by 17
- 2022Latent Discriminant deterministic Uncertaintycited by 17
- 2021I Find Your Lack of Uncertainty in Computer Vision Disturbingcited by 16
- 2021Blurs Behave Like Ensembles: Spatial Smoothings to Improve Accuracy, Uncertainty, and Robustnesscited by 14
- 2021Active Learning in Bayesian Neural Networks with Balanced Entropy Learning Principlecited by 14
- 2023Deep Learning for Visual Localization and Mapping: A Surveycited by 14
- 2023PolyMaX: General Dense Prediction with Mask Transformercited by 14
- 2021Maximum Entropy on Erroneous Predictions (MEEP): Improving model calibration for medical image segmentationcited by 13
- 2022Deep Learning Serves Traffic Safety Analysis: A Forward-looking Reviewcited by 13
- 2022MultiAuto-DeepONet: A Multi-resolution Autoencoder DeepONet for Nonlinear Dimension Reduction, Uncertainty Quantification and Operator Learning of Forward and Inverse Stochastic Problemscited by 13
- 2023Anatomically-aware Uncertainty for Semi-supervised Image Segmentationcited by 13
- 2024Comparative Benchmarking of Failure Detection Methods in Medical Image Segmentation: Unveiling the Role of Confidence Aggregationcited by 12
- 2023Toward Reliable Human Pose Forecasting with Uncertaintycited by 11
- 2023U-CE: Uncertainty-aware Cross-Entropy for Semantic Segmentationcited by 11
- 2019Gaze Training by Modulated Dropout Improves Imitation Learningcited by 10
- 2023Robust Uncertainty Quantification Using Conformalised Monte Carlo Predictioncited by 10
- 2021S3Net: 3D LiDAR Sparse Semantic Segmentation Networkcited by 9
- 2021Trinity: A No-Code AI platform for complex spatial datasetscited by 9
50 most cited of 218 All 218 (JSON)
- 2026Towards Trustworthy AI for Glioma Diagnosis: A Task-Aware Evaluation of Uncertainty Quantification30 Sep 2026
- 2026One Attack to Fool Them All: Highly Transferable Black-Box Adversarial Attacks on Frontier MLLMs27 Sep 2026
- 2026UnGAP: Uncertainty-Guided Affine Prompting for Real-Time Crack Segmentation4 May 2026
- 2026Algorithm and Hardware Co-Design for Efficient Complex-Valued Uncertainty Estimation21 Apr 2026
- 2026Right Regions, Wrong Labels: Semantic Label Flips in Segmentation under Correlation Shift14 Apr 2026
- 2026Better than Average: Spatially-Aware Aggregation of Segmentation Uncertainty Improves Downstream Performance31 Mar 2026
- 2026Uncertainty-Aware Vision-based Risk Object Identification via Conformal Risk Tube Prediction25 Mar 2026
- 2026URA-Net: Uncertainty-Integrated Anomaly Perception and Restoration Attention Network for Unsupervised Anomaly Detection24 Mar 2026
- 2026DA-Cal: Towards Cross-Domain Calibration in Semantic Segmentation24 Feb 2026
- 2026REV-INR: Regularized Evidential Implicit Neural Representation for Uncertainty-Aware Volume Visualization25 Jan 2026
- 2025Fast SAM2 with Text-Driven Token Pruning24 Dec 2025
- 2025UAGLNet: Uncertainty-Aggregated Global-Local Fusion Network with Cooperative CNN-Transformer for Building Extraction15 Dec 2025
38 more
- 2025CORA: Consistency-Guided Semi-Supervised Framework for Reasoning Segmentation21 Nov 2025
- 2025BATIS: Bayesian Approaches for Targeted Improvement of Species Distribution Models22 Oct 2025
- 2025Learning to Navigate Under Imperfect Perception: Conformalised Segmentation for Safe Reinforcement Learning21 Oct 2025
- 2025Uncertainty-Aware Extreme Point Tracing for Weakly Supervised Ultrasound Image Segmentation17 Oct 2025
- 2025Vendi Information Gain for Active Learning and its Application to Ecology12 Sep 2025
- 2025Extracting Uncertainty Estimates from Mixtures of Experts for Semantic Segmentation5 Sep 2025
- 2025Deep Active Learning for Lung Disease Severity Classification from Chest X-rays: Learning with Less Data in the Presence of Class Imbalance28 Aug 2025
- 2025Stereo-based 3D Anomaly Object Detection for Autonomous Driving: A New Dataset and Baseline12 Jul 2025
- 2025A Data-Driven Novelty Score for Diverse In-Vehicle Data Recording6 Jul 2025
- 2025Next-Generation Conflict Forecasting: Unleashing Predictive Patterns through Spatiotemporal Learning8 Jun 2025
- 2025Uncertainty quantification with approximate variational learning for wearable photoplethysmography prediction tasks16 May 2025
- 2025Diffusion Based Ambiguous Image Segmentation8 Apr 2025
- 2025L-FUSION: Laplacian Fetal Ultrasound Segmentation & Uncertainty Estimation7 Mar 2025
- 2025Benchmarking Vision Foundation Models for Input Monitoring in Autonomous Driving14 Jan 2025
- 2025Uncertainty-Aware Online Extrinsic Calibration: A Conformal Prediction Approach12 Jan 2025
- 2024Neural Network Meta Classifier: Improving the Reliability of Anomaly Segmentation14 Dec 2024
- 20243DTTNet: Multimodal Fusion-Based 3D Traversable Terrain Modeling for Off-Road Environments11 Dec 2024
- 2024A Review of Bayesian Uncertainty Quantification in Deep Probabilistic Image Segmentation25 Nov 2024
- 2024Calibrated and Efficient Sampling-Free Confidence Estimation for LiDAR Scene Semantic Segmentation18 Nov 2024
- 2024Next Best View For Point-Cloud Model Acquisition: Bayesian Approximation and Uncertainty Analysis4 Nov 2024
- 2024A Multi-Modal Approach for Face Anti-Spoofing in Non-Calibrated Systems using Disparity Maps31 Oct 2024
- 2024Probabilistic U-Net with Kendall Shape Spaces for Geometry-Aware Segmentations of Images17 Oct 2024
- 2024Understanding Human Activity with Uncertainty Measure for Novelty in Graph Convolutional Networks10 Oct 2024
- 2024Towards Trustworthy Web Attack Detection: An Uncertainty-Aware Ensemble Deep Kernel Learning Model10 Oct 2024
- 2024Generalizing to any diverse distribution: uniformity, gentle finetuning and rebalancing8 Oct 2024
- 2024Uncertainty-aware Human Mobility Modeling and Anomaly Detection2 Oct 2024
- 2024Towards Integrating Epistemic Uncertainty Estimation into the Radiotherapy Workflow27 Sep 2024
- 2024Uncertainty and Prediction Quality Estimation for Semantic Segmentation via Graph Neural Networks17 Sep 2024
- 2024Bayesian Self-Training for Semi-Supervised 3D Segmentation12 Sep 2024
- 2024Forecasting infectious disease prevalence with associated uncertainty using neural networks2 Sep 2024
- 2024Explainable Convolutional Networks for Crater Detection and Lunar Landing Navigation24 Aug 2024
- 2024Uncertainty-Informed Volume Visualization using Implicit Neural Representation12 Aug 2024
- 2024Bayesian Active Learning for Semantic Segmentation3 Aug 2024
- 2024Enhanced Uncertainty Estimation in Ultrasound Image Segmentation with MSU-Net31 Jul 2024
- 2024Distribution-Aware Replay for Continual MRI Segmentation30 Jul 2024
- 2024Uncertainty-Aware Deep Neural Representations for Visual Analysis of Vector Field Data23 Jul 2024
- 2024Deep Time Series Models: A Comprehensive Survey and Benchmark18 Jul 2024
- 2024Subgroup-Specific Risk-Controlled Dose Estimation in Radiotherapy11 Jul 2024
50 newest of 218 All 218 (JSON)
- 2025Fast SAM2 with Text-Driven Token Pruningcited by 3
- 2025Fast SAM2 with Text-Driven Token Pruning24 Dec 2025
- 2021FIERY: Future Instance Prediction in Bird's-Eye View from Surround Monocular Camerascited by 239
- 2024Deep Time Series Models: A Comprehensive Survey and Benchmarkcited by 197
- 2021SegmentMeIfYouCan: A Benchmark for Anomaly Segmentationcited by 150
- 2021Pixel-wise Anomaly Detection in Complex Driving Scenescited by 109
- 2022Benchmarking Bayesian Deep Learning on Diabetic Retinopathy Detection Taskscited by 49
- 2021Semi-Supervised Domain Generalization with Stochastic StyleMatchcited by 43
- 2021Triggering Failures: Out-Of-Distribution detection by learning from local adversarial attacks in Semantic Segmentationcited by 40
- 2021Uncertainty-Aware Machine Translation Evaluationcited by 35
- 2022GIPSO: Geometrically Informed Propagation for Online Adaptation in 3D LiDAR Segmentationcited by 35
- 2022Probabilistic Representations for Video Contrastive Learningcited by 34
- 2021Uncertainty Estimation via Response Scaling for Pseudo-mask Noise Mitigation in Weakly-supervised Semantic Segmentationcited by 29
- 2021QU-BraTS: MICCAI BraTS 2020 Challenge on Quantifying Uncertainty in Brain Tumor Segmentation - Analysis of Ranking Scores and Benchmarking Resultscited by 28
12 most cited of 208 All 208 (JSON)
- 2026Towards Trustworthy AI for Glioma Diagnosis: A Task-Aware Evaluation of Uncertainty Quantification30 Sep 2026
- 2026One Attack to Fool Them All: Highly Transferable Black-Box Adversarial Attacks on Frontier MLLMs27 Sep 2026
- 2026UnGAP: Uncertainty-Guided Affine Prompting for Real-Time Crack Segmentation4 May 2026
- 2026Algorithm and Hardware Co-Design for Efficient Complex-Valued Uncertainty Estimation21 Apr 2026
- 2026Right Regions, Wrong Labels: Semantic Label Flips in Segmentation under Correlation Shift14 Apr 2026
- 2026Better than Average: Spatially-Aware Aggregation of Segmentation Uncertainty Improves Downstream Performance31 Mar 2026
- 2026Uncertainty-Aware Vision-based Risk Object Identification via Conformal Risk Tube Prediction25 Mar 2026
- 2026URA-Net: Uncertainty-Integrated Anomaly Perception and Restoration Attention Network for Unsupervised Anomaly Detection24 Mar 2026
- 2026DA-Cal: Towards Cross-Domain Calibration in Semantic Segmentation24 Feb 2026
- 2026REV-INR: Regularized Evidential Implicit Neural Representation for Uncertainty-Aware Volume Visualization25 Jan 2026
- 2025UAGLNet: Uncertainty-Aggregated Global-Local Fusion Network with Cooperative CNN-Transformer for Building Extraction15 Dec 2025
- 2025BATIS: Bayesian Approaches for Targeted Improvement of Species Distribution Models22 Oct 2025
12 newest of 208 All 208 (JSON)