Robust Uncertainty Estimation for Classification of Maritime Objects
Not on the map. Why?
Abstract (arXiv)
We explore the use of uncertainty estimation in the maritime domain, showing the efficacy on toy datasets (CIFAR10) and proving it on an in-house dataset, SHIPS. We present a method joining the intra-class uncertainty achieved using Monte Carlo Dropout, with recent discoveries in the field of outlier detection, to gain more holistic uncertainty measures. We explore the relationship between the introduced uncertainty measures and examine how well they work on CIFAR10 and in a real-life setting. Our work improves the FPR95 by 8% compared to the current highest-performing work when the models are trained without out-of-distribution data. We increase the performance by 77% compared to a vanilla implementation of the Wide ResNet. We release the SHIPS dataset and show the effectiveness of our method by improving the FPR95 by 44.2% with respect to the baseline. Our approach is model agnostic, easy to implement, and often does not require model retraining.
Key facts. No citing papers in the map yet (data through 7 Oct 2026). Builds on 24 of its 40 references that are in the map. First posted on arXiv 3 Jul 2023.
Builds on
24 of 40 references.
References · 24
- 2017On Calibration of Modern Neural Networkscited by 4,860
- 2015Dropout as a Bayesian Approximation: Representing Model Uncertainty in Deep Learningcited by 4,416
- 2016Simple and Scalable Predictive Uncertainty Estimation using Deep Ensemblescited by 3,888
- 2016Wide Residual Networkscited by 3,057
- 2016A Baseline for Detecting Misclassified and Out-of-Distribution Examples in Neural Networkscited by 2,362
- 2013Describing Textures in the Wildcited by 2,110
- 2018A Simple Unified Framework for Detecting Out-of-Distribution Samples and Adversarial Attackscited by 1,472
- 2017Enhancing The Reliability of Out-of-distribution Image Detection in Neural Networkscited by 1,325
- 2020Energy-based Out-of-distribution Detectioncited by 1,296
- 2018Deep Anomaly Detection with Outlier Exposurecited by 939
- 2019Using Self-Supervised Learning Can Improve Model Robustness and Uncertaintycited by 511
- 2018Accurate Uncertainties for Deep Learning Using Calibrated Regressioncited by 417
12 more
- 2020Generalized ODIN: Detecting Out-of-distribution Image without Learning from Out-of-distribution Datacited by 408
- 2017Training Confidence-calibrated Classifiers for Detecting Out-of-Distribution Samplescited by 389
- 2022VOS: Learning What You Don't Know by Virtual Outlier Synthesiscited by 300
- 2018Aleatoric uncertainty estimation with test-time augmentation for medical image segmentation with convolutional neural networkscited by 278
- 2022Mitigating Neural Network Overconfidence with Logit Normalizationcited by 251
- 2018Understanding Measures of Uncertainty for Adversarial Example Detectioncited by 177
- 2015TurkerGaze: Crowdsourcing Saliency with Webcam based Eye Trackingcited by 165
- 2020Posterior Network: Uncertainty Estimation without OOD Samples via Density-Based Pseudo-Countscited by 163
- 2016Video Processing from Electro-optical Sensors for Object Detection and Tracking in Maritime Environment: A Surveycited by 46
- 2018Open Category Detection with PAC Guaranteescited by 35
- 2020Dense open-set recognition with synthetic outliers generated by Real NVPcited by 29
- 2021An Effective Baseline for Robustness to Distributional Shiftcited by 25
Built on by
Not cited yet.