Inhibited Softmax for Uncertainty Estimation in Neural Networks
Not on the map. Why?
Abstract (arXiv)
We present a new method for uncertainty estimation and out-of-distribution detection in neural networks with softmax output. We extend softmax layer with an additional constant input. The corresponding additional output is able to represent the uncertainty of the network. The proposed method requires neither additional parameters nor multiple forward passes nor input preprocessing nor out-of-distribution datasets. We show that our method performs comparably to more computationally expensive methods and outperforms baselines on our experiments from image recognition and sentiment analysis domains.
Key facts. Cited by 19 papers in the map (data through 14 Oct 2026). First posted on arXiv 3 Oct 2018.
Builds on
No reference list yet.
Built on by
Citing papers per year: 2021: 4; 2022: 6; 2023: 3; 2024: 3; 2025: 2; 2026: 1.
19 papers.
Sort:
- 2021A Survey of Uncertainty in Deep Neural Networkscited by 680
- 2023ELFNet: Evidential Local-global Fusion for Stereo Matchingcited by 25
- 2022AI Security for Geoscience and Remote Sensing: Challenges and Future Trendscited by 23
- 2024A Structured Review of Literature on Uncertainty in Machine Learning & Deep Learningcited by 10
- 2021Learning Uncertainty For Safety-Oriented Semantic Segmentation In Autonomous Drivingcited by 8
- 2022Confidence estimation of classification based on the distribution of the neural network output layercited by 8
- 2022Revisiting Softmax for Uncertainty Approximation in Text Classificationcited by 4
- 2022TEDL: A Two-stage Evidential Deep Learning Method for Classification Uncertainty Quantificationcited by 3
- 2022To Softmax, or not to Softmax: that is the question when applying Active Learning for Transformer Modelscited by 3
- 2021Dealing with Distribution Mismatch in Semi-supervised Deep Learning for Covid-19 Detection Using Chest X-ray Images: A Novel Approach Using Feature Densitiescited by 2
- 2022Selective classification using a robust meta-learning approachcited by 2
- 2023Delay-SDE-net: A deep learning approach for time series modelling with memory and uncertainty estimatescited by 2
7 more
- 2021Sparse-shot Learning with Exclusive Cross-Entropy for Extremely Many Localisationscited by 0
- 2023Efficient IoT Inference via Context-Awarenesscited by 0
- 2024Robust quantum dots charge autotuning using neural network uncertaintycited by 0
- 2024Gaussian Mixture based Evidential Learning for Stereo Matchingcited by 0
- 2025Long-Term Alzheimers Disease Prediction: A Novel Image Generation Method Using Temporal Parameter Estimation with Normal Inverse Gamma Distribution on Uneven Time Seriescited by 0
- 2025Quantifying Uncertainty in Machine Learning-Based Pervasive Systems: Application to Human Activity Recognitioncited by 0
- 2026Noise reduction in BERT NER models for clinical entity extractioncited by 0
- 2026Noise reduction in BERT NER models for clinical entity extraction3 Feb 2026
- 2025Quantifying Uncertainty in Machine Learning-Based Pervasive Systems: Application to Human Activity Recognition10 Dec 2025
- 2025Long-Term Alzheimers Disease Prediction: A Novel Image Generation Method Using Temporal Parameter Estimation with Normal Inverse Gamma Distribution on Uneven Time Series26 Nov 2025
- 2024Gaussian Mixture based Evidential Learning for Stereo Matching5 Aug 2024
- 2024Robust quantum dots charge autotuning using neural network uncertainty7 Jun 2024
- 2024A Structured Review of Literature on Uncertainty in Machine Learning & Deep Learning1 Jun 2024
- 2023Efficient IoT Inference via Context-Awareness29 Oct 2023
- 2023ELFNet: Evidential Local-global Fusion for Stereo Matching1 Aug 2023
- 2023Delay-SDE-net: A deep learning approach for time series modelling with memory and uncertainty estimates14 Mar 2023
- 2022AI Security for Geoscience and Remote Sensing: Challenges and Future Trends19 Dec 2022
- 2022Selective classification using a robust meta-learning approach12 Dec 2022
- 2022Revisiting Softmax for Uncertainty Approximation in Text Classification25 Oct 2022
7 more
- 2022Confidence estimation of classification based on the distribution of the neural network output layer14 Oct 2022
- 2022To Softmax, or not to Softmax: that is the question when applying Active Learning for Transformer Models6 Oct 2022
- 2022TEDL: A Two-stage Evidential Deep Learning Method for Classification Uncertainty Quantification12 Sep 2022
- 2021Dealing with Distribution Mismatch in Semi-supervised Deep Learning for Covid-19 Detection Using Chest X-ray Images: A Novel Approach Using Feature Densities17 Aug 2021
- 2021A Survey of Uncertainty in Deep Neural Networks7 Jul 2021
- 2021Learning Uncertainty For Safety-Oriented Semantic Segmentation In Autonomous Driving28 May 2021
- 2021Sparse-shot Learning with Exclusive Cross-Entropy for Extremely Many Localisations21 Apr 2021
- 2021A Survey of Uncertainty in Deep Neural Networkscited by 680
- 2023ELFNet: Evidential Local-global Fusion for Stereo Matchingcited by 25
- 2022AI Security for Geoscience and Remote Sensing: Challenges and Future Trendscited by 23
- 2024A Structured Review of Literature on Uncertainty in Machine Learning & Deep Learningcited by 10
- 2021Learning Uncertainty For Safety-Oriented Semantic Segmentation In Autonomous Drivingcited by 8
- 2022Confidence estimation of classification based on the distribution of the neural network output layercited by 8
- 2022Revisiting Softmax for Uncertainty Approximation in Text Classificationcited by 4
- 2022TEDL: A Two-stage Evidential Deep Learning Method for Classification Uncertainty Quantificationcited by 3
- 2022To Softmax, or not to Softmax: that is the question when applying Active Learning for Transformer Modelscited by 3
- 2021Dealing with Distribution Mismatch in Semi-supervised Deep Learning for Covid-19 Detection Using Chest X-ray Images: A Novel Approach Using Feature Densitiescited by 2
- 2022Selective classification using a robust meta-learning approachcited by 2
- 2023Delay-SDE-net: A deep learning approach for time series modelling with memory and uncertainty estimatescited by 2
12 most cited of 19 All 19 (JSON)
- 2026Noise reduction in BERT NER models for clinical entity extraction3 Feb 2026
- 2025Quantifying Uncertainty in Machine Learning-Based Pervasive Systems: Application to Human Activity Recognition10 Dec 2025
- 2025Long-Term Alzheimers Disease Prediction: A Novel Image Generation Method Using Temporal Parameter Estimation with Normal Inverse Gamma Distribution on Uneven Time Series26 Nov 2025
- 2024Gaussian Mixture based Evidential Learning for Stereo Matching5 Aug 2024
- 2024Robust quantum dots charge autotuning using neural network uncertainty7 Jun 2024
- 2024A Structured Review of Literature on Uncertainty in Machine Learning & Deep Learning1 Jun 2024
- 2023Efficient IoT Inference via Context-Awareness29 Oct 2023
- 2023ELFNet: Evidential Local-global Fusion for Stereo Matching1 Aug 2023
- 2023Delay-SDE-net: A deep learning approach for time series modelling with memory and uncertainty estimates14 Mar 2023
- 2022AI Security for Geoscience and Remote Sensing: Challenges and Future Trends19 Dec 2022
- 2022Selective classification using a robust meta-learning approach12 Dec 2022
- 2022Revisiting Softmax for Uncertainty Approximation in Text Classification25 Oct 2022
12 newest of 19 All 19 (JSON)