Being Bayesian about Categorical Probability
Not on the map. Why?
Abstract (arXiv)
Neural networks utilize the softmax as a building block in classification tasks, which contains an overconfidence problem and lacks an uncertainty representation ability. As a Bayesian alternative to the softmax, we consider a random variable of a categorical probability over class labels. In this framework, the prior distribution explicitly models the presumed noise inherent in the observed label, which provides consistent gains in generalization performance in multiple challenging tasks. The proposed method inherits advantages of Bayesian approaches that achieve better uncertainty estimation and model calibration. Our method can be implemented as a plug-and-play loss function with negligible computational overhead compared to the softmax with the cross-entropy loss function.
Key facts. Cited by 35 papers in the map (data through 7 Oct 2026). First posted on arXiv 19 Feb 2020.
Builds on
No reference list yet.
Built on by
Citing papers per year: 2021: 6; 2022: 10; 2023: 8; 2024: 6; 2025: 3; 2026: 2.
35 papers.
Sort:
By area:
- 2021A Survey of Uncertainty in Deep Neural Networkscited by 675
- 2021Prior and Posterior Networks: A Survey on Evidential Deep Learning Methods For Uncertainty Estimationcited by 71
- 2022Better Uncertainty Calibration via Proper Scores for Classification and Beyondcited by 65
- 2022Sample-dependent Adaptive Temperature Scaling for Improved Calibrationcited by 48
- 2022Post-hoc Uncertainty Learning using a Dirichlet Meta-Modelcited by 31
- 2022Exploring Predictive Uncertainty and Calibration in NLP: A Study on the Impact of Method & Data Scarcitycited by 24
- 2023Dirichlet-based Uncertainty Calibration for Active Domain Adaptationcited by 23
- 2024Uncertainty Estimation by Density Aware Evidential Deep Learningcited by 22
- 2021Robust Semantic Segmentation with Superpixel-Mixcited by 19
- 2024Are Uncertainty Quantification Capabilities of Evidential Deep Learning a Mirage?cited by 17
- 2023EdVAE: Mitigating Codebook Collapse with Evidential Discrete Variational Autoencoderscited by 16
- 2022Ambiguous Images With Human Judgments for Robust Visual Event Classificationcited by 12
23 more
- 2022Explainable Artificial Intelligence for Bayesian Neural Networks: Towards trustworthy predictions of ocean dynamicscited by 11
- 2023Overcoming Recency Bias of Normalization Statistics in Continual Learning: Balance and Adaptationcited by 11
- 2023Consistent and Asymptotically Unbiased Estimation of Proper Calibration Errorscited by 10
- 2022Segmenting Known Objects and Unseen Unknowns without Prior Knowledgecited by 9
- 2023Discretization-Induced Dirichlet Posterior for Robust Uncertainty Quantification on Regressioncited by 7
- 2022Revisiting Softmax for Uncertainty Approximation in Text Classificationcited by 4
- 2024Optimizing Estimators of Squared Calibration Errors in Classificationcited by 3
- 2021Fuzzy Classification of Multi-intent Utterancescited by 2
- 2023A Confidence-based Acquisition Model for Self-supervised Active Learning and Label Correctioncited by 2
- 2025Enhancing Uncertainty Estimation and Interpretability via Bayesian Non-negative Decision Layercited by 2
- 2026Evidential Transformation Network: Turning Pretrained Models into Evidential Models for Post-hoc Uncertainty Estimationcited by 2
- 2022Switchable Representation Learning Framework with Self-compatibilitycited by 1
- 2022Bayesian Evidential Learning for Few-Shot Classificationcited by 1
- 2023IW-GAE: Importance Weighted Group Accuracy Estimation for Improved Calibration and Model Selection in Unsupervised Domain Adaptationcited by 1
- 2024Improving self-training under distribution shifts via anchored confidence with theoretical guaranteescited by 1
- 2025Subjective Logic Encodingscited by 1
- 2025MedBayes-Lite: A Clinical Uncertainty Governance Layer for Risk-Aware Medical Decision Supportcited by 1
- 2021Scene Uncertainty and the Wellington Posterior of Deterministic Image Classifierscited by 0
- 2021Disturbing Target Values for Neural Network Regularizationcited by 0
- 2023Function-Space Regularization for Deep Bayesian Classificationcited by 0
- 2024Transforming Location Retrieval at Airbnb: A Journey from Heuristics to Reinforcement Learningcited by 0
- 2024Evidential Transformers for Improved Image Retrievalcited by 0
- 2026Bayesian Preference Learning for Test-Time Steerable Reward Modelscited by 0
- 2026Evidential Transformation Network: Turning Pretrained Models into Evidential Models for Post-hoc Uncertainty Estimation9 Apr 2026
- 2026Bayesian Preference Learning for Test-Time Steerable Reward Models9 Feb 2026
- 2025MedBayes-Lite: A Clinical Uncertainty Governance Layer for Risk-Aware Medical Decision Support20 Nov 2025
- 2025Enhancing Uncertainty Estimation and Interpretability via Bayesian Non-negative Decision Layer28 May 2025
- 2025Subjective Logic Encodings17 Feb 2025
- 2024Improving self-training under distribution shifts via anchored confidence with theoretical guarantees1 Nov 2024
- 2024Optimizing Estimators of Squared Calibration Errors in Classification9 Oct 2024
- 2024Uncertainty Estimation by Density Aware Evidential Deep Learning13 Sep 2024
- 2024Evidential Transformers for Improved Image Retrieval2 Sep 2024
- 2024Transforming Location Retrieval at Airbnb: A Journey from Heuristics to Reinforcement Learning23 Aug 2024
- 2024Are Uncertainty Quantification Capabilities of Evidential Deep Learning a Mirage?9 Feb 2024
- 2023Consistent and Asymptotically Unbiased Estimation of Proper Calibration Errors14 Dec 2023
23 more
- 2023IW-GAE: Importance Weighted Group Accuracy Estimation for Improved Calibration and Model Selection in Unsupervised Domain Adaptation16 Oct 2023
- 2023A Confidence-based Acquisition Model for Self-supervised Active Learning and Label Correction13 Oct 2023
- 2023Overcoming Recency Bias of Normalization Statistics in Continual Learning: Balance and Adaptation13 Oct 2023
- 2023EdVAE: Mitigating Codebook Collapse with Evidential Discrete Variational Autoencoders9 Oct 2023
- 2023Discretization-Induced Dirichlet Posterior for Robust Uncertainty Quantification on Regression17 Aug 2023
- 2023Function-Space Regularization for Deep Bayesian Classification12 Jul 2023
- 2023Dirichlet-based Uncertainty Calibration for Active Domain Adaptation27 Feb 2023
- 2022Post-hoc Uncertainty Learning using a Dirichlet Meta-Model14 Dec 2022
- 2022Revisiting Softmax for Uncertainty Approximation in Text Classification25 Oct 2022
- 2022Exploring Predictive Uncertainty and Calibration in NLP: A Study on the Impact of Method & Data Scarcity20 Oct 2022
- 2022Ambiguous Images With Human Judgments for Robust Visual Event Classification6 Oct 2022
- 2022Segmenting Known Objects and Unseen Unknowns without Prior Knowledge12 Sep 2022
- 2022Bayesian Evidential Learning for Few-Shot Classification19 Jul 2022
- 2022Sample-dependent Adaptive Temperature Scaling for Improved Calibration13 Jul 2022
- 2022Switchable Representation Learning Framework with Self-compatibility16 Jun 2022
- 2022Explainable Artificial Intelligence for Bayesian Neural Networks: Towards trustworthy predictions of ocean dynamics30 Apr 2022
- 2022Better Uncertainty Calibration via Proper Scores for Classification and Beyond15 Mar 2022
- 2021Disturbing Target Values for Neural Network Regularization11 Oct 2021
- 2021Prior and Posterior Networks: A Survey on Evidential Deep Learning Methods For Uncertainty Estimation6 Oct 2021
- 2021Robust Semantic Segmentation with Superpixel-Mix2 Aug 2021
- 2021A Survey of Uncertainty in Deep Neural Networks7 Jul 2021
- 2021Scene Uncertainty and the Wellington Posterior of Deterministic Image Classifiers25 Jun 2021
- 2021Fuzzy Classification of Multi-intent Utterances22 Apr 2021
- 2021A Survey of Uncertainty in Deep Neural Networkscited by 675
- 2021Prior and Posterior Networks: A Survey on Evidential Deep Learning Methods For Uncertainty Estimationcited by 71
- 2022Better Uncertainty Calibration via Proper Scores for Classification and Beyondcited by 65
- 2022Sample-dependent Adaptive Temperature Scaling for Improved Calibrationcited by 48
- 2022Post-hoc Uncertainty Learning using a Dirichlet Meta-Modelcited by 31
- 2022Exploring Predictive Uncertainty and Calibration in NLP: A Study on the Impact of Method & Data Scarcitycited by 24
- 2023Dirichlet-based Uncertainty Calibration for Active Domain Adaptationcited by 23
- 2024Uncertainty Estimation by Density Aware Evidential Deep Learningcited by 22
- 2021Robust Semantic Segmentation with Superpixel-Mixcited by 19
- 2024Are Uncertainty Quantification Capabilities of Evidential Deep Learning a Mirage?cited by 17
- 2023EdVAE: Mitigating Codebook Collapse with Evidential Discrete Variational Autoencoderscited by 16
- 2022Ambiguous Images With Human Judgments for Robust Visual Event Classificationcited by 12
12 most cited of 34 All 34 (JSON)
- 2026Evidential Transformation Network: Turning Pretrained Models into Evidential Models for Post-hoc Uncertainty Estimation9 Apr 2026
- 2025MedBayes-Lite: A Clinical Uncertainty Governance Layer for Risk-Aware Medical Decision Support20 Nov 2025
- 2025Enhancing Uncertainty Estimation and Interpretability via Bayesian Non-negative Decision Layer28 May 2025
- 2025Subjective Logic Encodings17 Feb 2025
- 2024Improving self-training under distribution shifts via anchored confidence with theoretical guarantees1 Nov 2024
- 2024Optimizing Estimators of Squared Calibration Errors in Classification9 Oct 2024
- 2024Uncertainty Estimation by Density Aware Evidential Deep Learning13 Sep 2024
- 2024Evidential Transformers for Improved Image Retrieval2 Sep 2024
- 2024Transforming Location Retrieval at Airbnb: A Journey from Heuristics to Reinforcement Learning23 Aug 2024
- 2024Are Uncertainty Quantification Capabilities of Evidential Deep Learning a Mirage?9 Feb 2024
- 2023Consistent and Asymptotically Unbiased Estimation of Proper Calibration Errors14 Dec 2023
- 2023IW-GAE: Importance Weighted Group Accuracy Estimation for Improved Calibration and Model Selection in Unsupervised Domain Adaptation16 Oct 2023
12 newest of 34 All 34 (JSON)