Hands-on Bayesian Neural Networks -- a Tutorial for Deep Learning Users
Not on the map. Why?
Abstract (arXiv)
Modern deep learning methods constitute incredibly powerful tools to tackle a myriad of challenging problems. However, since deep learning methods operate as black boxes, the uncertainty associated with their predictions is often challenging to quantify. Bayesian statistics offer a formalism to understand and quantify the uncertainty associated with deep neural network predictions. This tutorial provides an overview of the relevant literature and a complete toolset to design, implement, train, use and evaluate Bayesian Neural Networks, i.e. Stochastic Artificial Neural Networks trained using Bayesian methods.
Key facts. Cited by 336 papers in the map (data through 7 Oct 2026). First posted on arXiv 14 Jul 2020.
Builds on
No reference list yet.
Built on by
Citing papers per year: 2021: 27; 2022: 52; 2023: 68; 2024: 76; 2025: 79; 2026: 34.
336 papers.
Sort:
By area:
- 2024A Survey on Uncertainty Quantification of Large Language Models: Taxonomy, Open Research Challenges, and Future Directionscited by 115
- 2021Priors in Bayesian Deep Learning: A Reviewcited by 101
- 2023A Survey on Uncertainty Quantification Methods for Deep Learningcited by 78
- 2023Machine learning with data assimilation and uncertainty quantification for dynamical systems: a reviewcited by 74
- 2022Personalized Federated Learning via Variational Bayesian Inferencecited by 68
- 2022Trustworthy clinical AI solutions: a unified review of uncertainty quantification in deep learning models for medical image analysiscited by 62
- 2023Credal Bayesian Deep Learningcited by 45
- 2022Recent Advances for Quantum Neural Networks in Generative Learningcited by 39
- 2023A review of uncertainty quantification in medical image analysis: probabilistic and non-probabilistic methodscited by 39
- 2024BEARS Make Neuro-Symbolic Models Aware of their Reasoning Shortcutscited by 36
- 2025No Answer Needed: Predicting LLM Answer Accuracy from Question-Only Linear Probescited by 35
- 2021Constructing Neural Network-Based Models for Simulating Dynamical Systemscited by 29
38 more
- 2021Deep Ensembles from a Bayesian Perspectivecited by 27
- 2022Augmenting Softmax Information for Selective Classification with Out-of-Distribution Datacited by 27
- 2023Uncertainty Quantification in Machine Learning for Engineering Design and Health Prognostics: A Tutorialcited by 27
- 2022Implicit Full Waveform Inversion with Deep Neural Representationcited by 26
- 2023A Large-Scale Study of Probabilistic Calibration in Neural Network Regressioncited by 26
- 2023A Primer on Bayesian Neural Networks: Review and Debatescited by 26
- 2024CreINNs: Credal-Set Interval Neural Networks for Uncertainty Estimation in Classification Taskscited by 26
- 2021A Survey on Epistemic (Model) Uncertainty in Supervised Learning: Recent Advances and Applicationscited by 24
- 2022Uncertainty Quantification for Traffic Forecasting: A Unified Approachcited by 22
- 2022Bayesian Learning for Neural Networks: an algorithmic surveycited by 22
- 2023Bayesian Federated Learning: A Surveycited by 22
- 2021PID-GAN: A GAN Framework based on a Physics-informed Discriminator for Uncertainty Quantification with Physicscited by 21
- 2024The Empirical Impact of Neural Parameter Symmetries, or Lack Thereofcited by 21
- 2024Gaussian Stochastic Weight Averaging for Bayesian Low-Rank Adaptation of Large Language Modelscited by 20
- 2025Generative Uncertainty in Diffusion Modelscited by 20
- 2023Random-Set Neural Networks (RS-NN)cited by 19
- 2021Deep Learning Methods for Daily Wildfire Danger Forecastingcited by 17
- 2024Modeling uncertainty for Gaussian Splattingcited by 17
- 2022Autoinverse: Uncertainty Aware Inversion of Neural Networkscited by 16
- 2022Epistemic Deep Learningcited by 15
- 2022On double-descent in uncertainty quantification in overparametrized modelscited by 15
- 2023DUDES: Deep Uncertainty Distillation using Ensembles for Semantic Segmentationcited by 15
- 2023Improving Neural Additive Models with Bayesian Principlescited by 15
- 2023Bayesian Renormalizationcited by 13
- 2024Credal Wrapper of Model Averaging for Uncertainty Estimation in Classificationcited by 13
- 2021Structured Stochastic Gradient MCMCcited by 12
- 2021Bayesian Deep Learning for Partial Differential Equation Parameter Discovery with Sparse and Noisy Datacited by 12
- 2022Uncertainty estimation of pedestrian future trajectory using Bayesian approximationcited by 12
- 2022Bayesian Physics-Informed Extreme Learning Machine for Forward and Inverse PDE Problems with Noisy Datacited by 12
- 2022A General Framework for quantifying Aleatoric and Epistemic uncertainty in Graph Neural Networkscited by 12
- 2023Wasserstein Generative Regressioncited by 12
- 2024Looks Too Good To Be True: An Information-Theoretic Analysis of Hallucinations in Generative Restoration Modelscited by 12
- 2021Fail-Safe Execution of Deep Learning based Systems through Uncertainty Monitoringcited by 11
- 2021The Peril of Popular Deep Learning Uncertainty Estimation Methodscited by 11
- 2022Explainable Artificial Intelligence for Bayesian Neural Networks: Towards trustworthy predictions of ocean dynamicscited by 11
- 2022Variational Bayes Deep Operator Network: A data-driven Bayesian solver for parametric differential equationscited by 11
- 2023Improved uncertainty quantification for neural networks with Bayesian last layercited by 11
- 2023UMat: Uncertainty-Aware Single Image High Resolution Material Capturecited by 11
50 most cited of 336 All 336 (JSON)
- 2026Variational Augmented Invertible Koopman Autoencoder for probabilistic time series forecasting29 Sep 2026
- 20264D Parallelism Unlocks Exascale Bayesian Neural Networks for High-Fidelity Atmospheric Modeling11 Sep 2026
- 2026Uncertainty propagation in auto-regressive random neural network models20 Aug 2026
- 2026Structure-preserving uncertainty quantification for GENERIC dynamics12 Aug 2026
- 2026Constrained Co-Design for Photonic Bayesian Neural Networks3 Aug 2026
- 2026Uncertainty quantification for trustworthy deep learning: Methods and measures30 Jul 2026
- 2026Interval and fuzzy physics-augmented neural networks (iPANN and fPANN) for uncertainty quantification and propagation in constitutive modeling22 Jul 2026
- 2026In-Context Residual Calibration for Uncertainty Quantification of Energy Time Series over Graphs30 Jun 2026
- 2026Equivariance and Augmentation for Bayesian Neural Networks24 Jun 2026
- 2026KISS: Keeping it Simple and Slotted when Learning to Communicate over Wireless29 May 2026
- 2026Empirical Bayes Conformal Prediction for Vision and Language Models22 May 2026
- 2026Uncertainty-aware classification and triage of structural heart disease using electrocardiography and echocardiography metrics21 May 2026
38 more
- 2026Incentivizing Truthfulness and Collaborative Fairness in Bayesian Learning12 May 2026
- 2026Possibilistic Predictive Uncertainty for Deep Learning1 May 2026
- 2026Neural Aided Kalman Filtering for UAV State Estimation in Degraded Sensing Environments30 Apr 2026
- 2026Algorithm and Hardware Co-Design for Efficient Complex-Valued Uncertainty Estimation21 Apr 2026
- 2026Uncertainty-quantified Pulse Signal Recovery from Facial Video using Regularized Stochastic Interpolants12 Apr 2026
- 2026Learning Surrogate LPV State-Space Models with Uncertainty Quantification31 Mar 2026
- 2026CoE: Collaborative Entropy for Uncertainty Quantification in Agentic Multi-LLM Systems30 Mar 2026
- 2026Bayesian-Symbolic Integration for Uncertainty-Aware Parking Prediction28 Mar 2026
- 2026Uncertainty-Aware Vision-based Risk Object Identification via Conformal Risk Tube Prediction25 Mar 2026
- 2026Probabilistic Federated Learning on Uncertain and Heterogeneous Data with Model Personalization18 Mar 2026
- 2026Set-based v.s. Distribution-based Representations of Epistemic Uncertainty: A Comparative Study26 Feb 2026
- 2026Function-Space Empirical Bayes Regularisation with Student's t Priors25 Feb 2026
- 2026Estimation of Confidence Bounds in Binary Classification using Wilson Score Kernel Density Estimation24 Feb 2026
- 2026From Classical to Topological Neural Networks Under Uncertainty10 Feb 2026
- 2026Active Asymmetric Multi-Agent Multimodal Learning under Uncertainty4 Feb 2026
- 2026Bayesian Interpolating Neural Network (B-INN): a scalable and reliable Bayesian model for large-scale physical systems30 Jan 2026
- 2026Neural-Inspired Posterior Approximation (NIPA)30 Jan 2026
- 2026Evaluating the trustworthiness of the Fr'echet Inception Distance with stochastic embedding representations29 Jan 2026
- 2026DropoutTS: Sample-Adaptive Dropout for Robust Time Series Forecasting29 Jan 2026
- 2026Artificial Intelligence in Materials Science and Engineering: Current Landscape, Key Challenges, and Future Trajectorie18 Jan 2026
- 2026An AI-powered Bayesian Generative Modeling Approach for Arbitrary Conditional Inference8 Jan 2026
- 2026SGD-Based Knowledge Distillation with Bayesian Teachers: Theory and Guidelines4 Jan 2026
- 2025Physics-Informed Machine Learning for Transformer Condition Monitoring -- Part II: Physics-Informed Neural Networks and Uncertainty Quantification20 Dec 2025
- 2025Generative Multi-Objective Bayesian Optimization with Scalable Batch Evaluations for Sample-Efficient De Novo Molecular Design19 Dec 2025
- 2025Solomonoff-Inspired Hypothesis Ranking with LLMs for Prediction Under Uncertainty19 Dec 2025
- 2025Mind the Jumps: A Scalable Robust Local Gaussian Process for Multidimensional Response Surfaces with Discontinuities14 Dec 2025
- 2025High-Dimensional Surrogate Modeling for Closed-Loop Learning of Neural-Network-Parameterized Model Predictive Control12 Dec 2025
- 2025Uncertainty-Preserving QBNNs: Multi-Level Quantization of SVI-Based Bayesian Neural Networks for Image Classification11 Dec 2025
- 2025Credal and Interval Deep Evidential Classifications5 Dec 2025
- 2025Uncertainty Reasoning with Photonic Bayesian Machines1 Dec 2025
- 2025Building Trustworthy AI for Materials Discovery: From Autonomous Laboratories to Z-scores30 Nov 2025
- 2025Calibrating Geophysical Predictions under Constrained Probabilistic Distributions28 Nov 2025
- 2025Accelerated Execution of Bayesian Neural Networks using a Single Probabilistic Forward Pass and Code Generation28 Nov 2025
- 2025Efficient RF Passive Components Modeling with Bayesian Online Learning and Uncertainty Aware Sampling19 Nov 2025
- 2025Learning Dynamics from Input-Output Data with Hamiltonian Gaussian Processes7 Nov 2025
- 2025Partial Trace-Class Bayesian Neural Networks3 Nov 2025
- 2025A systematic evaluation of uncertainty quantification techniques in deep learning: a case study in photoplethysmography signal analysis31 Oct 2025
- 2025Energy-Efficient Autonomous Driving with Adaptive Perception and Robust Decision29 Oct 2025
50 newest of 336 All 336 (JSON)
- 2025Generative Uncertainty in Diffusion Modelscited by 20
- 2024DiffSF: Diffusion Models for Scene Flow Estimationcited by 6
- 2023Score-based Diffusion Models With Self-supervised Learning For Accelerated 3D Multi-contrast Cardiac Magnetic Resonance Imagingcited by 4
- 2025DiffPF: Differentiable Particle Filtering with Generative Sampling via Conditional Diffusion Modelscited by 2
- 2025UnPose: Uncertainty-Guided Diffusion Priors for Zero-Shot Pose Estimationcited by 2
- 2024Exploring Diffusion Models' Corruption Stage in Few-Shot Fine-tuning and Mitigating with Bayesian Neural Networkscited by 1
- 2025DnD Filter: Differentiable State Estimation for Dynamic Systems using Diffusion Modelscited by 1
- 2025UnPose: Uncertainty-Guided Diffusion Priors for Zero-Shot Pose Estimation21 Aug 2025
- 2025DiffPF: Differentiable Particle Filtering with Generative Sampling via Conditional Diffusion Models21 Jul 2025
- 2025DnD Filter: Differentiable State Estimation for Dynamic Systems using Diffusion Models3 Mar 2025
- 2025Generative Uncertainty in Diffusion Models28 Feb 2025
- 2024Exploring Diffusion Models' Corruption Stage in Few-Shot Fine-tuning and Mitigating with Bayesian Neural Networks30 May 2024
- 2024DiffSF: Diffusion Models for Scene Flow Estimation8 Mar 2024
- 2023Score-based Diffusion Models With Self-supervised Learning For Accelerated 3D Multi-contrast Cardiac Magnetic Resonance Imaging7 Oct 2023
- 2024A Survey on Uncertainty Quantification of Large Language Models: Taxonomy, Open Research Challenges, and Future Directionscited by 115
- 2021Priors in Bayesian Deep Learning: A Reviewcited by 101
- 2023A Survey on Uncertainty Quantification Methods for Deep Learningcited by 78
- 2023Machine learning with data assimilation and uncertainty quantification for dynamical systems: a reviewcited by 74
- 2022Personalized Federated Learning via Variational Bayesian Inferencecited by 68
- 2022Trustworthy clinical AI solutions: a unified review of uncertainty quantification in deep learning models for medical image analysiscited by 62
- 2023Credal Bayesian Deep Learningcited by 45
- 2022Recent Advances for Quantum Neural Networks in Generative Learningcited by 39
- 2023A review of uncertainty quantification in medical image analysis: probabilistic and non-probabilistic methodscited by 39
- 2024BEARS Make Neuro-Symbolic Models Aware of their Reasoning Shortcutscited by 36
- 2025No Answer Needed: Predicting LLM Answer Accuracy from Question-Only Linear Probescited by 35
- 2021Constructing Neural Network-Based Models for Simulating Dynamical Systemscited by 29
12 most cited of 323 All 323 (JSON)
- 2026Variational Augmented Invertible Koopman Autoencoder for probabilistic time series forecasting29 Sep 2026
- 20264D Parallelism Unlocks Exascale Bayesian Neural Networks for High-Fidelity Atmospheric Modeling11 Sep 2026
- 2026Uncertainty propagation in auto-regressive random neural network models20 Aug 2026
- 2026Structure-preserving uncertainty quantification for GENERIC dynamics12 Aug 2026
- 2026Constrained Co-Design for Photonic Bayesian Neural Networks3 Aug 2026
- 2026Uncertainty quantification for trustworthy deep learning: Methods and measures30 Jul 2026
- 2026Interval and fuzzy physics-augmented neural networks (iPANN and fPANN) for uncertainty quantification and propagation in constitutive modeling22 Jul 2026
- 2026In-Context Residual Calibration for Uncertainty Quantification of Energy Time Series over Graphs30 Jun 2026
- 2026Equivariance and Augmentation for Bayesian Neural Networks24 Jun 2026
- 2026KISS: Keeping it Simple and Slotted when Learning to Communicate over Wireless29 May 2026
- 2026Empirical Bayes Conformal Prediction for Vision and Language Models22 May 2026
- 2026Uncertainty-aware classification and triage of structural heart disease using electrocardiography and echocardiography metrics21 May 2026
12 newest of 323 All 323 (JSON)