Multiplicative Normalizing Flows for Variational Bayesian Neural Networks
Not on the map. Why?
Abstract (arXiv)
We reinterpret multiplicative noise in neural networks as auxiliary random variables that augment the approximate posterior in a variational setting for Bayesian neural networks. We show that through this interpretation it is both efficient and straightforward to improve the approximation by employing normalizing flows while still allowing for local reparametrizations and a tractable lower bound. In experiments we show that with this new approximation we can significantly improve upon classical mean field for Bayesian neural networks on both predictive accuracy as well as predictive uncertainty.
Key facts. Cited by 157 papers in the map (data through 14 Oct 2026). First posted on arXiv 6 Mar 2017.
Builds on
No reference list yet.
Built on by
Citing papers per year: 2020: 1; 2021: 48; 2022: 30; 2023: 27; 2024: 25; 2025: 22; 2026: 4.
157 papers.
Sort:
By area:
- 2021A Survey of Uncertainty in Deep Neural Networkscited by 680
- 2021What Are Bayesian Neural Network Posteriors Really Like?cited by 308
- 2021Bayesian Neural Network Priors Revisitedcited by 121
- 2021Epistemic Neural Networkscited by 120
- 2021Priors in Bayesian Deep Learning: A Reviewcited by 101
- 2023A Survey on Uncertainty Quantification Methods for Deep Learningcited by 81
- 2021Paragraph-level Rationale Extraction through Regularization: A case study on European Court of Human Rights Casescited by 77
- 2022ViewFool: Evaluating the Robustness of Visual Recognition to Adversarial Viewpointscited by 48
- 2021Posterior Meta-Replay for Continual Learningcited by 45
- 2021LiBRe: A Practical Bayesian Approach to Adversarial Detectioncited by 40
- 2021Infinitely Deep Bayesian Neural Networks with Stochastic Differential Equationscited by 38
- 2021Is MC Dropout Bayesian?cited by 35
38 more
- 2023A Rigorous Link between Deep Ensembles and (Variational) Bayesian Methodscited by 32
- 2022Universal approximation property of invertible neural networkscited by 30
- 2022Copula Conformal Prediction for Multi-step Time Series Forecastingcited by 29
- 2021A Bit More Bayesian: Domain-Invariant Learning with Uncertaintycited by 27
- 2023A Primer on Bayesian Neural Networks: Review and Debatescited by 27
- 2021Contextual Dropout: An Efficient Sample-Dependent Dropout Modulecited by 26
- 2022Conformal Prediction with Temporal Quantile Adjustmentscited by 25
- 2021Robustness via Cross-Domain Ensemblescited by 23
- 2021Uncertainty-Aware Reliable Text Classificationcited by 23
- 2021Generalized Normalizing Flows via Markov Chainscited by 23
- 2024HyperFast: Instant Classification for Tabular Datacited by 22
- 2023POCO: 3D Pose and Shape Estimation with Confidencecited by 21
- 2024Diffusive Gibbs Samplingcited by 21
- 2020Sequential Anomaly Detection using Inverse Reinforcement Learningcited by 20
- 2024Embedding Trajectory for Out-of-Distribution Detection in Mathematical Reasoningcited by 18
- 2021Bayesian OOD detection with aleatoric uncertainty and outlier exposurecited by 16
- 2021Sparse Uncertainty Representation in Deep Learning with Inducing Weightscited by 16
- 2021When in Doubt: Neural Non-Parametric Uncertainty Quantification for Epidemic Forecastingcited by 16
- 2023Uncertainty Quantification via Neural Posterior Principal Componentscited by 16
- 2021A Bayesian neural network predicts the dissolution of compact planetary systemscited by 15
- 2021Deep Learning for Bayesian Optimization of Scientific Problems with High-Dimensional Structurecited by 15
- 2022Posterior Refinement Improves Sample Efficiency in Bayesian Neural Networkscited by 14
- 2021Pathologies in priors and inference for Bayesian transformerscited by 13
- 2024Variational Bayesian Optimal Experimental Design with Normalizing Flowscited by 13
- 2021Uncertainty-Aware Deep Co-training for Semi-supervised Medical Image Segmentationcited by 12
- 2024Looks Too Good To Be True: An Information-Theoretic Analysis of Hallucinations in Generative Restoration Modelscited by 12
- 2022Conformal Methods for Quantifying Uncertainty in Spatiotemporal Data: A Surveycited by 11
- 2023Using AI Uncertainty Quantification to Improve Human Decision-Makingcited by 11
- 2024EigenVI: score-based variational inference with orthogonal function expansionscited by 11
- 2021Are Bayesian neural networks intrinsically good at out-of-distribution detection?cited by 10
- 2023Flat Seeking Bayesian Neural Networkscited by 10
- 2023Promises and Pitfalls of the Linearized Laplace in Bayesian Optimizationcited by 10
- 2024Epistemic Uncertainty Quantification For Pre-trained Neural Networkcited by 10
- 2022Conformal Prediction Intervals with Temporal Dependencecited by 9
- 2024Monotone, Bi-Lipschitz, and Polyak-Lojasiewicz Networkscited by 9
- 2022Learning Unbiased Transferability for Domain Adaptation by Uncertainty Modelingcited by 8
- 2022Tackling covariate shift with node-based Bayesian neural networkscited by 8
- 2022Confidence estimation of classification based on the distribution of the neural network output layercited by 8
50 most cited of 157 All 157 (JSON)
- 2026Optimal Transport Dropout for Structured Predictive Uncertainty27 Sep 2026
- 2026Do Deep Ensembles Actually Capture Uncertainty in Graph Neural Networks?21 May 2026
- 2026Hyper-V2X: Hypernetworks for Estimating Epistemic and Aleatoric Uncertainty in Cooperative Bird's-Eye-View Semantic Segmentation20 May 2026
- 2026Amortising Inference and Meta-Learning Priors in Neural Networks9 Feb 2026
- 2025Supervised Learning of Random Neural Architectures Structured by Latent Random Fields on Compact Boundaryless Multiply-Connected Manifolds11 Dec 2025
- 2025CLAPS: Aleatoric-Epistemic Scaling via Last-Layer Laplace for Conformal Regression1 Dec 2025
- 2025QiVC-Net: Quantum-Inspired Variational Convolutional Network, with Application to Biosignal Classification7 Nov 2025
- 2025Bayesian Neural Networks vs. Mixture Density Networks: Theoretical and Empirical Insights for Uncertainty-Aware Nonlinear Modeling28 Oct 2025
- 2025Uncertainty-Aware Deep Learning for Wildfire Danger Forecasting29 Sep 2025
- 2025The Sensitivity of Variational Bayesian Neural Network Performance to Hyperparameters24 Sep 2025
- 2025Post-Hoc Split-Point Self-Consistency Verification for Efficient, Unified Quantification of Aleatoric and Epistemic Uncertainty in Deep Learning16 Sep 2025
- 2025Two Birds with One Stone: Enhancing Uncertainty Quantification and Interpretability with Graph Functional Neural Process23 Aug 2025
38 more
- 2025Uncertainty-Aware Segmentation Quality Prediction via Deep Learning Bayesian Modeling: Comprehensive Evaluation and Interpretation on Skin Cancer and Liver Segmentation2 Aug 2025
- 2025Accelerating Hamiltonian Monte Carlo for Bayesian Inference in Neural Networks and Neural Operators19 Jul 2025
- 2025A Novel Active Learning Approach to Label One Million Unknown Malware Variants30 Jun 2025
- 2025Learning Adapter Rank via Symmetry Breaking28 Jun 2025
- 2025Promoting Ensemble Diversity with Interactive Bayesian Distributional Robustness for Fine-tuning Foundation Models8 Jun 2025
- 2025Enhancing Uncertainty Estimation and Interpretability via Bayesian Non-negative Decision Layer28 May 2025
- 2025Last Layer Empirical Bayes21 May 2025
- 2025SurvUnc: A Meta-Model Based Uncertainty Quantification Framework for Survival Analysis20 May 2025
- 2025Automated Real-time Assessment of Intracranial Hemorrhage Detection AI Using an Ensembled Monitoring Model (EMM)16 May 2025
- 2025Comparing Uncertainty Measurement and Mitigation Methods for Large Language Models: A Systematic Review25 Apr 2025
- 2025Explainable Bayesian deep learning through input-skip Latent Binary Bayesian Neural Networks13 Mar 2025
- 2025One-Shot Federated Unsupervised Domain Adaptation with Scaled Entropy Attention and Multi-Source Smoothed Pseudo Labeling13 Mar 2025
- 2025Bayesian Computation in Deep Learning25 Feb 2025
- 2025BARNN: A Bayesian Autoregressive and Recurrent Neural Network30 Jan 2025
- 2024How to Re-enable PDE Loss for Physical Systems Modeling Under Partial Observation12 Dec 2024
- 2024Calibrated and Efficient Sampling-Free Confidence Estimation for LiDAR Scene Semantic Segmentation18 Nov 2024
- 2024EigenVI: score-based variational inference with orthogonal function expansions31 Oct 2024
- 2024Improving Generalization with Flat Hilbert Bayesian Inference5 Oct 2024
- 2024Uncertainty Quantification with Bayesian Higher Order ReLU KANs2 Oct 2024
- 2024Deep Bayesian segmentation for colon polyps: Well-calibrated predictions in medical imaging23 Jul 2024
- 2024Unmasking Social Bots: How Confident Are We?18 Jul 2024
- 2024Inflationary Flows: Calibrated Bayesian Inference with Diffusion-Based Models11 Jul 2024
- 2024Improving robustness to corruptions with multiplicative weight perturbations24 Jun 2024
- 2024Bayesian neural networks for predicting uncertainty in full-field material response21 Jun 2024
- 2024Injective flows for star-like manifolds13 Jun 2024
- 2024Central Limit Theorem for Bayesian Neural Network trained with Variational Inference10 Jun 2024
- 2024Looks Too Good To Be True: An Information-Theoretic Analysis of Hallucinations in Generative Restoration Models26 May 2024
- 2024Embedding Trajectory for Out-of-Distribution Detection in Mathematical Reasoning22 May 2024
- 2024Physics-integrated generative modeling using attentive planar normalizing flow based variational autoencoder18 Apr 2024
- 2024Epistemic Uncertainty Quantification For Pre-trained Neural Network15 Apr 2024
- 2024Variational Bayesian Optimal Experimental Design with Normalizing Flows8 Apr 2024
- 2024Uncertainty-Based Extensible Codebook for Discrete Federated Learning in Heterogeneous Data Silos29 Feb 2024
- 2024Masked Gamma-SSL: Learning Uncertainty Estimation via Masked Image Modeling27 Feb 2024
- 2024HyperFast: Instant Classification for Tabular Data22 Feb 2024
- 2024Scalable and reliable deep transfer learning for intelligent fault detection via multi-scale neural processes embedded with knowledge20 Feb 2024
- 2024Variational Continual Test-Time Adaptation13 Feb 2024
- 2024Diffusive Gibbs Sampling5 Feb 2024
- 2024Monotone, Bi-Lipschitz, and Polyak-Lojasiewicz Networks2 Feb 2024
50 newest of 157 All 157 (JSON)
- 2021A Survey of Uncertainty in Deep Neural Networkscited by 680
- 2021What Are Bayesian Neural Network Posteriors Really Like?cited by 308
- 2021Bayesian Neural Network Priors Revisitedcited by 121
- 2021Epistemic Neural Networkscited by 120
- 2021Priors in Bayesian Deep Learning: A Reviewcited by 101
- 2023A Survey on Uncertainty Quantification Methods for Deep Learningcited by 81
- 2021Paragraph-level Rationale Extraction through Regularization: A case study on European Court of Human Rights Casescited by 77
- 2022ViewFool: Evaluating the Robustness of Visual Recognition to Adversarial Viewpointscited by 48
- 2021Posterior Meta-Replay for Continual Learningcited by 45
- 2021LiBRe: A Practical Bayesian Approach to Adversarial Detectioncited by 40
- 2021Infinitely Deep Bayesian Neural Networks with Stochastic Differential Equationscited by 38
- 2021Is MC Dropout Bayesian?cited by 35
12 most cited of 154 All 154 (JSON)
- 2026Optimal Transport Dropout for Structured Predictive Uncertainty27 Sep 2026
- 2026Do Deep Ensembles Actually Capture Uncertainty in Graph Neural Networks?21 May 2026
- 2026Hyper-V2X: Hypernetworks for Estimating Epistemic and Aleatoric Uncertainty in Cooperative Bird's-Eye-View Semantic Segmentation20 May 2026
- 2026Amortising Inference and Meta-Learning Priors in Neural Networks9 Feb 2026
- 2025Supervised Learning of Random Neural Architectures Structured by Latent Random Fields on Compact Boundaryless Multiply-Connected Manifolds11 Dec 2025
- 2025CLAPS: Aleatoric-Epistemic Scaling via Last-Layer Laplace for Conformal Regression1 Dec 2025
- 2025QiVC-Net: Quantum-Inspired Variational Convolutional Network, with Application to Biosignal Classification7 Nov 2025
- 2025Bayesian Neural Networks vs. Mixture Density Networks: Theoretical and Empirical Insights for Uncertainty-Aware Nonlinear Modeling28 Oct 2025
- 2025Uncertainty-Aware Deep Learning for Wildfire Danger Forecasting29 Sep 2025
- 2025The Sensitivity of Variational Bayesian Neural Network Performance to Hyperparameters24 Sep 2025
- 2025Two Birds with One Stone: Enhancing Uncertainty Quantification and Interpretability with Graph Functional Neural Process23 Aug 2025
- 2025Uncertainty-Aware Segmentation Quality Prediction via Deep Learning Bayesian Modeling: Comprehensive Evaluation and Interpretation on Skin Cancer and Liver Segmentation2 Aug 2025
12 newest of 154 All 154 (JSON)