TyXe: Pyro-based Bayesian neural nets for Pytorch
Not on the map. Why?
Abstract (arXiv)
We introduce TyXe, a Bayesian neural network library built on top of Pytorch and Pyro. Our leading design principle is to cleanly separate architecture, prior, inference and likelihood specification, allowing for a flexible workflow where users can quickly iterate over combinations of these components. In contrast to existing packages TyXe does not implement any layer classes, and instead relies on architectures defined in generic Pytorch code. TyXe then provides modular choices for canonical priors, variational guides, inference techniques, and layer selections for a Bayesian treatment of the specified architecture. Sampling tricks for variance reduction, such as local reparameterization or flipout, are implemented as effect handlers, which can be applied independently of other specifications. We showcase the ease of use of TyXe to explore Bayesian versions of popular models from various libraries: toy regression with a pure Pytorch neural network; large-scale image classification with torchvision ResNets; graph neural networks based on DGL; and Neural Radiance Fields built on top of Pytorch3D. Finally, we provide convenient abstractions for variational continual learning. In all cases the change from a deterministic to a Bayesian neural network comes with minimal modifications to existing code, offering a broad range of researchers and practitioners alike practical access to uncertainty estimation techniques. The library is available at https://github.com/TyXe-BDL/TyXe.
Key facts. Cited by 6 papers in the map (data through 7 Oct 2026). Builds on 26 of its 53 references that are in the map. First posted on arXiv 1 Oct 2021.
Builds on
26 of 53 references.
References · 26
- 2015Deep Residual Learning for Image Recognitioncited by 51,809
- 2019PyTorch: An Imperative Style, High-Performance Deep Learning Librarycited by 20,160
- 2015Dropout as a Bayesian Approximation: Representing Model Uncertainty in Deep Learningcited by 4,416
- 2015Delving Deep into Rectifiers: Surpassing Human-Level Performance on ImageNet Classificationcited by 3,590
- 2015Variational Dropout and the Local Reparameterization Trickcited by 489
- 2018Pyro: Deep Universal Probabilistic Programmingcited by 379
- 2017Variational Continual Learningcited by 335
- 2013Black Box Variational Inferencecited by 317
- 2015Probabilistic Backpropagation for Scalable Learning of Bayesian Neural Networkscited by 295
- 2017Multiplicative Normalizing Flows for Variational Bayesian Neural Networkscited by 157
- 2018Flipout: Efficient Pseudo-Independent Weight Perturbations on Mini-Batchescited by 133
- 2018Bayesian graph convolutional neural networks for semi-supervised classificationcited by 88
14 more
- 2016Structured and Efficient Variational Deep Learning with Matrix Gaussian Posteriorscited by 82
- 2020Bayesian Graph Neural Networks with Adaptive Connection Samplingcited by 81
- 2018Bayesian Layers: A Module for Neural Network Uncertaintycited by 57
- 2013Automated Variational Inference in Probabilistic Programmingcited by 31
- 2017Learning Discrete Weights Using the Local Reparameterization Trickcited by 29
- 2021Uncertainty Quantification 360: A Holistic Toolkit for Quantifying and Communicating the Uncertainty of AIcited by 22
- 2018Overpruning in Variational Bayesian Neural Networkscited by 21
- 2021BNNpriors: A library for Bayesian neural network inference with different prior distributionscited by 20
- 2018Simple, Distributed, and Accelerated Probabilistic Programmingcited by 18
- 2021Sparse Uncertainty Representation in Deep Learning with Inducing Weightscited by 16
- 2019Improving and Understanding Variational Continual Learningcited by 12
- 2019Learning from the Past: Continual Meta-Learning via Bayesian Graph Modelingcited by 9
- 2020Bayesian Graph Neural Networks for Molecular Property Predictioncited by 8
- 2018Probabilistic Meta-Representations Of Neural Networkscited by 7
Built on by
Citing papers per year: 2022: 2; 2023: 2; 2024: 1; 2025: 0; 2026: 1.
6 papers.
- 2024Position: Bayesian Deep Learning is Needed in the Age of Large-Scale AIcited by 60
- 2023Fortuna: A Library for Uncertainty Quantification in Deep Learningcited by 14
- 2023A Benchmark on Uncertainty Quantification for Deep Learning Prognosticscited by 9
- 2022Black-box Coreset Variational Inferencecited by 4
- 2022Density Regression and Uncertainty Quantification with Bayesian Deep Noise Neural Networkscited by 1
- 2026Neetyabhas: A Framework for Uncertainty-Aware Public Policy Optimization in Rational Agent-Based Modelscited by 0
- 2026Neetyabhas: A Framework for Uncertainty-Aware Public Policy Optimization in Rational Agent-Based Models3 Jun 2026
- 2024Position: Bayesian Deep Learning is Needed in the Age of Large-Scale AI1 Feb 2024
- 2023A Benchmark on Uncertainty Quantification for Deep Learning Prognostics9 Feb 2023
- 2023Fortuna: A Library for Uncertainty Quantification in Deep Learning8 Feb 2023
- 2022Black-box Coreset Variational Inference4 Nov 2022
- 2022Density Regression and Uncertainty Quantification with Bayesian Deep Noise Neural Networks12 Jun 2022