Bayesian Neural Networks: A Min-Max Game Framework
Not on the map. Why?
Abstract (arXiv)
In deep learning, Bayesian neural networks (BNN) provide the role of robustness analysis, and the minimax method is used to be a conservative choice in the traditional Bayesian field. In this paper, we study a conservative BNN with the minimax method and formulate a two-player game between a deterministic neural network f and a sampling stochastic neural network f + r*xi. From this perspective, we understand the closed-loop neural networks with the minimax loss and reveal their connection to the BNN. We test the models on simple data sets, study their robustness under noise perturbation, and report some issues for searching r.
Key facts. No citing papers in the map yet (data through 14 Oct 2026). Builds on 29 of its 47 references that are in the map. First posted on arXiv 18 Nov 2023.
Builds on
29 of 47 references.
References · 29
- 2019PyTorch: An Imperative Style, High-Performance Deep Learning Librarycited by 20,305
- 2015Batch Normalization: Accelerating Deep Network Training by Reducing Internal Covariate Shiftcited by 7,005
- 2015Dropout as a Bayesian Approximation: Representing Model Uncertainty in Deep Learningcited by 4,448
- 2017Fashion-MNIST: a Novel Image Dataset for Benchmarking Machine Learning Algorithmscited by 4,349
- 2013Auto-Encoding Variational Bayescited by 4,053
- 2022Emergent Abilities of Large Language Modelscited by 2,512
- 2016Identity Mappings in Deep Residual Networkscited by 1,965
- 2017Enhancing The Reliability of Out-of-distribution Image Detection in Neural Networkscited by 1,328
- 2018Learning deep representations by mutual information estimation and maximizationcited by 1,273
- 2017SmoothGrad: removing noise by adding noisecited by 1,109
- 2018An Empirical Study of Example Forgetting during Deep Neural Network Learningcited by 678
- 2017Generative Adversarial Networks: An Overviewcited by 590
17 more
- 2018Predictive Uncertainty Estimation via Prior Networkscited by 557
- 2020Hands-on Bayesian Neural Networks -- a Tutorial for Deep Learning Userscited by 338
- 2021What Are Bayesian Neural Network Posteriors Really Like?cited by 308
- 2021Deep Deterministic Uncertainty: A Simple Baselinecited by 200
- 2022Pangu-Weather: A 3D High-Resolution Model for Fast and Accurate Global Weather Forecastcited by 166
- 2016Improving the Robustness of Deep Neural Networks via Stability Trainingcited by 156
- 2020Learning Diverse and Discriminative Representations via the Principle of Maximal Coding Rate Reductioncited by 142
- 2019Functional Variational Bayesian Neural Networkscited by 127
- 2019Deep Learning for Hyperspectral Image Classification: An Overviewcited by 123
- 2019Training Robust Deep Neural Networks via Adversarial Noise Propagationcited by 62
- 2020Robustness of Bayesian Neural Networks to Gradient-Based Attackscited by 48
- 2020Analyzing the Noise Robustness of Deep Neural Networkscited by 31
- 2021PAC-Bayes Information Bottleneckcited by 28
- 2017Towards Proving the Adversarial Robustness of Deep Neural Networkscited by 26
- 2021Closed-Loop Data Transcription to an LDR via Minimaxing Rate Reductioncited by 17
- 2023Minimax-Bayes Reinforcement Learningcited by 6
- 2023Closed-Loop Transcription via Convolutional Sparse Codingcited by 4
Built on by
Not cited yet.