mlsanityData to 14 Oct 2026

Free energy of Bayesian Convolutional Neural Network with Skip Connection

arXiv 2307.01417 ↗First posted 4 Jul 2023cs.LG stat.MLcited by 4

Not on the map. Why?

Abstract (arXiv)

Since the success of Residual Network(ResNet), many of architectures of Convolutional Neural Networks(CNNs) have adopted skip connection. While the generalization performance of CNN with skip connection has been explained within the framework of Ensemble Learning, the dependency on the number of parameters have not been revealed. In this paper, we show that Bayesian free energy of Convolutional Neural Network both with and without skip connection in Bayesian learning. The upper bound of free energy of Bayesian CNN with skip connection does not depend on the oveparametrization and, the generalization error of Bayesian CNN has similar property.

Key facts. Cited by 4 papers in the map (data through 14 Oct 2026). Builds on 10 of its 29 references that are in the map. First posted on arXiv 4 Jul 2023.

Builds on

10 of 29 references.

References · 10

  1. 2015Deep Residual Learning for Image Recognitioncited by 52,096
  2. 2015Dropout as a Bayesian Approximation: Representing Model Uncertainty in Deep Learningcited by 4,448
  3. 2014Going Deeper with Convolutionscited by 4,241
  4. 2021Ensemble deep learning: A reviewcited by 284
  5. 2015Bayesian Convolutional Neural Networks with Bernoulli Approximate Variational Inferencecited by 159
  6. 2018Bayesian graph convolutional neural networks for semi-supervised classificationcited by 89
  7. 2020Deep Learning is Singular, and That's Goodcited by 49
  8. 2017Learning Deep ResNet Blocks Sequentially using Boosting Theorycited by 32
  9. 2020The Exact Asymptotic Form of Bayesian Generalization Error in Latent Dirichlet Allocationcited by 14
  10. 2023Bayesian Free Energy of Deep ReLU Neural Network in Overparametrized Casescited by 5

Built on by

Cited by year

Citing papers per year: 2024: 3; 2025: 1.

4 papers.

  1. 2024Review and Prospect of Algebraic Research in Equivalent Framework between Statistical Mechanics and Machine Learning Theorycited by 2
  2. 2024Upper Bound of Bayesian Generalization Error in Partial Concept Bottleneck Model (CBM): Partial CBM outperforms naive CBMcited by 1
  3. 2024Statistical inference for quantum singular modelscited by 0
  4. 2025ZClassifier: Temperature Tuning and Manifold Approximation via KL Divergence on Logit Spacecited by 0