mlsanityData to 7 Oct 2026

Analytic Convolutional Layer: A Step to Analytic Neural Network

arXiv 2407.06087 ↗First posted 3 Jul 2024cs.LG cs.CVcited by 0

Not on the map. Why?

Abstract (arXiv)

The prevailing approach to embedding prior knowledge within convolutional layers typically includes the design of steerable kernels or their modulation using designated kernel banks. In this study, we introduce the Analytic Convolutional Layer (ACL), an innovative model-driven convolutional layer, which is a mosaic of analytical convolution kernels (ACKs) and traditional convolution kernels. ACKs are characterized by mathematical functions governed by analytic kernel parameters (AKPs) learned in training process. Learnable AKPs permit the adaptive update of incorporated knowledge to align with the features representation of data. Our extensive experiments demonstrate that the ACLs not only have a remarkable capacity for feature representation with a reduced number of parameters but also attain increased reliability through the analytical formulation of ACKs. Furthermore, ACLs offer a means for neural network interpretation, thereby paving the way for the intrinsic interpretability of neural network. The source code will be published in company with the paper.

Key facts. No citing papers in the map yet (data through 7 Oct 2026). Builds on 17 of its 35 references that are in the map. First posted on arXiv 3 Jul 2024.

Builds on

17 of 35 references.

References · 17

  1. 2015Deep Residual Learning for Image Recognitioncited by 51,809
  2. 2019PyTorch: An Imperative Style, High-Performance Deep Learning Librarycited by 20,160
  3. 2014Very Deep Convolutional Networks for Large-Scale Image Recognitioncited by 15,267
  4. 2023Llama 2: Open Foundation and Fine-Tuned Chat Modelscited by 12,865
  5. 2016Densely Connected Convolutional Networkscited by 6,691
  6. 2019EfficientNet: Rethinking Model Scaling for Convolutional Neural Networkscited by 6,415
  7. 2014Going Deeper with Convolutionscited by 4,231
  8. 2017MobileNets: Efficient Convolutional Neural Networks for Mobile Vision Applicationscited by 3,827
  9. 2017Deformable Convolutional Networkscited by 1,481
  10. 2018ShuffleNet V2: Practical Guidelines for Efficient CNN Architecture Designcited by 1,132
  11. 2021EfficientNetV2: Smaller Models and Faster Trainingcited by 1,127
  12. 2020Designing Network Design Spacescited by 954
5 more
  1. 2021When Vision Transformers Outperform ResNets without Pre-training or Strong Data Augmentationscited by 259
  2. 2016Understanding and Improving Convolutional Neural Networks via Concatenated Rectified Linear Unitscited by 86
  3. 2017Oriented Response Networkscited by 67
  4. 2017Gabor Convolutional Networkscited by 55
  5. 2017Gabor Filter Assisted Energy Efficient Fast Learning Convolutional Neural Networkscited by 8

Built on by

Not cited yet.