mlsanityData to 14 Oct 2026

CAM Back Again: Large Kernel CNNs from a Weakly Supervised Object Localization Perspective

arXiv 2403.06676 ↗First posted 11 Mar 2024cs.CVcited by 2

Not on the map. Why?

Abstract (arXiv)

Recently, convolutional neural networks (CNNs) with large size kernels have attracted much attention in the computer vision field, following the success of the Vision Transformers. Large kernel CNNs have been reported to perform well in downstream vision tasks as well as in classification performance. The reason for the high-performance of large kernel CNNs in downstream tasks has been attributed to the large effective receptive field (ERF) produced by large size kernels, but this view has not been fully tested. We therefore revisit the performance of large kernel CNNs in downstream task, focusing on the weakly supervised object localization (WSOL) task. WSOL, a difficult downstream task that is not fully supervised, provides a new angle to explore the capabilities of the large kernel CNNs. Our study compares the modern large kernel CNNs ConvNeXt, RepLKNet, and SLaK to test the validity of the naive expectation that ERF size is important for improving downstream task performance. Our analysis of the factors contributing to high performance provides a different perspective, in which the main factor is feature map improvement. Furthermore, we find that modern CNNs are robust to the CAM problems of local regions of objects being activated, which has long been discussed in WSOL. CAM is the most classic WSOL method, but because of the above-mentioned problems, it is often used as a baseline method for comparison. However, experiments on the CUB-200-2011 dataset show that simply combining a large kernel CNN, CAM, and simple data augmentation methods can achieve performance (90.99% MaxBoxAcc) comparable to the latest WSOL method, which is CNN-based and requires special training or complex post-processing. The code is available at https://github.com/snskysk/CAM-Back-Again.

Key facts. Cited by 2 papers in the map (data through 14 Oct 2026). Builds on 38 of its 52 references that are in the map. First posted on arXiv 11 Mar 2024.

Builds on

38 of 52 references.

References · 38

  1. 2015Deep Residual Learning for Image Recognitioncited by 52,096
  2. 2020An Image is Worth 16x16 Words: Transformers for Image Recognition at Scalecited by 30,186
  3. 2021Swin Transformer: Hierarchical Vision Transformer using Shifted Windowscited by 12,139
  4. 2016Grad-CAM: Visual Explanations from Deep Networks via Gradient-based Localizationcited by 6,733
  5. 2017mixup: Beyond Empirical Risk Minimizationcited by 5,183
  6. 2022A ConvNet for the 2020scited by 3,579
  7. 2016DeepLab: Semantic Image Segmentation with Deep Convolutional Nets, Atrous Convolution, and Fully Connected CRFscited by 3,241
  8. 2018Encoder-Decoder with Atrous Separable Convolution for Semantic Image Segmentationcited by 3,223
  9. 2019CutMix: Regularization Strategy to Train Strong Classifiers with Localizable Featurescited by 2,884
  10. 2015Learning Deep Features for Discriminative Localizationcited by 2,436
  11. 2019RandAugment: Practical automated data augmentation with a reduced search spacecited by 2,269
  12. 2017Decoupled Weight Decay Regularizationcited by 1,831
26 more
  1. 2020Rethinking Semantic Segmentation from a Sequence-to-Sequence Perspective with Transformerscited by 1,369
  2. 2017Random Erasing Data Augmentationcited by 1,239
  3. 2016Deep Networks with Stochastic Depthcited by 979
  4. 2017Grad-CAM++: Improved Visual Explanations for Deep Convolutional Networkscited by 939
  5. 2017Understanding the Effective Receptive Field in Deep Convolutional Neural Networkscited by 553
  6. 2017Dilated Residual Networkscited by 294
  7. 2017Large Kernel Matters -- Improve Semantic Segmentation by Global Convolutional Networkcited by 208
  8. 2017Hide-and-Seek: Forcing a Network to be Meticulous for Weakly-supervised Object and Action Localizationcited by 207
  9. 2017Object Region Mining with Adversarial Erasing: A Simple Classification to Semantic Segmentation Approachcited by 201
  10. 2018Adversarial Complementary Learning for Weakly Supervised Object Localizationcited by 166
  11. 2022Scaling Up Your Kernels to 31x31: Revisiting Large Kernel Design in CNNscited by 155
  12. 2022More ConvNets in the 2020s: Scaling up Kernels Beyond 51x51 using Sparsitycited by 142
  13. 2021TS-CAM: Token Semantic Coupled Attention Map for Weakly Supervised Object Localizationcited by 123
  14. 2021Are Convolutional Neural Networks or Transformers more like human vision?cited by 109
  15. 2020Evaluating Weakly Supervised Object Localization Methods Rightcited by 105
  16. 2022HorNet: Efficient High-Order Spatial Interactions with Recursive Gated Convolutionscited by 103
  17. 2021Involution: Inverting the Inherence of Convolution for Visual Recognitioncited by 99
  18. 2018Self-produced Guidance for Weakly-supervised Object Localizationcited by 72
  19. 2020Inter-Image Communication for Weakly Supervised Localizationcited by 52
  20. 2021Shallow Feature Matters for Weakly Supervised Object Localizationcited by 34
  21. 2021F-CAM: Full Resolution Class Activation Maps via Guided Parametric Upscalingcited by 26
  22. 2022Bridging the Gap between Classification and Localization for Weakly Supervised Object Localizationcited by 25
  23. 2021LCTR: On Awakening the Local Continuity of Transformer for Weakly Supervised Object Localizationcited by 24
  24. 2022CREAM: Weakly Supervised Object Localization via Class RE-Activation Mappingcited by 21
  25. 2022Weakly Supervised Object Localization via Transformer with Implicit Spatial Calibrationcited by 20
  26. 2022Discriminative Sampling of Proposals in Self-Supervised Transformers for Weakly Supervised Object Localizationcited by 13

Built on by

Cited by year

Citing papers per year: 2025: 2.

2 papers.