Importance Sampling CAMs for Weakly-Supervised Segmentation
Not on the map. Why?
Abstract (arXiv)
Classification networks can be used to localize and segment objects in images by means of class activation maps (CAMs). However, without pixel-level annotations, classification networks are known to (1) mainly focus on discriminative regions, and (2) to produce diffuse CAMs without well-defined prediction contours. In this work, we approach both problems with two contributions for improving CAM learning. First, we incorporate importance sampling based on the class-wise probability mass function induced by the CAMs to produce stochastic image-level class predictions. This results in CAMs which activate over a larger extent of objects. Second, we formulate a feature similarity loss term which aims to match the prediction contours with edges in the image. As a third contribution, we conduct experiments on the PASCAL VOC 2012 benchmark dataset to demonstrate that these modifications significantly increase the performance in terms of contour accuracy, while being comparable to current state-of-the-art methods in terms of region similarity.
Key facts. Cited by 3 papers in the map (data through 7 Oct 2026). Builds on 40 of its 63 references that are in the map. First posted on arXiv 23 Mar 2022.
Builds on
40 of 63 references.
References · 40
- 2015Deep Residual Learning for Image Recognitioncited by 51,809
- 2014Very Deep Convolutional Networks for Large-Scale Image Recognitioncited by 15,267
- 2015Distilling the Knowledge in a Neural Networkcited by 10,076
- 2016Grad-CAM: Visual Explanations from Deep Networks via Gradient-based Localizationcited by 6,690
- 2016The Cityscapes Dataset for Semantic Urban Scene Understandingcited by 4,427
- 2015Learning Deep Features for Discriminative Localizationcited by 2,430
- 2020Image Segmentation Using Deep Learning: A Surveycited by 659
- 2014Semantic Image Segmentation with Deep Convolutional Nets and Fully Connected CRFscited by 552
- 2019Res2Net: A New Multi-scale Backbone Architecturecited by 468
- 2016ScribbleSup: Scribble-Supervised Convolutional Networks for Semantic Segmentationcited by 330
- 2018Learning Pixel-level Semantic Affinity with Image-level Supervision for Weakly Supervised Semantic Segmentationcited by 321
- 2020Self-supervised Equivariant Attention Mechanism for Weakly Supervised Semantic Segmentationcited by 299
28 more
- 2015What's the Point: Semantic Segmentation with Point Supervisioncited by 297
- 2020Towards Understanding Ensemble, Knowledge Distillation and Self-Distillation in Deep Learningcited by 292
- 2019Weakly Supervised Learning of Instance Segmentation with Inter-pixel Relationscited by 245
- 2015BoxSup: Exploiting Bounding Boxes to Supervise Convolutional Networks for Semantic Segmentationcited by 238
- 2020Causal Intervention for Weakly-Supervised Semantic Segmentationcited by 229
- 2016Simple Does It: Weakly Supervised Instance and Semantic Segmentationcited by 226
- 2016Seed, Expand and Constrain: Three Principles for Weakly-Supervised Image Segmentationcited by 198
- 2015Weakly- and Semi-Supervised Learning of a DCNN for Semantic Image Segmentationcited by 189
- 2016Wider or Deeper: Revisiting the ResNet Model for Visual Recognitioncited by 184
- 2019FickleNet: Weakly and Semi-supervised Semantic Image Segmentation using Stochastic Inferencecited by 162
- 2018Revisiting Dilated Convolution: A Simple Approach for Weakly- and Semi- Supervised Semantic Segmentationcited by 145
- 2020Mining Cross-Image Semantics for Weakly Supervised Semantic Segmentationcited by 144
- 2022Multi-class Token Transformer for Weakly Supervised Semantic Segmentationcited by 138
- 2022Learning Affinity from Attention: End-to-End Weakly-Supervised Semantic Segmentation with Transformerscited by 118
- 2018Learning random-walk label propagation for weakly-supervised semantic segmentationcited by 101
- 2015Constrained Convolutional Neural Networks for Weakly Supervised Segmentationcited by 100
- 2018Self-Erasing Network for Integral Object Attentioncited by 95
- 2022Self-supervised Image-specific Prototype Exploration for Weakly Supervised Semantic Segmentationcited by 87
- 2021Weakly Supervised Semantic Segmentation by Pixel-to-Prototype Contrastcited by 85
- 2018Weakly-Supervised Semantic Segmentation by Iteratively Mining Common Object Featurescited by 81
- 2018CIAN: Cross-Image Affinity Net for Weakly Supervised Semantic Segmentationcited by 80
- 2015STC: A Simple to Complex Framework for Weakly-supervised Semantic Segmentationcited by 78
- 2021Complementary Patch for Weakly Supervised Semantic Segmentationcited by 75
- 2022Class Re-Activation Maps for Weakly-Supervised Semantic Segmentationcited by 75
- 2021Context Decoupling Augmentation for Weakly Supervised Semantic Segmentationcited by 69
- 2021Reducing Information Bottleneck for Weakly Supervised Semantic Segmentationcited by 65
- 2019Self-Supervised Difference Detection for Weakly-Supervised Semantic Segmentationcited by 58
- 2021Pseudo-mask Matters in Weakly-supervised Semantic Segmentationcited by 48
Built on by
Citing papers per year: 2023: 2; 2024: 0; 2025: 1.
3 papers.