mlsanityData to 7 Oct 2026

Regional Semantic Contrast and Aggregation for Weakly Supervised Semantic Segmentation

arXiv 2203.09653 ↗First posted 17 Mar 2022cs.CVcited by 64

Not on the map. Why?

Abstract (arXiv)

Learning semantic segmentation from weakly-labeled (e.g., image tags only) data is challenging since it is hard to infer dense object regions from sparse semantic tags. Despite being broadly studied, most current efforts directly learn from limited semantic annotations carried by individual image or image pairs, and struggle to obtain integral localization maps. Our work alleviates this from a novel perspective, by exploring rich semantic contexts synergistically among abundant weakly-labeled training data for network learning and inference. In particular, we propose regional semantic contrast and aggregation (RCA) . RCA is equipped with a regional memory bank to store massive, diverse object patterns appearing in training data, which acts as strong support for exploration of dataset-level semantic structure. Particularly, we propose i) semantic contrast to drive network learning by contrasting massive categorical object regions, leading to a more holistic object pattern understanding, and ii) semantic aggregation to gather diverse relational contexts in the memory to enrich semantic representations. In this manner, RCA earns a strong capability of fine-grained semantic understanding, and eventually establishes new state-of-the-art results on two popular benchmarks, i.e., PASCAL VOC 2012 and COCO 2014.

Key facts. Cited by 64 papers in the map (data through 7 Oct 2026). Builds on 71 of its 87 references that are in the map. First posted on arXiv 17 Mar 2022.

Builds on

71 of 87 references.

References · 71

  1. 2015Deep Residual Learning for Image Recognitioncited by 51,809
  2. 2014Microsoft COCO: Common Objects in Contextcited by 17,498
  3. 2014Very Deep Convolutional Networks for Large-Scale Image Recognitioncited by 15,267
  4. 2020A Simple Framework for Contrastive Learning of Visual Representationscited by 11,979
  5. 2018Representation Learning with Contrastive Predictive Codingcited by 7,662
  6. 2019Momentum Contrast for Unsupervised Visual Representation Learningcited by 7,482
  7. 2017mixup: Beyond Empirical Risk Minimizationcited by 5,155
  8. 2020Bootstrap your own latent: A new approach to self-supervised Learningcited by 4,712
  9. 2016DeepLab: Semantic Image Segmentation with Deep Convolutional Nets, Atrous Convolution, and Fully Connected CRFscited by 3,239
  10. 2020Exploring Simple Siamese Representation Learningcited by 2,853
  11. 2020Supervised Contrastive Learningcited by 2,803
  12. 2015Learning Deep Features for Discriminative Localizationcited by 2,430
38 more
  1. 2018Unsupervised Feature Learning via Non-Parametric Instance-level Discriminationcited by 1,838
  2. 2019Contrastive Multiview Codingcited by 1,297
  3. 2018Deep Clustering for Unsupervised Learning of Visual Featurescited by 1,020
  4. 2018Dual Attention Network for Scene Segmentationcited by 1,001
  5. 2019Self-Supervised Learning of Pretext-Invariant Representationscited by 806
  6. 2019Segmentation Transformer: Object-Contextual Representations for Semantic Segmentationcited by 573
  7. 2020Dense Contrastive Learning for Self-Supervised Visual Pre-Trainingcited by 512
  8. 2016ScribbleSup: Scribble-Supervised Convolutional Networks for Semantic Segmentationcited by 330
  9. 2018Learning Pixel-level Semantic Affinity with Image-level Supervision for Weakly Supervised Semantic Segmentationcited by 321
  10. 2020Contrastive learning of global and local features for medical image segmentation with limited annotationscited by 309
  11. 2020Self-supervised Equivariant Attention Mechanism for Weakly Supervised Semantic Segmentationcited by 299
  12. 2015What's the Point: Semantic Segmentation with Point Supervisioncited by 297
  13. 2020Propagate Yourself: Exploring Pixel-Level Consistency for Unsupervised Visual Representation Learningcited by 297
  14. 2018Context Encoding for Semantic Segmentationcited by 289
  15. 2019Weakly Supervised Learning of Instance Segmentation with Inter-pixel Relationscited by 245
  16. 2021Exploring Cross-Image Pixel Contrast for Semantic Segmentationcited by 242
  17. 2015BoxSup: Exploiting Bounding Boxes to Supervise Convolutional Networks for Semantic Segmentationcited by 238
  18. 2020Causal Intervention for Weakly-Supervised Semantic Segmentationcited by 229
  19. 2016Simple Does It: Weakly Supervised Instance and Semantic Segmentationcited by 226
  20. 2019A Simple Pooling-Based Design for Real-Time Salient Object Detectioncited by 211
  21. 2017Hide-and-Seek: Forcing a Network to be Meticulous for Weakly-supervised Object and Action Localizationcited by 207
  22. 2017Object Region Mining with Adversarial Erasing: A Simple Classification to Semantic Segmentation Approachcited by 201
  23. 2016Seed, Expand and Constrain: Three Principles for Weakly-Supervised Image Segmentationcited by 198
  24. 2016Joint Detection and Identification Feature Learning for Person Searchcited by 190
  25. 2018Tell Me Where to Look: Guided Attention Inference Networkcited by 168
  26. 2020Single-Stage Semantic Segmentation from Image Labelscited by 167
  27. 2018Adversarial Complementary Learning for Weakly Supervised Object Localizationcited by 166
  28. 2019FickleNet: Weakly and Semi-supervised Semantic Image Segmentation using Stochastic Inferencecited by 162
  29. 2018Revisiting Dilated Convolution: A Simple Approach for Weakly- and Semi- Supervised Semantic Segmentationcited by 145
  30. 2020Weakly-Supervised Semantic Segmentation via Sub-category Explorationcited by 145
  31. 2020Mining Cross-Image Semantics for Weakly Supervised Semantic Segmentationcited by 144
  32. 2018A2-Nets: Double Attention Networkscited by 136
  33. 2021A Survey on Deep Learning Technique for Video Segmentationcited by 132
  34. 2019Cross-Batch Memory for Embedding Learningcited by 130
  35. 2021Railroad is not a Train: Saliency as Pseudo-pixel Supervision for Weakly Supervised Semantic Segmentationcited by 127
  36. 2021BBAM: Bounding Box Attribution Map for Weakly Supervised Semantic and Instance Segmentationcited by 104
  37. 2018Learning random-walk label propagation for weakly-supervised semantic segmentationcited by 101
  38. 2019Box-driven Class-wise Region Masking and Filling Rate Guided Loss for Weakly Supervised Semantic Segmentationcited by 97

50 most cited of 71 All 71 (JSON)

Built on by

Cited by year (2026 to 7 Oct)

Citing papers per year: 2022: 10; 2023: 25; 2024: 20; 2025: 7; 2026: 2.

64 papers.

Sort:

By area:

  1. 2022CLIP is Also an Efficient Segmenter: A Text-Driven Approach for Weakly Supervised Semantic Segmentationcited by 118
  2. 2023Token Contrast for Weakly-Supervised Semantic Segmentationcited by 64
  3. 2023LOCATE: Localize and Transfer Object Parts for Weakly Supervised Affordance Groundingcited by 64
  4. 2023Segment Anything Model (SAM) Enhanced Pseudo Labels for Weakly Supervised Semantic Segmentationcited by 53
  5. 2022Tree Energy Loss: Towards Sparsely Annotated Semantic Segmentationcited by 47
  6. 2022A Survey on Label-efficient Deep Image Segmentation: Bridging the Gap between Weak Supervision and Dense Predictioncited by 46
  7. 2022Max Pooling with Vision Transformers reconciles class and shape in weakly supervised semantic segmentationcited by 41
  8. 2023Hierarchical Semantic Contrast for Scene-aware Video Anomaly Detectioncited by 39
  9. 2023Foundation Model Assisted Weakly Supervised Semantic Segmentationcited by 31
  10. 2023Extracting Class Activation Maps from Non-Discriminative Features as wellcited by 30
  11. 2022Out-of-Candidate Rectification for Weakly Supervised Semantic Segmentationcited by 26
  12. 2023MCTformer+: Multi-Class Token Transformer for Weakly Supervised Semantic Segmentationcited by 22
38 more
  1. 2023Weakly-Supervised Semantic Segmentation with Image-Level Labels: from Traditional Models to Foundation Modelscited by 19
  2. 2024Spatial Structure Constraints for Weakly Supervised Semantic Segmentationcited by 17
  3. 2024Hunting Attributes: Context Prototype-Aware Learning for Weakly Supervised Semantic Segmentationcited by 16
  4. 2022TransVCL: Attention-enhanced Video Copy Localization Network with Flexible Supervisioncited by 15
  5. 2023Emergent Open-Vocabulary Semantic Segmentation from Off-the-shelf Vision-Language Modelscited by 15
  6. 2024Separate and Conquer: Decoupling Co-occurrence via Decomposition and Representation for Weakly Supervised Semantic Segmentationcited by 14
  7. 2024Frozen CLIP: A Strong Backbone for Weakly Supervised Semantic Segmentationcited by 14
  8. 2023MARS: Model-agnostic Biased Object Removal without Additional Supervision for Weakly-Supervised Semantic Segmentationcited by 13
  9. 2022Semi-Supervised Semantic Segmentation with Cross Teacher Trainingcited by 11
  10. 2023SIM: Semantic-aware Instance Mask Generation for Box-Supervised Instance Segmentationcited by 11
  11. 2024CPM: Class-conditional Prompting Machine for Audio-visual Segmentationcited by 11
  12. 2023Timestamp-supervised Wearable-based Activity Segmentation and Recognition with Contrastive Learning and Order-Preserving Optimal Transportcited by 10
  13. 2024Learning without Exact Guidance: Updating Large-scale High-resolution Land Cover Maps from Low-resolution Historical Labelscited by 8
  14. 2024Knowledge Transfer with Simulated Inter-Image Erasing for Weakly Supervised Semantic Segmentationcited by 8
  15. 2025WeakMedSAM: Weakly-Supervised Medical Image Segmentation via SAM with Sub-Class Exploration and Prompt Affinity Miningcited by 8
  16. 2025Exploring CLIP's Dense Knowledge for Weakly Supervised Semantic Segmentationcited by 8
  17. 2023Centered Self-Attention Layerscited by 7
  18. 2023MS-Former: Memory-Supported Transformer for Weakly Supervised Change Detection with Patch-Level Annotationscited by 6
  19. 2024Finding Meaning in Points: Weakly Supervised Semantic Segmentation for Event Camerascited by 6
  20. 2024Fine-grained Background Representation for Weakly Supervised Semantic Segmentationcited by 4
  21. 2024WPS-SAM: Towards Weakly-Supervised Part Segmentation with Foundation Modelscited by 4
  22. 2024DIAL: Dense Image-text ALignment for Weakly Supervised Semantic Segmentationcited by 4
  23. 2024Exact: Exploring Space-Time Perceptive Clues for Weakly Supervised Satellite Image Time Series Semantic Segmentationcited by 4
  24. 2023A Language-Guided Benchmark for Weakly Supervised Open Vocabulary Semantic Segmentationcited by 3
  25. 2023A Survey of Historical Learning: Learning Models with Learning Historycited by 3
  26. 2023Calibrating Undisciplined Over-Smoothing in Transformer for Weakly Supervised Semantic Segmentationcited by 3
  27. 2024Weakly Supervised Co-training with Swapping Assignments for Semantic Segmentationcited by 3
  28. 2024DHR: Dual Features-Driven Hierarchical Rebalancing in Inter- and Intra-Class Regions for Weakly-Supervised Semantic Segmentationcited by 3
  29. 2024Prototype Learning Guided Hybrid Network for Breast Tumor Segmentation in DCE-MRIcited by 3
  30. 2023Exploit CAM by itself: Complementary Learning System for Weakly Supervised Semantic Segmentationcited by 2
  31. 2023Boosting Weakly-Supervised Image Segmentation via Representation, Transform, and Compensatorcited by 2
  32. 2024Weakly-supervised Semantic Segmentation via Dual-stream Contrastive Learning of Cross-image Contextual Informationcited by 2
  33. 2024Pixel-Level Domain Adaptation: A New Perspective for Enhancing Weakly Supervised Semantic Segmentationcited by 2
  34. 2022RecurSeed and EdgePredictMix: Pseudo-Label Refinement Learning for Weakly Supervised Semantic Segmentation across Single- and Multi-Stage Frameworkscited by 1
  35. 2023ReFit: A Framework for Refinement of Weakly Supervised Semantic Segmentation using Object Border Fitting for Medical Imagescited by 1
  36. 2023The Effects of Mixed Sample Data Augmentation are Class Dependentcited by 1
  37. 2023Small Objects Matters in Weakly-supervised Semantic Segmentationcited by 1
  38. 2025SPARS: Self-Play Adversarial Reinforcement Learning for Segmentation of Liver Tumourscited by 1

50 most cited of 64 All 64 (JSON)