Seed, Expand and Constrain: Three Principles for Weakly-Supervised Image Segmentation
Not on the map. Why?
Abstract (arXiv)
We introduce a new loss function for the weakly-supervised training of semantic image segmentation models based on three guiding principles: to seed with weak localization cues, to expand objects based on the information about which classes can occur in an image, and to constrain the segmentations to coincide with object boundaries. We show experimentally that training a deep convolutional neural network using the proposed loss function leads to substantially better segmentations than previous state-of-the-art methods on the challenging PASCAL VOC 2012 dataset. We furthermore give insight into the working mechanism of our method by a detailed experimental study that illustrates how the segmentation quality is affected by each term of the proposed loss function as well as their combinations.
Key facts. Cited by 198 papers in the map (data through 7 Oct 2026). First posted on arXiv 19 Mar 2016.
Builds on
No reference list yet.
Built on by
Citing papers per year: 2021: 52; 2022: 55; 2023: 42; 2024: 31; 2025: 11; 2026: 7.
198 papers.
Sort:
By area:
- 2022DTFD-MIL: Double-Tier Feature Distillation Multiple Instance Learning for Histopathology Whole Slide Image Classificationcited by 254
- 2022Multi-class Token Transformer for Weakly Supervised Semantic Segmentationcited by 138
- 2021Anti-Adversarially Manipulated Attributions for Weakly and Semi-Supervised Semantic Segmentationcited by 134
- 2021Railroad is not a Train: Saliency as Pseudo-pixel Supervision for Weakly Supervised Semantic Segmentationcited by 127
- 2021TS-CAM: Token Semantic Coupled Attention Map for Weakly Supervised Object Localizationcited by 122
- 2022Learning Affinity from Attention: End-to-End Weakly-Supervised Semantic Segmentation with Transformerscited by 118
- 2021Large-scale Unsupervised Semantic Segmentationcited by 98
- 2021Non-Salient Region Object Mining for Weakly Supervised Semantic Segmentationcited by 95
- 2022Self-supervised Image-specific Prototype Exploration for Weakly Supervised Semantic Segmentationcited by 87
- 2021Weakly Supervised Semantic Segmentation by Pixel-to-Prototype Contrastcited by 85
- 2021Leveraging Auxiliary Tasks with Affinity Learning for Weakly Supervised Semantic Segmentationcited by 77
- 2021Complementary Patch for Weakly Supervised Semantic Segmentationcited by 75
38 more
- 2022Class Re-Activation Maps for Weakly-Supervised Semantic Segmentationcited by 75
- 2022Cross Language Image Matching for Weakly Supervised Semantic Segmentationcited by 72
- 2021Context Decoupling Augmentation for Weakly Supervised Semantic Segmentationcited by 69
- 2022Scribble-Supervised LiDAR Semantic Segmentationcited by 69
- 2021Reducing Information Bottleneck for Weakly Supervised Semantic Segmentationcited by 65
- 2022Regional Semantic Contrast and Aggregation for Weakly Supervised Semantic Segmentationcited by 64
- 2021Adaptive Early-Learning Correction for Segmentation from Noisy Annotationscited by 61
- 2022Weakly Supervised Semantic Segmentation using Out-of-Distribution Datacited by 58
- 2022L2G: A Simple Local-to-Global Knowledge Transfer Framework for Weakly Supervised Semantic Segmentationcited by 57
- 2022Unsupervised Semantic Segmentation with Self-supervised Object-centric Representationscited by 54
- 2023Segment Anything Model (SAM) Enhanced Pseudo Labels for Weakly Supervised Semantic Segmentationcited by 53
- 2021Pseudo-mask Matters in Weakly-supervised Semantic Segmentationcited by 48
- 2021ZeroWaste Dataset: Towards Deformable Object Segmentation in Cluttered Scenescited by 47
- 2021Unveiling the Potential of Structure Preserving for Weakly Supervised Object Localizationcited by 46
- 2022A Survey on Label-efficient Deep Image Segmentation: Bridging the Gap between Weak Supervision and Dense Predictioncited by 46
- 2021Universal Weakly Supervised Segmentation by Pixel-to-Segment Contrastive Learningcited by 43
- 2021Background-Aware Pooling and Noise-Aware Loss for Weakly-Supervised Semantic Segmentationcited by 41
- 2022Max Pooling with Vision Transformers reconciles class and shape in weakly supervised semantic segmentationcited by 41
- 2023CLIP in Medical Imaging: A Surveycited by 40
- 2021Incremental Learning in Semantic Segmentation from Image Labelscited by 39
- 2022Unsupervised Hierarchical Semantic Segmentation with Multiview Cosegmentation and Clustering Transformerscited by 39
- 2021Every Annotation Counts: Multi-label Deep Supervision for Medical Image Segmentationcited by 37
- 2022Threshold Matters in WSSS: Manipulating the Activation for the Robust and Accurate Segmentation Model Against Thresholdscited by 37
- 2022Expansion and Shrinkage of Localization for Weakly-Supervised Semantic Segmentationcited by 37
- 2021All you need are a few pixels: semantic segmentation with PixelPickcited by 30
- 2023Extracting Class Activation Maps from Non-Discriminative Features as wellcited by 30
- 2021Activation Modulation and Recalibration Scheme for Weakly Supervised Semantic Segmentationcited by 29
- 2021Uncertainty Estimation via Response Scaling for Pseudo-mask Noise Mitigation in Weakly-supervised Semantic Segmentationcited by 28
- 2022TransCAM: Transformer Attention-based CAM Refinement for Weakly Supervised Semantic Segmentationcited by 26
- 2023Semantic Image Segmentation: Two Decades of Researchcited by 26
- 2023Opti-CAM: Optimizing saliency maps for interpretabilitycited by 25
- 2023Shatter and Gather: Learning Referring Image Segmentation with Text Supervisioncited by 25
- 2021Semantic Segmentation In-the-Wild Without Seeing Any Segmentation Examplescited by 24
- 2023Image Data Augmentation Approaches: A Comprehensive Survey and Future directionscited by 23
- 2021Adaptive Affinity Loss and Erroneous Pseudo-Label Refinement for Weakly Supervised Semantic Segmentationcited by 22
- 2022From colouring-in to pointillism: revisiting semantic segmentation supervisioncited by 22
- 2023WeakTr: Exploring Plain Vision Transformer for Weakly-supervised Semantic Segmentationcited by 22
- 2023MCTformer+: Multi-Class Token Transformer for Weakly Supervised Semantic Segmentationcited by 22
50 most cited of 198 All 198 (JSON)
- 2026Less Supervision, Better Generalization: Weakly Supervised Fake Region Localization in Diffusion-Edited Images29 Sep 2026
- 2026CRF Loss is How Networks Should Learn Boundaries in Weakly Supervised Segmentation28 Sep 2026
- 2026Report Supervision27 Aug 2026
- 2026Weakly Supervised Polar Low Segmentation in Sentinel-1 SAR Imagery14 Aug 2026
- 2026ProBAG: Prototype-Guided Boundary-Aware Graph Diffusion for Weakly Supervised Histopathology Segmentation12 Aug 2026
- 2026PANC: Prior-Aware Normalized Cut via Anchor-Augmented Token Graphs6 Feb 2026
- 2026Context Patch Fusion With Class Token Enhancement for Weakly Supervised Semantic Segmentation21 Jan 2026
- 2025Attack-Aware Deepfake Detection under Counter-Forensic Manipulations26 Dec 2025
- 2025SynthSeg-Agents: Multi-Agent Synthetic Data Generation for Zero-Shot Weakly Supervised Semantic Segmentation17 Dec 2025
- 2025Hybrid Transformer-Mamba for Weakly Supervised Volumetric Medical Segmentation11 Dec 2025
- 2025Causally Guided Gaussian Perturbations for Out-Of-Distribution Generalization in Medical Imaging30 Sep 2025
- 2025Contrastive Prompt Clustering for Weakly Supervised Semantic Segmentation23 Aug 2025
38 more
- 2025DisFaceRep: Representation Disentanglement for Co-occurring Facial Components in Weakly Supervised Face Parsing2 Aug 2025
- 2025SeeDiff: Off-the-Shelf Seeded Mask Generation from Diffusion Models26 Jul 2025
- 2025Soft Self-labeling and Potts Relaxations for Weakly-Supervised Segmentation2 Jul 2025
- 2025SPARS: Self-Play Adversarial Reinforcement Learning for Segmentation of Liver Tumours25 May 2025
- 2025Approximate Size Targets Are Sufficient for Accurate Semantic Segmentation10 Mar 2025
- 2025Temporal-consistent CAMs for Weakly Supervised Video Segmentation in Waste Sorting3 Feb 2025
- 2024Image Augmentation Agent for Weakly Supervised Semantic Segmentation29 Dec 2024
- 2024Spectrum-oriented Point-supervised Saliency Detector for Hyperspectral Images24 Dec 2024
- 2024Prompt Categories Cluster for Weakly Supervised Semantic Segmentation18 Dec 2024
- 2024Sli2Vol+: Segmenting 3D Medical Images Based on an Object Estimation Guided Correspondence Flow Network21 Nov 2024
- 2024Text-Driven Weakly Supervised OCT Lesion Segmentation with Structural Guidance19 Nov 2024
- 2024Free-Mask: A Novel Paradigm of Integration Between the Segmentation Diffusion Model and Image Editing4 Nov 2024
- 2024Cognition Transferring and Decoupling for Text-supervised Egocentric Semantic Segmentation2 Oct 2024
- 2024Semantic Segmentation from Image Labels by Reconstruction from Structured Decomposition2 Sep 2024
- 2024Learning to Discover Forgery Cues for Face Forgery Detection2 Sep 2024
- 2024Pixel-Level Domain Adaptation: A New Perspective for Enhancing Weakly Supervised Semantic Segmentation4 Aug 2024
- 2024Disentangling spatio-temporal knowledge for weakly supervised object detection and segmentation in surgical video22 Jul 2024
- 2024Adaptive Patch Contrast for Weakly Supervised Semantic Segmentation15 Jul 2024
- 2024Knowledge Transfer with Simulated Inter-Image Erasing for Weakly Supervised Semantic Segmentation3 Jul 2024
- 2024Fine-grained Background Representation for Weakly Supervised Semantic Segmentation22 Jun 2024
- 2024Competing for pixels: a self-play algorithm for weakly-supervised segmentation26 May 2024
- 2024Image to Pseudo-Episode: Boosting Few-Shot Segmentation by Unlabeled Data14 May 2024
- 2024ToNNO: Tomographic Reconstruction of a Neural Network's Output for Weakly Supervised Segmentation of 3D Medical Images19 Apr 2024
- 2024Tendency-driven Mutual Exclusivity for Weakly Supervised Incremental Semantic Segmentation18 Apr 2024
- 2024Background Noise Reduction of Attention Map for Weakly Supervised Semantic Segmentation4 Apr 2024
- 2024CAPE: CAM as a Probabilistic Ensemble for Enhanced DNN Interpretation3 Apr 2024
- 2024DHR: Dual Features-Driven Hierarchical Rebalancing in Inter- and Intra-Class Regions for Weakly-Supervised Semantic Segmentation30 Mar 2024
- 2024Counting Network for Learning from Majority Label20 Mar 2024
- 2024DuPL: Dual Student with Trustworthy Progressive Learning for Robust Weakly Supervised Semantic Segmentation17 Mar 2024
- 2024Hunting Attributes: Context Prototype-Aware Learning for Weakly Supervised Semantic Segmentation12 Mar 2024
- 2024Weakly Supervised Change Detection via Knowledge Distillation and Multiscale Sigmoid Inference9 Mar 2024
- 2024Auxiliary Tasks Enhanced Dual-affinity Learning for Weakly Supervised Semantic Segmentation2 Mar 2024
- 2024Scribble Hides Class: Promoting Scribble-Based Weakly-Supervised Semantic Segmentation with Its Class Label27 Feb 2024
- 2024Fingerprint Presentation Attack Detector Using Global-Local Model20 Feb 2024
- 2024HistoSegCap: Capsules for Weakly-Supervised Semantic Segmentation of Histological Tissue Type in Whole Slide Images16 Feb 2024
- 2024CoBra: Complementary Branch Fusing Class and Semantic Knowledge for Robust Weakly Supervised Semantic Segmentation5 Feb 2024
- 2024Spatial Structure Constraints for Weakly Supervised Semantic Segmentation20 Jan 2024
- 2023Weakly Supervised Semantic Segmentation for Driving Scenes21 Dec 2023
50 newest of 198 All 198 (JSON)
- 2022DTFD-MIL: Double-Tier Feature Distillation Multiple Instance Learning for Histopathology Whole Slide Image Classificationcited by 254
- 2022Multi-class Token Transformer for Weakly Supervised Semantic Segmentationcited by 138
- 2021Anti-Adversarially Manipulated Attributions for Weakly and Semi-Supervised Semantic Segmentationcited by 134
- 2021Railroad is not a Train: Saliency as Pseudo-pixel Supervision for Weakly Supervised Semantic Segmentationcited by 127
- 2021TS-CAM: Token Semantic Coupled Attention Map for Weakly Supervised Object Localizationcited by 122
- 2022Learning Affinity from Attention: End-to-End Weakly-Supervised Semantic Segmentation with Transformerscited by 118
- 2021Large-scale Unsupervised Semantic Segmentationcited by 98
- 2021Non-Salient Region Object Mining for Weakly Supervised Semantic Segmentationcited by 95
- 2022Self-supervised Image-specific Prototype Exploration for Weakly Supervised Semantic Segmentationcited by 87
- 2021Weakly Supervised Semantic Segmentation by Pixel-to-Prototype Contrastcited by 85
- 2021Leveraging Auxiliary Tasks with Affinity Learning for Weakly Supervised Semantic Segmentationcited by 77
- 2021Complementary Patch for Weakly Supervised Semantic Segmentationcited by 75
12 most cited of 192 All 192 (JSON)
- 2026Less Supervision, Better Generalization: Weakly Supervised Fake Region Localization in Diffusion-Edited Images29 Sep 2026
- 2026CRF Loss is How Networks Should Learn Boundaries in Weakly Supervised Segmentation28 Sep 2026
- 2026Report Supervision27 Aug 2026
- 2026Weakly Supervised Polar Low Segmentation in Sentinel-1 SAR Imagery14 Aug 2026
- 2026ProBAG: Prototype-Guided Boundary-Aware Graph Diffusion for Weakly Supervised Histopathology Segmentation12 Aug 2026
- 2026PANC: Prior-Aware Normalized Cut via Anchor-Augmented Token Graphs6 Feb 2026
- 2026Context Patch Fusion With Class Token Enhancement for Weakly Supervised Semantic Segmentation21 Jan 2026
- 2025Causally Guided Gaussian Perturbations for Out-Of-Distribution Generalization in Medical Imaging30 Sep 2025
- 2025Contrastive Prompt Clustering for Weakly Supervised Semantic Segmentation23 Aug 2025
- 2025DisFaceRep: Representation Disentanglement for Co-occurring Facial Components in Weakly Supervised Face Parsing2 Aug 2025
- 2025Soft Self-labeling and Potts Relaxations for Weakly-Supervised Segmentation2 Jul 2025
- 2025SPARS: Self-Play Adversarial Reinforcement Learning for Segmentation of Liver Tumours25 May 2025
12 newest of 192 All 192 (JSON)