Single-Stage Semantic Segmentation from Image Labels
Not on the map. Why?
Abstract (arXiv)
Recent years have seen a rapid growth in new approaches improving the accuracy of semantic segmentation in a weakly supervised setting, i.e. with only image-level labels available for training. However, this has come at the cost of increased model complexity and sophisticated multi-stage training procedures. This is in contrast to earlier work that used only a single stage - training one segmentation network on image labels - which was abandoned due to inferior segmentation accuracy. In this work, we first define three desirable properties of a weakly supervised method: local consistency, semantic fidelity, and completeness. Using these properties as guidelines, we then develop a segmentation-based network model and a self-supervised training scheme to train for semantic masks from image-level annotations in a single stage. We show that despite its simplicity, our method achieves results that are competitive with significantly more complex pipelines, substantially outperforming earlier single-stage methods.
Key facts. Cited by 167 papers in the map (data through 7 Oct 2026). First posted on arXiv 16 May 2020.
Builds on
No reference list yet.
Built on by
Citing papers per year: 2021: 23; 2022: 21; 2023: 36; 2024: 43; 2025: 30; 2026: 14.
167 papers.
Sort:
By area:
- 2023SCLIP: Rethinking Self-Attention for Dense Vision-Language Inferencecited by 169
- 2022Multi-class Token Transformer for Weakly Supervised Semantic Segmentationcited by 138
- 2022Learning to Generate Text-grounded Mask for Open-world Semantic Segmentation from Only Image-Text Pairscited by 130
- 2021Railroad is not a Train: Saliency as Pseudo-pixel Supervision for Weakly Supervised Semantic Segmentationcited by 127
- 2022Learning Affinity from Attention: End-to-End Weakly-Supervised Semantic Segmentation with Transformerscited by 118
- 2022CLIP is Also an Efficient Segmenter: A Text-Driven Approach for Weakly Supervised Semantic Segmentationcited by 118
- 2024FeatUp: A Model-Agnostic Framework for Features at Any Resolutioncited by 114
- 2021Leveraging Auxiliary Tasks with Affinity Learning for Weakly Supervised Semantic Segmentationcited by 77
- 2024Pay Attention to Your Neighbours: Training-Free Open-Vocabulary Semantic Segmentationcited by 76
- 2021Complementary Patch for Weakly Supervised Semantic Segmentationcited by 75
- 2023CLIP as RNN: Segment Countless Visual Concepts without Training Endeavorcited by 69
- 2021Reducing Information Bottleneck for Weakly Supervised Semantic Segmentationcited by 65
38 more
- 2022Regional Semantic Contrast and Aggregation for Weakly Supervised Semantic Segmentationcited by 64
- 2023Token Contrast for Weakly-Supervised Semantic Segmentationcited by 64
- 2023Diffusion Models for Open-Vocabulary Segmentationcited by 63
- 2022L2G: A Simple Local-to-Global Knowledge Transfer Framework for Weakly Supervised Semantic Segmentationcited by 57
- 2022Unsupervised Semantic Segmentation with Self-supervised Object-centric Representationscited by 54
- 2023Segment Anything Model (SAM) Enhanced Pseudo Labels for Weakly Supervised Semantic Segmentationcited by 53
- 2022A Survey on Label-efficient Deep Image Segmentation: Bridging the Gap between Weak Supervision and Dense Predictioncited by 46
- 2021Universal Weakly Supervised Segmentation by Pixel-to-Segment Contrastive Learningcited by 43
- 2024Training-Free Open-Vocabulary Segmentation with Offline Diffusion-Augmented Prototype Generationcited by 43
- 2024EmerDiff: Emerging Pixel-level Semantic Knowledge in Diffusion Modelscited by 42
- 2024Talking to DINO: Bridging Self-Supervised Vision Backbones with Language for Open-Vocabulary Segmentationcited by 42
- 2022Max Pooling with Vision Transformers reconciles class and shape in weakly supervised semantic segmentationcited by 41
- 2021Incremental Learning in Semantic Segmentation from Image Labelscited by 39
- 2023CLIP-DIY: CLIP Dense Inference Yields Open-Vocabulary Semantic Segmentation For-Freecited by 39
- 2024Harnessing Vision Foundation Models for High-Performance, Training-Free Open Vocabulary Segmentationcited by 38
- 2022Threshold Matters in WSSS: Manipulating the Activation for the Robust and Accurate Segmentation Model Against Thresholdscited by 37
- 2023Referring Image Segmentation Using Text Supervisioncited by 35
- 2023Foundation Model Assisted Weakly Supervised Semantic Segmentationcited by 31
- 2024ResCLIP: Residual Attention for Training-free Dense Vision-language Inferencecited by 28
- 2021MFNet: Multi-filter Directive Network for Weakly Supervised Salient Object Detectioncited by 27
- 2022Out-of-Candidate Rectification for Weakly Supervised Semantic Segmentationcited by 26
- 2023Self Correspondence Distillation for End-to-End Weakly-Supervised Semantic Segmentationcited by 26
- 2024DiffCut: Catalyzing Zero-Shot Semantic Segmentation with Diffusion Features and Recursive Normalized Cutcited by 26
- 2021Beyond Semantic to Instance Segmentation: Weakly-Supervised Instance Segmentation via Semantic Knowledge Transfer and Self-Refinementcited by 25
- 2021Semantic Segmentation In-the-Wild Without Seeing Any Segmentation Examplescited by 24
- 2023LEOD: Label-Efficient Object Detection for Event Camerascited by 24
- 2021Source-free unsupervised domain adaptation for cross-modality abdominal multi-organ segmentationcited by 23
- 2023Towards Generic Image Manipulation Detection with Weakly-Supervised Self-Consistency Learningcited by 23
- 2024Distilling Spectral Graph for Object-Context Aware Open-Vocabulary Semantic Segmentationcited by 23
- 2021Adaptive Affinity Loss and Erroneous Pseudo-Label Refinement for Weakly Supervised Semantic Segmentationcited by 22
- 2023MCTformer+: Multi-Class Token Transformer for Weakly Supervised Semantic Segmentationcited by 22
- 2022Learning Self-Supervised Low-Rank Network for Single-Stage Weakly and Semi-Supervised Semantic Segmentationcited by 21
- 2022Weakly-supervised segmentation of referring expressionscited by 21
- 2023Rewrite Caption Semantics: Bridging Semantic Gaps for Language-Supervised Semantic Segmentationcited by 21
- 2024Image-Text Co-Decomposition for Text-Supervised Semantic Segmentationcited by 21
- 2025LPOSS: Label Propagation Over Patches and Pixels for Open-vocabulary Semantic Segmentationcited by 21
- 2021Scribble-Supervised Semantic Segmentation by Uncertainty Reduction on Neural Representation and Self-Supervision on Neural Eigenspacecited by 19
- 2022Weakly-Supervised Semantic Segmentation with Visual Words Learning and Hybrid Poolingcited by 19
50 most cited of 167 All 167 (JSON)
- 2026DR.WILSS: Diffusion-Based Replay for Weakly Supervised Continual Semantic Segmentation16 Sep 2026
- 2026MARS-CLIP: Multi-Resolution and Attention Refined Zero-Shot Image Segmentation8 Sep 2026
- 2026Perceptual Anchoring: Prototype-Guided Text Calibration for Training-free Open-Vocabulary Semantic Segmentation4 Aug 2026
- 2026DINOde: Continuous Vision-Text Alignment for Open-Vocabulary Semantic Segmentation23 Jul 2026
- 2026Unlocking Diffusion Hierarchies: Adaptive Timestep Selection for Zero-Shot Segmentation14 Jun 2026
- 2026VIP: Visual-guided Prompt Evolution for Efficient Dense Vision-Language Inference12 May 2026
- 2026Featurising Pixels from Dynamic 3D Scenes with Linear In-Context Learners29 Apr 2026
- 2026Excite, Attend and Segment (EASe): Domain-Agnostic Fine-Grained Mask Discovery with Feature Calibration and Self-Supervised Upsampling31 Mar 2026
- 2026PEARL: Geometry Aligns Semantics for Training-Free Open-Vocabulary Semantic Segmentation23 Mar 2026
- 2026Taming SAM3 in the Wild: A Concept Bank for Open-Vocabulary Segmentation6 Feb 2026
- 2026CIEC: Coupling Implicit and Explicit Cues for Multimodal Weakly Supervised Manipulation Localization2 Feb 2026
- 2026SPARK: Stochastic Propagation via Affinity-guided Random walK for training-free unsupervised segmentation31 Jan 2026
38 more
- 2026Context Patch Fusion With Class Token Enhancement for Weakly Supervised Semantic Segmentation21 Jan 2026
- 2026SAPL: Semantic-Agnostic Prompt Learning in CLIP for Weakly Supervised Image Manipulation Localization9 Jan 2026
- 2025ARM: A Learnable, Plug-and-Play Module for CLIP-based Open-vocabulary Semantic Segmentation30 Dec 2025
- 2025SegEarth-OV3: Exploring SAM 3 for Open-Vocabulary Semantic Segmentation in Remote Sensing Images9 Dec 2025
- 2025RADSeg: Unleashing Parameter and Compute Efficient Zero-Shot Open-Vocabulary Segmentation Using Agglomerative Models24 Nov 2025
- 2025FlowFeat: Pixel-Dense Embedding of Motion Profiles10 Nov 2025
- 2025Improving Visual Discriminability of CLIP for Training-Free Open-Vocabulary Semantic Segmentation27 Oct 2025
- 2025Depth Edge Alignment Loss: DEALing with Depth in Weakly Supervised Semantic Segmentation22 Sep 2025
- 2025Synthetic Captions for Open-Vocabulary Zero-Shot Segmentation15 Sep 2025
- 2025Contrastive Learning through Auxiliary Branch for Video Object Detection28 Aug 2025
- 2025Training-Free Class Purification for Open-Vocabulary Semantic Segmentation1 Aug 2025
- 2025Mitigating Spurious Correlations in Weakly Supervised Semantic Segmentation via Cross-architecture Consistency Regularization29 Jul 2025
- 2025SeeDiff: Off-the-Shelf Seeded Mask Generation from Diffusion Models26 Jul 2025
- 2025Diffusion-Guided Knowledge Distillation for Weakly-Supervised Low-Light Semantic Segmentation10 Jul 2025
- 2025Soft Self-labeling and Potts Relaxations for Weakly-Supervised Segmentation2 Jul 2025
- 2025FA-Seg: A Fast and Accurate Diffusion-Based Method for Open-Vocabulary Segmentation29 Jun 2025
- 2025A Comprehensive Survey on Video Scene Parsing:Advances, Challenges, and Prospects16 Jun 2025
- 2025FMaMIL: Frequency-Driven Mamba Multi-Instance Learning for Weakly Supervised Lesion Segmentation in Medical Images9 Jun 2025
- 2025A Survey on Training-free Open-Vocabulary Semantic Segmentation28 May 2025
- 2025SPARS: Self-Play Adversarial Reinforcement Learning for Segmentation of Liver Tumours25 May 2025
- 2025Native Segmentation Vision Transformers22 May 2025
- 2025Self-Supervised Learning for Image Segmentation: A Comprehensive Survey19 May 2025
- 2025Completely Weakly Supervised Class-Incremental Learning for Semantic Segmentation16 May 2025
- 2025Show or Tell? A Benchmark To Evaluate Visual and Textual Prompts in Semantic Segmentation6 May 2025
- 2025Falcon: Fractional Alternating Cut with Overcoming Minima in Unsupervised Segmentation8 Apr 2025
- 2025HGFormer: Topology-Aware Vision Transformer with HyperGraph Learning3 Apr 2025
- 2025Exploring CLIP's Dense Knowledge for Weakly Supervised Semantic Segmentation26 Mar 2025
- 2025Context-Aware Weakly Supervised Image Manipulation Localization with SAM Refinement26 Mar 2025
- 2025LPOSS: Label Propagation Over Patches and Pixels for Open-vocabulary Semantic Segmentation25 Mar 2025
- 2025The Power of One: A Single Example is All it Takes for Segmentation in VLMs13 Mar 2025
- 2025Approximate Size Targets Are Sufficient for Accurate Semantic Segmentation10 Mar 2025
- 2025SketchYourSeg: Mask-Free Subjective Image Segmentation via Freehand Sketches27 Jan 2025
- 2024The ART of Composition: Attention-Regularized Training for Compositional Visual Grounding11 Dec 2024
- 2024Unsupervised Segmentation by Diffusing, Walking and Cutting6 Dec 2024
- 2024Exact: Exploring Space-Time Perceptive Clues for Weakly Supervised Satellite Image Time Series Semantic Segmentation5 Dec 2024
- 2024COSMOS: Cross-Modality Self-Distillation for Vision Language Pre-training2 Dec 2024
- 2024Talking to DINO: Bridging Self-Supervised Vision Backbones with Language for Open-Vocabulary Segmentation28 Nov 2024
- 2024Distilling Spectral Graph for Object-Context Aware Open-Vocabulary Semantic Segmentation26 Nov 2024
50 newest of 167 All 167 (JSON)
- 2024ResCLIP: Residual Attention for Training-free Dense Vision-language Inferencecited by 28
- 2024Distilling Spectral Graph for Object-Context Aware Open-Vocabulary Semantic Segmentationcited by 23
- 2023Rewrite Caption Semantics: Bridging Semantic Gaps for Language-Supervised Semantic Segmentationcited by 21
- 2023Emergent Open-Vocabulary Semantic Segmentation from Off-the-shelf Vision-Language Modelscited by 15
- 2024COSMOS: Cross-Modality Self-Distillation for Vision Language Pre-trainingcited by 15
- 2025Training-Free Class Purification for Open-Vocabulary Semantic Segmentationcited by 9
- 2024ITACLIP: Boosting Training-Free Semantic Segmentation with Image, Text, and Architectural Enhancementscited by 7
- 2025The Power of One: A Single Example is All it Takes for Segmentation in VLMscited by 4
- 2025Synthetic Captions for Open-Vocabulary Zero-Shot Segmentationcited by 1
- 2024The ART of Composition: Attention-Regularized Training for Compositional Visual Groundingcited by 0
- 2025Synthetic Captions for Open-Vocabulary Zero-Shot Segmentation15 Sep 2025
- 2025Training-Free Class Purification for Open-Vocabulary Semantic Segmentation1 Aug 2025
- 2025The Power of One: A Single Example is All it Takes for Segmentation in VLMs13 Mar 2025
- 2024The ART of Composition: Attention-Regularized Training for Compositional Visual Grounding11 Dec 2024
- 2024COSMOS: Cross-Modality Self-Distillation for Vision Language Pre-training2 Dec 2024
- 2024Distilling Spectral Graph for Object-Context Aware Open-Vocabulary Semantic Segmentation26 Nov 2024
- 2024ResCLIP: Residual Attention for Training-free Dense Vision-language Inference24 Nov 2024
- 2024ITACLIP: Boosting Training-Free Semantic Segmentation with Image, Text, and Architectural Enhancements18 Nov 2024
- 2023Emergent Open-Vocabulary Semantic Segmentation from Off-the-shelf Vision-Language Models28 Nov 2023
- 2023Rewrite Caption Semantics: Bridging Semantic Gaps for Language-Supervised Semantic Segmentation24 Sep 2023
- 2023Diffusion Models for Open-Vocabulary Segmentationcited by 63
- 2024EmerDiff: Emerging Pixel-level Semantic Knowledge in Diffusion Modelscited by 42
- 2024FreeSeg-Diff: Training-Free Open-Vocabulary Segmentation with Diffusion Modelscited by 12
- 2025SeeDiff: Off-the-Shelf Seeded Mask Generation from Diffusion Modelscited by 5
- 2024Unsupervised Segmentation by Diffusing, Walking and Cuttingcited by 3
- 2025FA-Seg: A Fast and Accurate Diffusion-Based Method for Open-Vocabulary Segmentationcited by 1
- 2026Unlocking Diffusion Hierarchies: Adaptive Timestep Selection for Zero-Shot Segmentationcited by 1
- 2026Unlocking Diffusion Hierarchies: Adaptive Timestep Selection for Zero-Shot Segmentation14 Jun 2026
- 2025SeeDiff: Off-the-Shelf Seeded Mask Generation from Diffusion Models26 Jul 2025
- 2025FA-Seg: A Fast and Accurate Diffusion-Based Method for Open-Vocabulary Segmentation29 Jun 2025
- 2024Unsupervised Segmentation by Diffusing, Walking and Cutting6 Dec 2024
- 2024FreeSeg-Diff: Training-Free Open-Vocabulary Segmentation with Diffusion Models29 Mar 2024
- 2024EmerDiff: Emerging Pixel-level Semantic Knowledge in Diffusion Models22 Jan 2024
- 2023Diffusion Models for Open-Vocabulary Segmentation15 Jun 2023
- 2023SCLIP: Rethinking Self-Attention for Dense Vision-Language Inferencecited by 169
- 2022Multi-class Token Transformer for Weakly Supervised Semantic Segmentationcited by 138
- 2022Learning to Generate Text-grounded Mask for Open-world Semantic Segmentation from Only Image-Text Pairscited by 130
- 2021Railroad is not a Train: Saliency as Pseudo-pixel Supervision for Weakly Supervised Semantic Segmentationcited by 127
- 2022Learning Affinity from Attention: End-to-End Weakly-Supervised Semantic Segmentation with Transformerscited by 118
- 2022CLIP is Also an Efficient Segmenter: A Text-Driven Approach for Weakly Supervised Semantic Segmentationcited by 118
- 2024FeatUp: A Model-Agnostic Framework for Features at Any Resolutioncited by 114
- 2021Leveraging Auxiliary Tasks with Affinity Learning for Weakly Supervised Semantic Segmentationcited by 77
- 2024Pay Attention to Your Neighbours: Training-Free Open-Vocabulary Semantic Segmentationcited by 76
- 2021Complementary Patch for Weakly Supervised Semantic Segmentationcited by 75
- 2023CLIP as RNN: Segment Countless Visual Concepts without Training Endeavorcited by 69
- 2021Reducing Information Bottleneck for Weakly Supervised Semantic Segmentationcited by 65
12 most cited of 149 All 149 (JSON)
- 2026DR.WILSS: Diffusion-Based Replay for Weakly Supervised Continual Semantic Segmentation16 Sep 2026
- 2026MARS-CLIP: Multi-Resolution and Attention Refined Zero-Shot Image Segmentation8 Sep 2026
- 2026Perceptual Anchoring: Prototype-Guided Text Calibration for Training-free Open-Vocabulary Semantic Segmentation4 Aug 2026
- 2026DINOde: Continuous Vision-Text Alignment for Open-Vocabulary Semantic Segmentation23 Jul 2026
- 2026VIP: Visual-guided Prompt Evolution for Efficient Dense Vision-Language Inference12 May 2026
- 2026Featurising Pixels from Dynamic 3D Scenes with Linear In-Context Learners29 Apr 2026
- 2026Excite, Attend and Segment (EASe): Domain-Agnostic Fine-Grained Mask Discovery with Feature Calibration and Self-Supervised Upsampling31 Mar 2026
- 2026PEARL: Geometry Aligns Semantics for Training-Free Open-Vocabulary Semantic Segmentation23 Mar 2026
- 2026Taming SAM3 in the Wild: A Concept Bank for Open-Vocabulary Segmentation6 Feb 2026
- 2026CIEC: Coupling Implicit and Explicit Cues for Multimodal Weakly Supervised Manipulation Localization2 Feb 2026
- 2026SPARK: Stochastic Propagation via Affinity-guided Random walK for training-free unsupervised segmentation31 Jan 2026
- 2026Context Patch Fusion With Class Token Enhancement for Weakly Supervised Semantic Segmentation21 Jan 2026
12 newest of 149 All 149 (JSON)