Weakly- and Semi-Supervised Learning of a DCNN for Semantic Image Segmentation
Not on the map. Why?
Abstract (arXiv)
Deep convolutional neural networks (DCNNs) trained on a large number of images with strong pixel-level annotations have recently significantly pushed the state-of-art in semantic image segmentation. We study the more challenging problem of learning DCNNs for semantic image segmentation from either (1) weakly annotated training data such as bounding boxes or image-level labels or (2) a combination of few strongly labeled and many weakly labeled images, sourced from one or multiple datasets. We develop Expectation-Maximization (EM) methods for semantic image segmentation model training under these weakly supervised and semi-supervised settings. Extensive experimental evaluation shows that the proposed techniques can learn models delivering competitive results on the challenging PASCAL VOC 2012 image segmentation benchmark, while requiring significantly less annotation effort. We share source code implementing the proposed system at https://bitbucket.org/deeplab/deeplab-public.
Key facts. Cited by 189 papers in the map (data through 7 Oct 2026). First posted on arXiv 9 Feb 2015.
Builds on
No reference list yet.
Built on by
Citing papers per year: 2021: 72; 2022: 37; 2023: 40; 2024: 20; 2025: 16; 2026: 4.
189 papers.
Sort:
By area:
- 2021A Survey on Deep Semi-supervised Learningcited by 250
- 2021Unsupervised Semantic Segmentation by Contrasting Object Mask Proposalscited by 190
- 2022Panoptic NeRF: 3D-to-2D Label Transfer for Panoptic Urban Scene Segmentationcited by 152
- 2021TS-CAM: Token Semantic Coupled Attention Map for Weakly Supervised Object Localizationcited by 122
- 2022Learning Affinity from Attention: End-to-End Weakly-Supervised Semantic Segmentation with Transformerscited by 118
- 2022CLIP is Also an Efficient Segmenter: A Text-Driven Approach for Weakly Supervised Semantic Segmentationcited by 118
- 2021Semi-supervised Semantic Segmentation with Directional Context-aware Consistencycited by 112
- 2021BBAM: Bounding Box Attribution Map for Weakly Supervised Semantic and Instance Segmentationcited by 104
- 2022Cross Language Image Matching for Weakly Supervised Semantic Segmentationcited by 72
- 2021DiscoBox: Weakly Supervised Instance Segmentation and Semantic Correspondence from Box Supervisioncited by 59
- 2022L2G: A Simple Local-to-Global Knowledge Transfer Framework for Weakly Supervised Semantic Segmentationcited by 57
- 2022Discovering Object Masks with Transformers for Unsupervised Semantic Segmentationcited by 54
38 more
- 2021Scalable Scene Flow from Point Clouds in the Real Worldcited by 49
- 2021Revisiting Contrastive Methods for Unsupervised Learning of Visual Representationscited by 48
- 2021Affinity Attention Graph Neural Network for Weakly Supervised Semantic Segmentationcited by 47
- 2021Unveiling the Potential of Structure Preserving for Weakly Supervised Object Localizationcited by 46
- 2021Universal Weakly Supervised Segmentation by Pixel-to-Segment Contrastive Learningcited by 43
- 2021Background-Aware Pooling and Noise-Aware Loss for Weakly-Supervised Semantic Segmentationcited by 41
- 2021Incremental Learning in Semantic Segmentation from Image Labelscited by 39
- 2021Every Annotation Counts: Multi-label Deep Supervision for Medical Image Segmentationcited by 37
- 2021Pseudo-labeling for Scalable 3D Object Detectioncited by 32
- 2021Fully Convolutional Networks for Panoptic Segmentation with Point-based Supervisioncited by 31
- 2021All you need are a few pixels: semantic segmentation with PixelPickcited by 30
- 2023DaTaSeg: Taming a Universal Multi-Dataset Multi-Task Segmentation Modelcited by 30
- 2023Segment Anything is A Good Pseudo-label Generator for Weakly Supervised Semantic Segmentationcited by 27
- 2021Unsupervised Foreground Extraction via Deep Region Competitioncited by 26
- 2023Semantic Image Segmentation: Two Decades of Researchcited by 26
- 2021Beyond Semantic to Instance Segmentation: Weakly-Supervised Instance Segmentation via Semantic Knowledge Transfer and Self-Refinementcited by 25
- 2021An EM Framework for Online Incremental Learning of Semantic Segmentationcited by 24
- 2023LEOD: Label-Efficient Object Detection for Event Camerascited by 24
- 2021Adaptive Affinity Loss and Erroneous Pseudo-Label Refinement for Weakly Supervised Semantic Segmentationcited by 22
- 2022MutexMatch: Semi-Supervised Learning with Mutex-Based Consistency Regularizationcited by 22
- 2022A Survey on Deep Learning for Skin Lesion Segmentationcited by 22
- 2022From colouring-in to pointillism: revisiting semantic segmentation supervisioncited by 22
- 2021Medical Image Segmentation with Limited Supervision: A Review of Deep Network Modelscited by 21
- 2021Efficient Algorithms for Learning from Coarse Labelscited by 21
- 2021Background-Click Supervision for Temporal Action Localizationcited by 21
- 2022Learning Self-Supervised Low-Rank Network for Single-Stage Weakly and Semi-Supervised Semantic Segmentationcited by 21
- 2022Weakly-supervised segmentation of referring expressionscited by 21
- 2021Weakly-supervised Instance Segmentation via Class-agnostic Learning with Salient Imagescited by 20
- 2023Mask-Free Video Instance Segmentationcited by 20
- 2021Weakly Supervised Instance Segmentation for Videos with Temporal Mask Consistencycited by 19
- 2022Weakly-Supervised Semantic Segmentation with Visual Words Learning and Hybrid Poolingcited by 19
- 2023Weakly-Supervised Semantic Segmentation with Image-Level Labels: from Traditional Models to Foundation Modelscited by 19
- 2023Weakly-Supervised Audio-Visual Segmentationcited by 19
- 2025SAMRefiner: Taming Segment Anything Model for Universal Mask Refinementcited by 19
- 2021Weakly supervised segmentation with cross-modality equivariant constraintscited by 18
- 2021Weakly Supervised Semantic Segmentation via Alternative Self-Dual Teachingcited by 18
- 2023Shepherding Slots to Objects: Towards Stable and Robust Object-Centric Learningcited by 17
- 2021Weakly-Supervised Hierarchical Models for Predicting Persuasive Strategies in Good-faith Textual Requestscited by 16
50 most cited of 189 All 189 (JSON)
- 2026Latent Commonality Expectation-Maximisation for Box-supervised Tree Crown Instance Segmentation22 Sep 2026
- 2026Deep Learning-Based Meat Freshness Detection with Segmentation and OOD-Aware Classification27 Feb 2026
- 2026PLESS: Pseudo-Label Enhancement with Spreading Scribbles for Weakly Supervised Segmentation12 Feb 2026
- 2026PANC: Prior-Aware Normalized Cut via Anchor-Augmented Token Graphs6 Feb 2026
- 2025Lightweight Transformer Framework for Weakly Supervised Semantic Segmentation24 Nov 2025
- 2025Sample-Centric Multi-Task Learning for Detection and Segmentation of Industrial Surface Defects15 Oct 2025
- 2025Explainable Human-in-the-Loop Segmentation via Critic Feedback Signals11 Oct 2025
- 2025Depth Edge Alignment Loss: DEALing with Depth in Weakly Supervised Semantic Segmentation22 Sep 2025
- 2025Emerging Semantic Segmentation from Positive and Negative Coarse Label Learning25 Aug 2025
- 2025DisFaceRep: Representation Disentanglement for Co-occurring Facial Components in Weakly Supervised Face Parsing2 Aug 2025
- 2025Mitigating Spurious Correlations in Weakly Supervised Semantic Segmentation via Cross-architecture Consistency Regularization29 Jul 2025
- 2025Rethinking Semi-supervised Segmentation Beyond Accuracy: Reliability and Robustness6 Jun 2025
38 more
- 2025AutoMiSeg: Automatic Medical Image Segmentation via Test-Time Adaptation of Foundation Models23 May 2025
- 2025Self-Reinforced Graph Contrastive Learning19 May 2025
- 2025Approximate Size Targets Are Sufficient for Accurate Semantic Segmentation10 Mar 2025
- 2025Knowledge Distillation for Semantic Segmentation: A Label Space Unification Approach26 Feb 2025
- 2025ERANet: Edge Replacement Augmentation for Semi-Supervised Meniscus Segmentation with Prototype Consistency Alignment and Conditional Self-Training11 Feb 2025
- 2025SAMRefiner: Taming Segment Anything Model for Universal Mask Refinement10 Feb 2025
- 2025Temporal-consistent CAMs for Weakly Supervised Video Segmentation in Waste Sorting3 Feb 2025
- 2025SketchYourSeg: Mask-Free Subjective Image Segmentation via Freehand Sketches27 Jan 2025
- 2024Sli2Vol+: Segmenting 3D Medical Images Based on an Object Estimation Guided Correspondence Flow Network21 Nov 2024
- 2024QuasiNav: Asymmetric Cost-Aware Navigation Planning with Constrained Quasimetric Reinforcement Learning22 Oct 2024
- 2024iSeg: An Iterative Refinement-based Framework for Training-free Segmentation5 Sep 2024
- 2024SAM-Driven Weakly Supervised Nodule Segmentation with Uncertainty-Aware Cross Teaching18 Jul 2024
- 2024Finding Meaning in Points: Weakly Supervised Semantic Segmentation for Event Cameras15 Jul 2024
- 2024Enhancing Weakly-Supervised Histopathology Image Segmentation with Knowledge Distillation on MIL-Based Pseudo-Labels14 Jul 2024
- 2024AI-based Automatic Segmentation of Prostate on Multi-modality Images: A Review9 Jul 2024
- 2024ALPS: An Auto-Labeling and Pre-training Scheme for Remote Sensing Segmentation With Segment Anything Model16 Jun 2024
- 2024From Obstacles to Resources: Semi-supervised Learning Faces Synthetic Data Contamination27 May 2024
- 2024Revealing Hierarchical Structure of Leaf Venations in Plant Science via Label-Efficient Segmentation: Dataset and Method16 May 2024
- 2024Ultrasound Nodule Segmentation Using Asymmetric Learning with Simple Clinical Annotation23 Apr 2024
- 2024ToNNO: Tomographic Reconstruction of a Neural Network's Output for Weakly Supervised Segmentation of 3D Medical Images19 Apr 2024
- 2024Tendency-driven Mutual Exclusivity for Weakly Supervised Incremental Semantic Segmentation18 Apr 2024
- 2024Towards Label-Efficient Human Matting: A Simple Baseline for Weakly Semi-Supervised Trimap-Free Human Matting1 Apr 2024
- 2024DHR: Dual Features-Driven Hierarchical Rebalancing in Inter- and Intra-Class Regions for Weakly-Supervised Semantic Segmentation30 Mar 2024
- 2024Point-DETR3D: Leveraging Imagery Data with Spatial Point Prior for Weakly Semi-supervised 3D Object Detection22 Mar 2024
- 2024Scribble Hides Class: Promoting Scribble-Based Weakly-Supervised Semantic Segmentation with Its Class Label27 Feb 2024
- 2024DABS-LS: Deep Atlas-Based Segmentation Using Regional Level Set Self-Supervision16 Feb 2024
- 2024Active Learning for Graphs with Noisy Structures4 Feb 2024
- 2024MetaSeg: Content-Aware Meta-Net for Omni-Supervised Semantic Segmentation22 Jan 2024
- 2023Appeal: Allow Mislabeled Samples the Chance to be Rectified in Partial Label Learning18 Dec 2023
- 2023How to Efficiently Annotate Images for Best-Performing Deep Learning Based Segmentation Models: An Empirical Study with Weak and Noisy Annotations and Segment Anything Model17 Dec 2023
- 2023LEOD: Label-Efficient Object Detection for Event Cameras29 Nov 2023
- 2023Weakly-Supervised Audio-Visual Segmentation25 Nov 2023
- 2023Leveraging Large-Scale Pretrained Vision Foundation Models for Label-Efficient 3D Point Cloud Segmentation3 Nov 2023
- 2023Acquiring Weak Annotations for Tumor Localization in Temporal and Volumetric Data23 Oct 2023
- 2023Weakly-Supervised Semantic Segmentation with Image-Level Labels: from Traditional Models to Foundation Models19 Oct 2023
- 2023Label-efficient Segmentation via Affinity Propagation16 Oct 2023
- 2023Small Objects Matters in Weakly-supervised Semantic Segmentation25 Sep 2023
- 2023OneSeg: Self-learning and One-shot Learning based Single-slice Annotation for 3D Medical Image Segmentation24 Sep 2023
50 newest of 189 All 189 (JSON)
- 2021A Survey on Deep Semi-supervised Learningcited by 250
- 2021Unsupervised Semantic Segmentation by Contrasting Object Mask Proposalscited by 190
- 2022Panoptic NeRF: 3D-to-2D Label Transfer for Panoptic Urban Scene Segmentationcited by 152
- 2021TS-CAM: Token Semantic Coupled Attention Map for Weakly Supervised Object Localizationcited by 122
- 2022Learning Affinity from Attention: End-to-End Weakly-Supervised Semantic Segmentation with Transformerscited by 118
- 2022CLIP is Also an Efficient Segmenter: A Text-Driven Approach for Weakly Supervised Semantic Segmentationcited by 118
- 2021Semi-supervised Semantic Segmentation with Directional Context-aware Consistencycited by 112
- 2021BBAM: Bounding Box Attribution Map for Weakly Supervised Semantic and Instance Segmentationcited by 104
- 2022Cross Language Image Matching for Weakly Supervised Semantic Segmentationcited by 72
- 2021DiscoBox: Weakly Supervised Instance Segmentation and Semantic Correspondence from Box Supervisioncited by 59
- 2022L2G: A Simple Local-to-Global Knowledge Transfer Framework for Weakly Supervised Semantic Segmentationcited by 57
- 2022Discovering Object Masks with Transformers for Unsupervised Semantic Segmentationcited by 54
12 most cited of 186 All 186 (JSON)
- 2026Latent Commonality Expectation-Maximisation for Box-supervised Tree Crown Instance Segmentation22 Sep 2026
- 2026Deep Learning-Based Meat Freshness Detection with Segmentation and OOD-Aware Classification27 Feb 2026
- 2026PLESS: Pseudo-Label Enhancement with Spreading Scribbles for Weakly Supervised Segmentation12 Feb 2026
- 2026PANC: Prior-Aware Normalized Cut via Anchor-Augmented Token Graphs6 Feb 2026
- 2025Lightweight Transformer Framework for Weakly Supervised Semantic Segmentation24 Nov 2025
- 2025Sample-Centric Multi-Task Learning for Detection and Segmentation of Industrial Surface Defects15 Oct 2025
- 2025Explainable Human-in-the-Loop Segmentation via Critic Feedback Signals11 Oct 2025
- 2025Depth Edge Alignment Loss: DEALing with Depth in Weakly Supervised Semantic Segmentation22 Sep 2025
- 2025Emerging Semantic Segmentation from Positive and Negative Coarse Label Learning25 Aug 2025
- 2025DisFaceRep: Representation Disentanglement for Co-occurring Facial Components in Weakly Supervised Face Parsing2 Aug 2025
- 2025Mitigating Spurious Correlations in Weakly Supervised Semantic Segmentation via Cross-architecture Consistency Regularization29 Jul 2025
- 2025Rethinking Semi-supervised Segmentation Beyond Accuracy: Reliability and Robustness6 Jun 2025
12 newest of 186 All 186 (JSON)