ScribbleSup: Scribble-Supervised Convolutional Networks for Semantic Segmentation
Not on the map. Why?
Abstract (arXiv)
Large-scale data is of crucial importance for learning semantic segmentation models, but annotating per-pixel masks is a tedious and inefficient procedure. We note that for the topic of interactive image segmentation, scribbles are very widely used in academic research and commercial software, and are recognized as one of the most user-friendly ways of interacting. In this paper, we propose to use scribbles to annotate images, and develop an algorithm to train convolutional networks for semantic segmentation supervised by scribbles. Our algorithm is based on a graphical model that jointly propagates information from scribbles to unmarked pixels and learns network parameters. We present competitive object semantic segmentation results on the PASCAL VOC dataset by using scribbles as annotations. Scribbles are also favored for annotating stuff (e.g., water, sky, grass) that has no well-defined shape, and our method shows excellent results on the PASCAL-CONTEXT dataset thanks to extra inexpensive scribble annotations. Our scribble annotations on PASCAL VOC are available at http://research.microsoft.com/en-us/um/people/jifdai/downloads/scribble_sup
Key facts. Cited by 330 papers in the map (data through 7 Oct 2026). First posted on arXiv 18 Apr 2016.
Builds on
No reference list yet.
Built on by
Citing papers per year: 2021: 78; 2022: 74; 2023: 82; 2024: 58; 2025: 21; 2026: 17.
330 papers.
Sort:
By area:
- 2021Unsupervised Semantic Segmentation by Contrasting Object Mask Proposalscited by 190
- 2024InstanceDiffusion: Instance-level Control for Image Generationcited by 175
- 2021Reviving Iterative Training with Mask Guidance for Interactive Segmentationcited by 162
- 2023DiffuMask: Synthesizing Images with Pixel-level Annotations for Semantic Segmentation Using Diffusion Modelscited by 162
- 2021Railroad is not a Train: Saliency as Pseudo-pixel Supervision for Weakly Supervised Semantic Segmentationcited by 127
- 2023DatasetDM: Synthesizing Data with Perception Annotations Using Diffusion Modelscited by 122
- 2022Learning What Not to Segment: A New Perspective on Few-Shot Segmentationcited by 120
- 2022Learning Affinity from Attention: End-to-End Weakly-Supervised Semantic Segmentation with Transformerscited by 118
- 2022CLIP is Also an Efficient Segmenter: A Text-Driven Approach for Weakly Supervised Semantic Segmentationcited by 118
- 2022ReCo: Retrieve and Co-segment for Zero-shot Transfercited by 115
- 2021Semi-supervised Semantic Segmentation with Directional Context-aware Consistencycited by 112
- 2021Pixel Contrastive-Consistent Semi-Supervised Semantic Segmentationcited by 101
38 more
- 2022BigDatasetGAN: Synthesizing ImageNet with Pixel-wise Annotationscited by 99
- 2021Non-Salient Region Object Mining for Weakly Supervised Semantic Segmentationcited by 95
- 2021One Thing One Click: A Self-Training Approach for Weakly Supervised 3D Semantic Segmentationcited by 89
- 2022Self-supervised Image-specific Prototype Exploration for Weakly Supervised Semantic Segmentationcited by 87
- 2021Weakly Supervised Semantic Segmentation by Pixel-to-Prototype Contrastcited by 85
- 2021Pointly-Supervised Instance Segmentationcited by 83
- 2021Leveraging Auxiliary Tasks with Affinity Learning for Weakly Supervised Semantic Segmentationcited by 77
- 2023Review of Large Vision Models and Visual Prompt Engineeringcited by 77
- 2021Complementary Patch for Weakly Supervised Semantic Segmentationcited by 75
- 2022Class Re-Activation Maps for Weakly-Supervised Semantic Segmentationcited by 75
- 2022Cross Language Image Matching for Weakly Supervised Semantic Segmentationcited by 72
- 2021Context Decoupling Augmentation for Weakly Supervised Semantic Segmentationcited by 69
- 2022Scribble-Supervised LiDAR Semantic Segmentationcited by 69
- 2022CycleMix: A Holistic Strategy for Medical Image Segmentation from Scribble Supervisioncited by 64
- 2022Scribble-Supervised Medical Image Segmentation via Dual-Branch Network and Dynamically Mixed Pseudo Labels Supervisioncited by 64
- 2022Regional Semantic Contrast and Aggregation for Weakly Supervised Semantic Segmentationcited by 64
- 2021Adaptive Early-Learning Correction for Segmentation from Noisy Annotationscited by 61
- 2021DiscoBox: Weakly Supervised Instance Segmentation and Semantic Correspondence from Box Supervisioncited by 59
- 2021A Closer Look at Self-training for Zero-Label Semantic Segmentationcited by 57
- 2022L2G: A Simple Local-to-Global Knowledge Transfer Framework for Weakly Supervised Semantic Segmentationcited by 57
- 2022Discovering Object Masks with Transformers for Unsupervised Semantic Segmentationcited by 54
- 2022Unsupervised Semantic Segmentation with Self-supervised Object-centric Representationscited by 54
- 2021Exploiting a Joint Embedding Space for Generalized Zero-Shot Semantic Segmentationcited by 53
- 2023Segment Anything Model (SAM) Enhanced Pseudo Labels for Weakly Supervised Semantic Segmentationcited by 53
- 2024Diffusion Models and Representation Learning: A Surveycited by 53
- 2021Pseudo-mask Matters in Weakly-supervised Semantic Segmentationcited by 48
- 2021Affinity Attention Graph Neural Network for Weakly Supervised Semantic Segmentationcited by 47
- 2022Tree Energy Loss: Towards Sparsely Annotated Semantic Segmentationcited by 47
- 2022A Survey on Label-efficient Deep Image Segmentation: Bridging the Gap between Weak Supervision and Dense Predictioncited by 46
- 2021Universal Weakly Supervised Segmentation by Pixel-to-Segment Contrastive Learningcited by 43
- 2021Multi-Layer Pseudo-Supervision for Histopathology Tissue Semantic Segmentation using Patch-level Classification Labelscited by 43
- 2022ACSeg: Adaptive Conceptualization for Unsupervised Semantic Segmentationcited by 42
- 2021Background-Aware Pooling and Noise-Aware Loss for Weakly-Supervised Semantic Segmentationcited by 41
- 2023CLIP in Medical Imaging: A Surveycited by 40
- 2021Incremental Learning in Semantic Segmentation from Image Labelscited by 39
- 2021Puzzle-CAM: Improved localization via matching partial and full featurescited by 37
- 2022Threshold Matters in WSSS: Manipulating the Activation for the Robust and Accurate Segmentation Model Against Thresholdscited by 37
- 2022Expansion and Shrinkage of Localization for Weakly-Supervised Semantic Segmentationcited by 37
50 most cited of 330 All 330 (JSON)
- 2026IMVS: Interactive Medical Volume Segmentation with Test-Time Adaptation - A New Method for Annotating Radiology Datasets15 Sep 2026
- 2026MOSAIC: Modality-agnostic Spectral Alignment for Federated Image-level Weakly Supervised Tumor Segmentation under Client-specific Missing Modalities20 Aug 2026
- 2026Weakly Supervised Polar Low Segmentation in Sentinel-1 SAR Imagery14 Aug 2026
- 2026A Unified Variational Framework for Deep Weakly Supervised Image Segmentation22 Jul 2026
- 2026TACoS: Weakly Supervised Learning of Two-Dimensional Materials from Scribble Annotations to Precise Segmentation8 Jul 2026
- 2026OBBSeg: Irregular Lesion Segmentation under Oriented Bounding Box Annotations7 Jul 2026
- 2026APRIL-MedSeg: A Modular Medical Image Segmentation Toolbox Embracing Modern Paradigms29 Jun 2026
- 2026iSAGE: A Human-in-the-Loop Framework for Remote Sensing Semantic Segmentation via Sparse Point Supervision8 Jun 2026
- 2026Weakly Supervised Segmentation as Semantic-Based Regularization13 May 2026
- 2026ScribbleDose: Scribble-Guided Dose Prediction in Radiotherapy12 May 2026
- 2026DiCLIP: Diffusion Model Enhances CLIP's Dense Knowledge for Weakly Supervised Semantic Segmentation6 May 2026
- 2026Do Instance Priors Help Weakly Supervised Semantic Segmentation?13 Apr 2026
38 more
- 2026SCISSR: Scribble-Conditioned Interactive Surgical Segmentation and Refinement19 Mar 2026
- 2026Rewis3d: Reconstruction Improves Weakly-Supervised Semantic Segmentation6 Mar 2026
- 2026PLESS: Pseudo-Label Enhancement with Spreading Scribbles for Weakly Supervised Segmentation12 Feb 2026
- 2026PANC: Prior-Aware Normalized Cut via Anchor-Augmented Token Graphs6 Feb 2026
- 2026Context Patch Fusion With Class Token Enhancement for Weakly Supervised Semantic Segmentation21 Jan 2026
- 2025Explainable Human-in-the-Loop Segmentation via Critic Feedback Signals11 Oct 2025
- 2025Emerging Semantic Segmentation from Positive and Negative Coarse Label Learning25 Aug 2025
- 2025OmViD: Omni-supervised active learning for video action detection19 Aug 2025
- 2025Deep Learning for Crack Detection: A Review of Learning Paradigms, Generalizability, and Datasets14 Aug 2025
- 2025DisFaceRep: Representation Disentanglement for Co-occurring Facial Components in Weakly Supervised Face Parsing2 Aug 2025
- 2025SeeDiff: Off-the-Shelf Seeded Mask Generation from Diffusion Models26 Jul 2025
- 2025Know Your Attention Maps: Class-specific Token Masking for Weakly Supervised Semantic Segmentation9 Jul 2025
- 2025Prompt learning with bounding box constraints for medical image segmentation3 Jul 2025
- 2025Soft Self-labeling and Potts Relaxations for Weakly-Supervised Segmentation2 Jul 2025
- 2025CmFNet: Cross-modal Fusion Network for Weakly-supervised Segmentation of Medical Images22 Jun 2025
- 2025FocalClick-XL: Towards Unified and High-quality Interactive Segmentation17 Jun 2025
- 2025Structure-Aware Automatic Channel Pruning by Searching with Graph Embedding13 Jun 2025
- 2025SPARS: Self-Play Adversarial Reinforcement Learning for Segmentation of Liver Tumours25 May 2025
- 2025MedCL: Learning Consistent Anatomy Distribution for Scribble-supervised Medical Image Segmentation28 Mar 2025
- 2025Exploring CLIP's Dense Knowledge for Weakly Supervised Semantic Segmentation26 Mar 2025
- 2025Approximate Size Targets Are Sufficient for Accurate Semantic Segmentation10 Mar 2025
- 2025SAMRefiner: Taming Segment Anything Model for Universal Mask Refinement10 Feb 2025
- 2025Temporal-consistent CAMs for Weakly Supervised Video Segmentation in Waste Sorting3 Feb 2025
- 2025SketchYourSeg: Mask-Free Subjective Image Segmentation via Freehand Sketches27 Jan 2025
- 2025In the Picture: Medical Imaging Datasets, Artifacts, and their Living Review18 Jan 2025
- 2025EAUWSeg: Eliminating annotation uncertainty in weakly-supervised medical image segmentation3 Jan 2025
- 2024HisynSeg: Weakly-Supervised Histopathological Image Segmentation via Image-Mixing Synthesis and Consistency Regularization30 Dec 2024
- 2024MultiverSeg: Scalable Interactive Segmentation of Biomedical Imaging Datasets with In-Context Guidance19 Dec 2024
- 2024MoRe: Class Patch Attention Needs Regularization for Weakly Supervised Semantic Segmentation15 Dec 2024
- 2024ScribbleLight: Single Image Indoor Relighting with Scribbles26 Nov 2024
- 2024Text-Driven Weakly Supervised OCT Lesion Segmentation with Structural Guidance19 Nov 2024
- 2024SP 3 : Superpixel-propagated pseudo-label learning for weakly semi-supervised medical image segmentation18 Nov 2024
- 2024ScribbleVS: Scribble-Supervised Medical Image Segmentation via Dynamic Competitive Pseudo Label Selection15 Nov 2024
- 2024MambaEviScrib: Mamba and Evidence-Guided Consistency Enhance CNN Robustness for Scribble-Based Weakly Supervised Ultrasound Image Segmentation28 Sep 2024
- 2024Scribble-Guided Diffusion for Training-free Text-to-Image Generation12 Sep 2024
- 2024Towards Modality-agnostic Label-efficient Segmentation with Entropy-Regularized Distribution Alignment29 Aug 2024
- 2024Size Aware Cross-shape Scribble Supervision for Medical Image Segmentation24 Aug 2024
- 2024From Few to More: Scribble-based Medical Image Segmentation via Masked Context Modeling and Continuous Pseudo Labels23 Aug 2024
50 newest of 330 All 330 (JSON)
- 2024InstanceDiffusion: Instance-level Control for Image Generationcited by 175
- 2023DiffuMask: Synthesizing Images with Pixel-level Annotations for Semantic Segmentation Using Diffusion Modelscited by 162
- 2023DatasetDM: Synthesizing Data with Perception Annotations Using Diffusion Modelscited by 122
- 2024Diffusion Models and Representation Learning: A Surveycited by 53
- 2023ScribbleGen: Generative Data Augmentation Improves Scribble-supervised Semantic Segmentationcited by 5
- 2025SeeDiff: Off-the-Shelf Seeded Mask Generation from Diffusion Modelscited by 5
- 2024Scribble-Guided Diffusion for Training-free Text-to-Image Generationcited by 2
- 2026DiCLIP: Diffusion Model Enhances CLIP's Dense Knowledge for Weakly Supervised Semantic Segmentationcited by 0
- 2026DiCLIP: Diffusion Model Enhances CLIP's Dense Knowledge for Weakly Supervised Semantic Segmentation6 May 2026
- 2025SeeDiff: Off-the-Shelf Seeded Mask Generation from Diffusion Models26 Jul 2025
- 2024Scribble-Guided Diffusion for Training-free Text-to-Image Generation12 Sep 2024
- 2024Diffusion Models and Representation Learning: A Survey30 Jun 2024
- 2024InstanceDiffusion: Instance-level Control for Image Generation5 Feb 2024
- 2023ScribbleGen: Generative Data Augmentation Improves Scribble-supervised Semantic Segmentation28 Nov 2023
- 2023DatasetDM: Synthesizing Data with Perception Annotations Using Diffusion Models11 Aug 2023
- 2023DiffuMask: Synthesizing Images with Pixel-level Annotations for Semantic Segmentation Using Diffusion Models21 Mar 2023
- 2023Open-Vocabulary Camouflaged Object Segmentationcited by 14
- 2023Open-Vocabulary Camouflaged Object Segmentation19 Nov 2023
- 2021Unsupervised Semantic Segmentation by Contrasting Object Mask Proposalscited by 190
- 2021Reviving Iterative Training with Mask Guidance for Interactive Segmentationcited by 162
- 2021Railroad is not a Train: Saliency as Pseudo-pixel Supervision for Weakly Supervised Semantic Segmentationcited by 127
- 2022Learning What Not to Segment: A New Perspective on Few-Shot Segmentationcited by 120
- 2022Learning Affinity from Attention: End-to-End Weakly-Supervised Semantic Segmentation with Transformerscited by 118
- 2022CLIP is Also an Efficient Segmenter: A Text-Driven Approach for Weakly Supervised Semantic Segmentationcited by 118
- 2022ReCo: Retrieve and Co-segment for Zero-shot Transfercited by 115
- 2021Semi-supervised Semantic Segmentation with Directional Context-aware Consistencycited by 112
- 2021Pixel Contrastive-Consistent Semi-Supervised Semantic Segmentationcited by 101
- 2022BigDatasetGAN: Synthesizing ImageNet with Pixel-wise Annotationscited by 99
- 2021Non-Salient Region Object Mining for Weakly Supervised Semantic Segmentationcited by 95
- 2021One Thing One Click: A Self-Training Approach for Weakly Supervised 3D Semantic Segmentationcited by 89
12 most cited of 320 All 320 (JSON)
- 2026IMVS: Interactive Medical Volume Segmentation with Test-Time Adaptation - A New Method for Annotating Radiology Datasets15 Sep 2026
- 2026MOSAIC: Modality-agnostic Spectral Alignment for Federated Image-level Weakly Supervised Tumor Segmentation under Client-specific Missing Modalities20 Aug 2026
- 2026Weakly Supervised Polar Low Segmentation in Sentinel-1 SAR Imagery14 Aug 2026
- 2026A Unified Variational Framework for Deep Weakly Supervised Image Segmentation22 Jul 2026
- 2026TACoS: Weakly Supervised Learning of Two-Dimensional Materials from Scribble Annotations to Precise Segmentation8 Jul 2026
- 2026OBBSeg: Irregular Lesion Segmentation under Oriented Bounding Box Annotations7 Jul 2026
- 2026APRIL-MedSeg: A Modular Medical Image Segmentation Toolbox Embracing Modern Paradigms29 Jun 2026
- 2026iSAGE: A Human-in-the-Loop Framework for Remote Sensing Semantic Segmentation via Sparse Point Supervision8 Jun 2026
- 2026Weakly Supervised Segmentation as Semantic-Based Regularization13 May 2026
- 2026ScribbleDose: Scribble-Guided Dose Prediction in Radiotherapy12 May 2026
- 2026Do Instance Priors Help Weakly Supervised Semantic Segmentation?13 Apr 2026
- 2026SCISSR: Scribble-Conditioned Interactive Surgical Segmentation and Refinement19 Mar 2026
12 newest of 320 All 320 (JSON)