Simple Does It: Weakly Supervised Instance and Semantic Segmentation
Not on the map. Why?
Abstract (arXiv)
Semantic labelling and instance segmentation are two tasks that require particularly costly annotations. Starting from weak supervision in the form of bounding box detection annotations, we propose a new approach that does not require modification of the segmentation training procedure. We show that when carefully designing the input labels from given bounding boxes, even a single round of training is enough to improve over previously reported weakly supervised results. Overall, our weak supervision approach reaches ~95% of the quality of the fully supervised model, both for semantic labelling and instance segmentation.
Key facts. Cited by 226 papers in the map (data through 7 Oct 2026). First posted on arXiv 24 Mar 2016.
Builds on
No reference list yet.
Built on by
Citing papers per year: 2021: 67; 2022: 66; 2023: 41; 2024: 32; 2025: 15; 2026: 5.
226 papers.
Sort:
By area:
- 2021Unsupervised Semantic Segmentation by Contrasting Object Mask Proposalscited by 190
- 2022Deep Spectral Methods: A Surprisingly Strong Baseline for Unsupervised Semantic Segmentation and Localizationcited by 150
- 2021Anti-Adversarially Manipulated Attributions for Weakly and Semi-Supervised Semantic Segmentationcited by 134
- 2021Railroad is not a Train: Saliency as Pseudo-pixel Supervision for Weakly Supervised Semantic Segmentationcited by 127
- 2022ReCo: Retrieve and Co-segment for Zero-shot Transfercited by 115
- 2021BBAM: Bounding Box Attribution Map for Weakly Supervised Semantic and Instance Segmentationcited by 104
- 2022FreeSOLO: Learning to Segment Objects without Annotationscited by 102
- 2021Non-Salient Region Object Mining for Weakly Supervised Semantic Segmentationcited by 95
- 2021Weakly Supervised Object Localization and Detection: A Surveycited by 84
- 2021Open-Vocabulary Instance Segmentation via Robust Cross-Modal Pseudo-Labelingcited by 84
- 2021Pointly-Supervised Instance Segmentationcited by 83
- 2021Complementary Patch for Weakly Supervised Semantic Segmentationcited by 75
38 more
- 2021Context Decoupling Augmentation for Weakly Supervised Semantic Segmentationcited by 69
- 2022CycleMix: A Holistic Strategy for Medical Image Segmentation from Scribble Supervisioncited by 64
- 2022Regional Semantic Contrast and Aggregation for Weakly Supervised Semantic Segmentationcited by 64
- 2021DiscoBox: Weakly Supervised Instance Segmentation and Semantic Correspondence from Box Supervisioncited by 59
- 2022Weakly Supervised Semantic Segmentation using Out-of-Distribution Datacited by 58
- 2022Discovering Object Masks with Transformers for Unsupervised Semantic Segmentationcited by 54
- 2022Unsupervised Semantic Segmentation with Self-supervised Object-centric Representationscited by 54
- 2023Segment Anything Model (SAM) Enhanced Pseudo Labels for Weakly Supervised Semantic Segmentationcited by 53
- 2021Pseudo-mask Matters in Weakly-supervised Semantic Segmentationcited by 48
- 2021Affinity Attention Graph Neural Network for Weakly Supervised Semantic Segmentationcited by 47
- 2022A Survey on Label-efficient Deep Image Segmentation: Bridging the Gap between Weak Supervision and Dense Predictioncited by 46
- 2021Universal Weakly Supervised Segmentation by Pixel-to-Segment Contrastive Learningcited by 43
- 2021Background-Aware Pooling and Noise-Aware Loss for Weakly-Supervised Semantic Segmentationcited by 41
- 2022Box-supervised Instance Segmentation with Level Set Evolutioncited by 41
- 2023CLIP in Medical Imaging: A Surveycited by 40
- 2021Unsupervised Discovery of the Long-Tail in Instance Segmentation Using Hierarchical Self-Supervisioncited by 39
- 2021Incremental Learning in Semantic Segmentation from Image Labelscited by 39
- 2021Puzzle-CAM: Improved localization via matching partial and full featurescited by 37
- 2021Every Annotation Counts: Multi-label Deep Supervision for Medical Image Segmentationcited by 37
- 2022Threshold Matters in WSSS: Manipulating the Activation for the Robust and Accurate Segmentation Model Against Thresholdscited by 37
- 2022H2RBox: Horizontal Box Annotation is All You Need for Oriented Object Detectioncited by 36
- 2023SkyEye: Self-Supervised Bird's-Eye-View Semantic Mapping Using Monocular Frontal View Imagescited by 35
- 2023Conflict-Based Cross-View Consistency for Semi-Supervised Semantic Segmentationcited by 35
- 2021NuCLS: A scalable crowdsourcing, deep learning approach and dataset for nucleus classification, localization and segmentationcited by 33
- 2021Fully Convolutional Networks for Panoptic Segmentation with Point-based Supervisioncited by 31
- 2022BoxTeacher: Exploring High-Quality Pseudo Labels for Weakly Supervised Instance Segmentationcited by 31
- 2021All you need are a few pixels: semantic segmentation with PixelPickcited by 30
- 2023DaTaSeg: Taming a Universal Multi-Dataset Multi-Task Segmentation Modelcited by 30
- 2021Uncertainty Estimation via Response Scaling for Pseudo-mask Noise Mitigation in Weakly-supervised Semantic Segmentationcited by 28
- 2023H2RBox-v2: Incorporating Symmetry for Boosting Horizontal Box Supervised Oriented Object Detectioncited by 28
- 2023Segment Anything is A Good Pseudo-label Generator for Weakly Supervised Semantic Segmentationcited by 27
- 2021Unsupervised Foreground Extraction via Deep Region Competitioncited by 26
- 2022TransCAM: Transformer Attention-based CAM Refinement for Weakly Supervised Semantic Segmentationcited by 26
- 2022ShapePU: A New PU Learning Framework Regularized by Global Consistency for Scribble Supervised Cardiac Segmentationcited by 26
- 2022Out-of-Candidate Rectification for Weakly Supervised Semantic Segmentationcited by 26
- 2023Semantic Image Segmentation: Two Decades of Researchcited by 26
- 2021Beyond Semantic to Instance Segmentation: Weakly-Supervised Instance Segmentation via Semantic Knowledge Transfer and Self-Refinementcited by 25
- 2023Shatter and Gather: Learning Referring Image Segmentation with Text Supervisioncited by 25
50 most cited of 226 All 226 (JSON)
- 2026Weakly supervised neural network: segmentation of complex structures in X-ray microCT7 Sep 2026
- 2026iSAGE: A Human-in-the-Loop Framework for Remote Sensing Semantic Segmentation via Sparse Point Supervision8 Jun 2026
- 2026ZScribbleSeg: A comprehensive segmentation framework with modeling of efficient annotation and maximization of scribble supervision7 May 2026
- 2026Do Instance Priors Help Weakly Supervised Semantic Segmentation?13 Apr 2026
- 2026Deep Learning-Based Meat Freshness Detection with Segmentation and OOD-Aware Classification27 Feb 2026
- 2025Plasticine: A Traceable Diffusion Model for Medical Image Translation20 Dec 2025
- 2025ST-DETrack: Identity-Preserving Branch Tracking in Entangled Plant Canopies via Dual Spatiotemporal Evidence17 Dec 2025
- 2025WP-CrackNet: A Collaborative Adversarial Learning Framework for End-to-End Weakly-Supervised Road Crack Detection20 Oct 2025
- 2025Split-Fuse-Transport: Annotation-Free Saliency via Dual Clustering and Optimal Transport Alignment20 Oct 2025
- 2025SilvaScenes: Tree Detection and Species Classification from Under-Canopy Images in Natural Forests10 Oct 2025
- 2025Temporal Prompting Matters: Rethinking Referring Video Object Segmentation8 Oct 2025
- 2025Causally Guided Gaussian Perturbations for Out-Of-Distribution Generalization in Medical Imaging30 Sep 2025
38 more
- 2025OmViD: Omni-supervised active learning for video action detection19 Aug 2025
- 2025SeeDiff: Off-the-Shelf Seeded Mask Generation from Diffusion Models26 Jul 2025
- 2025Know Your Attention Maps: Class-specific Token Masking for Weakly Supervised Semantic Segmentation9 Jul 2025
- 2025Prompt learning with bounding box constraints for medical image segmentation3 Jul 2025
- 2025SPARS: Self-Play Adversarial Reinforcement Learning for Segmentation of Liver Tumours25 May 2025
- 2025Flip Learning: Weakly Supervised Erase to Segment Nodules in Breast Ultrasound26 Mar 2025
- 2025Wholly-WOOD: Wholly Leveraging Diversified-quality Labels for Weakly-supervised Oriented Object Detection13 Feb 2025
- 2025Temporal-consistent CAMs for Weakly Supervised Video Segmentation in Waste Sorting3 Feb 2025
- 2024Sli2Vol+: Segmenting 3D Medical Images Based on an Object Estimation Guided Correspondence Flow Network21 Nov 2024
- 2024Free-Mask: A Novel Paradigm of Integration Between the Segmentation Diffusion Model and Image Editing4 Nov 2024
- 2024Learning to Discover Forgery Cues for Face Forgery Detection2 Sep 2024
- 2024Improving Weakly-supervised Video Instance Segmentation by Leveraging Spatio-temporal Consistency29 Aug 2024
- 2024Scribbles for All: Benchmarking Scribble Supervised Segmentation Across Datasets22 Aug 2024
- 2024Detecting Wildfires on UAVs with Real-time Segmentation Trained by Larger Teacher Models19 Aug 2024
- 2024Bayesian Active Learning for Semantic Segmentation3 Aug 2024
- 2024Finding Meaning in Points: Weakly Supervised Semantic Segmentation for Event Cameras15 Jul 2024
- 2024WPS-SAM: Towards Weakly-Supervised Part Segmentation with Foundation Models14 Jul 2024
- 2024Knowledge Transfer with Simulated Inter-Image Erasing for Weakly Supervised Semantic Segmentation3 Jul 2024
- 2024Precision matters: Precision-aware ensemble for weakly supervised semantic segmentation28 Jun 2024
- 2024ALPS: An Auto-Labeling and Pre-training Scheme for Remote Sensing Segmentation With Segment Anything Model16 Jun 2024
- 2024Extreme Point Supervised Instance Segmentation31 May 2024
- 2024Learning to Detour: Shortcut Mitigating Augmentation for Weakly Supervised Semantic Segmentation28 May 2024
- 2024Enhancing Weakly Supervised Semantic Segmentation with Multi-modal Foundation Models: An End-to-End Approach10 May 2024
- 2024PCLMix: Weakly Supervised Medical Image Segmentation via Pixel-Level Contrastive Learning and Dynamic Mix Augmentation10 May 2024
- 2024ToNNO: Tomographic Reconstruction of a Neural Network's Output for Weakly Supervised Segmentation of 3D Medical Images19 Apr 2024
- 2024Tendency-driven Mutual Exclusivity for Weakly Supervised Incremental Semantic Segmentation18 Apr 2024
- 2024Rethinking Saliency-Guided Weakly-Supervised Semantic Segmentation1 Apr 2024
- 2024Pose-Guided Self-Training with Two-Stage Clustering for Unsupervised Landmark Discovery24 Mar 2024
- 2024Boosting Box-supervised Instance Segmentation with Pseudo Depth2 Mar 2024
- 2024Weakly Supervised Co-training with Swapping Assignments for Semantic Segmentation27 Feb 2024
- 2024Scribble Hides Class: Promoting Scribble-Based Weakly-Supervised Semantic Segmentation with Its Class Label27 Feb 2024
- 2024WeakSAM: Segment Anything Meets Weakly-supervised Instance-level Recognition22 Feb 2024
- 2024CoBra: Complementary Branch Fusing Class and Semantic Knowledge for Robust Weakly Supervised Semantic Segmentation5 Feb 2024
- 2024Beyond Strong labels: Weakly-supervised Learning Based on Gaussian Pseudo Labels for The Segmentation of Ellipse-like Vascular Structures in Non-contrast CTs5 Feb 2024
- 2024Deep Spectral Improvement for Unsupervised Image Instance Segmentation4 Feb 2024
- 2024Semantic Prompt Learning for Weakly-Supervised Semantic Segmentation22 Jan 2024
- 2024MetaSeg: Content-Aware Meta-Net for Omni-Supervised Semantic Segmentation22 Jan 2024
- 2024Spatial Structure Constraints for Weakly Supervised Semantic Segmentation20 Jan 2024
50 newest of 226 All 226 (JSON)
- 2023ScribbleGen: Generative Data Augmentation Improves Scribble-supervised Semantic Segmentationcited by 5
- 2025SeeDiff: Off-the-Shelf Seeded Mask Generation from Diffusion Modelscited by 5
- 2024Pose-Guided Self-Training with Two-Stage Clustering for Unsupervised Landmark Discoverycited by 3
- 2024Free-Mask: A Novel Paradigm of Integration Between the Segmentation Diffusion Model and Image Editingcited by 2
- 2025Plasticine: A Traceable Diffusion Model for Medical Image Translationcited by 0
- 2025Plasticine: A Traceable Diffusion Model for Medical Image Translation20 Dec 2025
- 2025SeeDiff: Off-the-Shelf Seeded Mask Generation from Diffusion Models26 Jul 2025
- 2024Free-Mask: A Novel Paradigm of Integration Between the Segmentation Diffusion Model and Image Editing4 Nov 2024
- 2024Pose-Guided Self-Training with Two-Stage Clustering for Unsupervised Landmark Discovery24 Mar 2024
- 2023ScribbleGen: Generative Data Augmentation Improves Scribble-supervised Semantic Segmentation28 Nov 2023
- 2021Unsupervised Semantic Segmentation by Contrasting Object Mask Proposalscited by 190
- 2022Deep Spectral Methods: A Surprisingly Strong Baseline for Unsupervised Semantic Segmentation and Localizationcited by 150
- 2021Anti-Adversarially Manipulated Attributions for Weakly and Semi-Supervised Semantic Segmentationcited by 134
- 2021Railroad is not a Train: Saliency as Pseudo-pixel Supervision for Weakly Supervised Semantic Segmentationcited by 127
- 2022ReCo: Retrieve and Co-segment for Zero-shot Transfercited by 115
- 2021BBAM: Bounding Box Attribution Map for Weakly Supervised Semantic and Instance Segmentationcited by 104
- 2022FreeSOLO: Learning to Segment Objects without Annotationscited by 102
- 2021Non-Salient Region Object Mining for Weakly Supervised Semantic Segmentationcited by 95
- 2021Weakly Supervised Object Localization and Detection: A Surveycited by 84
- 2021Open-Vocabulary Instance Segmentation via Robust Cross-Modal Pseudo-Labelingcited by 84
- 2021Pointly-Supervised Instance Segmentationcited by 83
- 2021Complementary Patch for Weakly Supervised Semantic Segmentationcited by 75
12 most cited of 220 All 220 (JSON)
- 2026Weakly supervised neural network: segmentation of complex structures in X-ray microCT7 Sep 2026
- 2026iSAGE: A Human-in-the-Loop Framework for Remote Sensing Semantic Segmentation via Sparse Point Supervision8 Jun 2026
- 2026ZScribbleSeg: A comprehensive segmentation framework with modeling of efficient annotation and maximization of scribble supervision7 May 2026
- 2026Do Instance Priors Help Weakly Supervised Semantic Segmentation?13 Apr 2026
- 2026Deep Learning-Based Meat Freshness Detection with Segmentation and OOD-Aware Classification27 Feb 2026
- 2025ST-DETrack: Identity-Preserving Branch Tracking in Entangled Plant Canopies via Dual Spatiotemporal Evidence17 Dec 2025
- 2025WP-CrackNet: A Collaborative Adversarial Learning Framework for End-to-End Weakly-Supervised Road Crack Detection20 Oct 2025
- 2025Split-Fuse-Transport: Annotation-Free Saliency via Dual Clustering and Optimal Transport Alignment20 Oct 2025
- 2025SilvaScenes: Tree Detection and Species Classification from Under-Canopy Images in Natural Forests10 Oct 2025
- 2025Temporal Prompting Matters: Rethinking Referring Video Object Segmentation8 Oct 2025
- 2025Causally Guided Gaussian Perturbations for Out-Of-Distribution Generalization in Medical Imaging30 Sep 2025
- 2025OmViD: Omni-supervised active learning for video action detection19 Aug 2025
12 newest of 220 All 220 (JSON)