Weakly- and Semi-Supervised Panoptic Segmentation
Not on the map. Why?
Abstract (arXiv)
We present a weakly supervised model that jointly performs both semantic- and instance-segmentation -- a particularly relevant problem given the substantial cost of obtaining pixel-perfect annotation for these tasks. In contrast to many popular instance segmentation approaches based on object detectors, our method does not predict any overlapping instances. Moreover, we are able to segment both "thing" and "stuff" classes, and thus explain all the pixels in the image. "Thing" classes are weakly-supervised with bounding boxes, and "stuff" with image-level tags. We obtain state-of-the-art results on Pascal VOC, for both full and weak supervision (which achieves about 95% of fully-supervised performance). Furthermore, we present the first weakly-supervised results on Cityscapes for both semantic- and instance-segmentation. Finally, we use our weakly supervised framework to analyse the relationship between annotation quality and predictive performance, which is of interest to dataset creators.
Key facts. Cited by 40 papers in the map (data through 7 Oct 2026). First posted on arXiv 10 Aug 2018.
Builds on
No reference list yet.
Built on by
Citing papers per year: 2021: 17; 2022: 9; 2023: 7; 2024: 3; 2025: 3; 2026: 1.
40 papers.
Sort:
By area:
- 2021Mixed supervision for surface-defect detection: from weakly to fully supervised learningcited by 101
- 2021Adaptive Early-Learning Correction for Segmentation from Noisy Annotationscited by 61
- 2021Bird's-Eye-View Panoptic Segmentation Using Monocular Frontal View Imagescited by 48
- 2021Affinity Attention Graph Neural Network for Weakly Supervised Semantic Segmentationcited by 47
- 2022A Survey on Label-efficient Deep Image Segmentation: Bridging the Gap between Weak Supervision and Dense Predictioncited by 46
- 2021Exemplar-Based Open-Set Panoptic Segmentation Networkcited by 37
- 2021Fully Convolutional Networks for Panoptic Segmentation with Point-based Supervisioncited by 31
- 2023DaTaSeg: Taming a Universal Multi-Dataset Multi-Task Segmentation Modelcited by 30
- 2021Slot-VPS: Object-centric Representation Learning for Video Panoptic Segmentationcited by 24
- 2023Point2Mask: Point-supervised Panoptic Segmentation via Optimal Transportcited by 23
- 2022Pointly-Supervised Panoptic Segmentationcited by 20
- 2021Instance and Panoptic Segmentation Using Conditional Convolutionscited by 19
28 more
- 2021Panoptic Segmentation: A Reviewcited by 18
- 2021Hierarchical Deep Network with Uncertainty-aware Semi-supervised Learning for Vessel Segmentationcited by 15
- 2021Sparse Object-level Supervision for Instance Segmentation with Pixel Embeddingscited by 10
- 2021Combinatorial Optimization for Panoptic Segmentation: A Fully Differentiable Approachcited by 10
- 2021Inferring the Class Conditional Response Map for Weakly Supervised Semantic Segmentationcited by 9
- 2022Adversarial Dual-Student with Differentiable Spatial Warping for Semi-Supervised Semantic Segmentationcited by 9
- 2022Panoptic, Instance and Semantic Relations: A Relational Context Encoder to Enhance Panoptic Segmentationcited by 9
- 2022Multi-task Fusion for Efficient Panoptic-Part Segmentationcited by 6
- 2023Cyclic Learning: Bridging Image-level Labels and Nuclei Instance Segmentationcited by 5
- 2021Hierarchical Lov'asz Embeddings for Proposal-free Panoptic Segmentationcited by 4
- 2024Point-DETR3D: Leveraging Imagery Data with Spatial Point Prior for Weakly Semi-supervised 3D Object Detectioncited by 3
- 2025TRACE: Your Diffusion Model is Secretly an Instance Edge Detectorcited by 3
- 2025DEARLi: Decoupled Enhancement of Recognition and Localization for Semi-supervised Panoptic Segmentationcited by 3
- 2021Weakly Supervised Multi-Object Tracking and Segmentationcited by 2
- 2023Training Semantic Segmentation on Heterogeneous Datasetscited by 2
- 2023JPPF: Multi-task Fusion for Consistent Panoptic-Part Segmentationcited by 2
- 2024MetaSeg: Content-Aware Meta-Net for Omni-Supervised Semantic Segmentationcited by 2
- 2021Visual Boundary Knowledge Translation for Foreground Segmentationcited by 1
- 2021Simpler Does It: Generating Semantic Labels with Objectness Guidancecited by 1
- 2022ConsInstancy: Learning Instance Representations for Semi-Supervised Panoptic Segmentation of Concrete Aggregate Particlescited by 1
- 2023ReFit: A Framework for Refinement of Weakly Supervised Semantic Segmentation using Object Border Fitting for Medical Imagescited by 1
- 2023Towards Omni-supervised Referring Expression Segmentationcited by 1
- 2024MLMT-CNN for Object Detection and Segmentation in Multi-layer and Multi-spectral Imagescited by 1
- 2022Learning with Weak Annotations for Robust Maritime Obstacle Detectioncited by 0
- 2022WUDA: Unsupervised Domain Adaptation Based on Weak Source Domain Labelscited by 0
- 2022Connectivity-constrained Interactive Panoptic Segmentationcited by 0
- 2025Region-CAM: Towards Accurate Object Regions in Class Activation Maps for Weakly Supervised Learning Taskscited by 0
- 2026Example-based Robust Abnormality Detection with Minimal Annotations using Exemplar Med-DETRcited by 0
- 2026Example-based Robust Abnormality Detection with Minimal Annotations using Exemplar Med-DETR25 Aug 2026
- 2025Region-CAM: Towards Accurate Object Regions in Class Activation Maps for Weakly Supervised Learning Tasks29 Oct 2025
- 2025DEARLi: Decoupled Enhancement of Recognition and Localization for Semi-supervised Panoptic Segmentation14 Jul 2025
- 2025TRACE: Your Diffusion Model is Secretly an Instance Edge Detector11 Mar 2025
- 2024MLMT-CNN for Object Detection and Segmentation in Multi-layer and Multi-spectral Images19 Jul 2024
- 2024Point-DETR3D: Leveraging Imagery Data with Spatial Point Prior for Weakly Semi-supervised 3D Object Detection22 Mar 2024
- 2024MetaSeg: Content-Aware Meta-Net for Omni-Supervised Semantic Segmentation22 Jan 2024
- 2023JPPF: Multi-task Fusion for Consistent Panoptic-Part Segmentation30 Nov 2023
- 2023Towards Omni-supervised Referring Expression Segmentation1 Nov 2023
- 2023Point2Mask: Point-supervised Panoptic Segmentation via Optimal Transport3 Aug 2023
- 2023Cyclic Learning: Bridging Image-level Labels and Nuclei Instance Segmentation5 Jun 2023
- 2023DaTaSeg: Taming a Universal Multi-Dataset Multi-Task Segmentation Model2 Jun 2023
28 more
- 2023ReFit: A Framework for Refinement of Weakly Supervised Semantic Segmentation using Object Border Fitting for Medical Images14 Mar 2023
- 2023Training Semantic Segmentation on Heterogeneous Datasets18 Jan 2023
- 2022Multi-task Fusion for Efficient Panoptic-Part Segmentation15 Dec 2022
- 2022Connectivity-constrained Interactive Panoptic Segmentation13 Dec 2022
- 2022Pointly-Supervised Panoptic Segmentation25 Oct 2022
- 2022WUDA: Unsupervised Domain Adaptation Based on Weak Source Domain Labels5 Oct 2022
- 2022A Survey on Label-efficient Deep Image Segmentation: Bridging the Gap between Weak Supervision and Dense Prediction4 Jul 2022
- 2022Learning with Weak Annotations for Robust Maritime Obstacle Detection27 Jun 2022
- 2022Panoptic, Instance and Semantic Relations: A Relational Context Encoder to Enhance Panoptic Segmentation11 Apr 2022
- 2022ConsInstancy: Learning Instance Representations for Semi-Supervised Panoptic Segmentation of Concrete Aggregate Particles10 Apr 2022
- 2022Adversarial Dual-Student with Differentiable Spatial Warping for Semi-Supervised Semantic Segmentation5 Mar 2022
- 2021Slot-VPS: Object-centric Representation Learning for Video Panoptic Segmentation16 Dec 2021
- 2021Panoptic Segmentation: A Review19 Nov 2021
- 2021Inferring the Class Conditional Response Map for Weakly Supervised Semantic Segmentation27 Oct 2021
- 2021Simpler Does It: Generating Semantic Labels with Objectness Guidance20 Oct 2021
- 2021Adaptive Early-Learning Correction for Segmentation from Noisy Annotations7 Oct 2021
- 2021Fully Convolutional Networks for Panoptic Segmentation with Point-based Supervision17 Aug 2021
- 2021Bird's-Eye-View Panoptic Segmentation Using Monocular Frontal View Images6 Aug 2021
- 2021Visual Boundary Knowledge Translation for Foreground Segmentation1 Aug 2021
- 2021Hierarchical Lov'asz Embeddings for Proposal-free Panoptic Segmentation8 Jun 2021
- 2021Affinity Attention Graph Neural Network for Weakly Supervised Semantic Segmentation8 Jun 2021
- 2021Combinatorial Optimization for Panoptic Segmentation: A Fully Differentiable Approach6 Jun 2021
- 2021Hierarchical Deep Network with Uncertainty-aware Semi-supervised Learning for Vessel Segmentation31 May 2021
- 2021Exemplar-Based Open-Set Panoptic Segmentation Network18 May 2021
- 2021Mixed supervision for surface-defect detection: from weakly to fully supervised learning13 Apr 2021
- 2021Sparse Object-level Supervision for Instance Segmentation with Pixel Embeddings26 Mar 2021
- 2021Instance and Panoptic Segmentation Using Conditional Convolutions5 Feb 2021
- 2021Weakly Supervised Multi-Object Tracking and Segmentation3 Jan 2021
- 2021Mixed supervision for surface-defect detection: from weakly to fully supervised learningcited by 101
- 2021Adaptive Early-Learning Correction for Segmentation from Noisy Annotationscited by 61
- 2021Bird's-Eye-View Panoptic Segmentation Using Monocular Frontal View Imagescited by 48
- 2021Affinity Attention Graph Neural Network for Weakly Supervised Semantic Segmentationcited by 47
- 2022A Survey on Label-efficient Deep Image Segmentation: Bridging the Gap between Weak Supervision and Dense Predictioncited by 46
- 2021Exemplar-Based Open-Set Panoptic Segmentation Networkcited by 37
- 2021Fully Convolutional Networks for Panoptic Segmentation with Point-based Supervisioncited by 31
- 2023DaTaSeg: Taming a Universal Multi-Dataset Multi-Task Segmentation Modelcited by 30
- 2021Slot-VPS: Object-centric Representation Learning for Video Panoptic Segmentationcited by 24
- 2023Point2Mask: Point-supervised Panoptic Segmentation via Optimal Transportcited by 23
- 2022Pointly-Supervised Panoptic Segmentationcited by 20
- 2021Instance and Panoptic Segmentation Using Conditional Convolutionscited by 19
12 most cited of 39 All 39 (JSON)
- 2026Example-based Robust Abnormality Detection with Minimal Annotations using Exemplar Med-DETR25 Aug 2026
- 2025Region-CAM: Towards Accurate Object Regions in Class Activation Maps for Weakly Supervised Learning Tasks29 Oct 2025
- 2025DEARLi: Decoupled Enhancement of Recognition and Localization for Semi-supervised Panoptic Segmentation14 Jul 2025
- 2024MLMT-CNN for Object Detection and Segmentation in Multi-layer and Multi-spectral Images19 Jul 2024
- 2024Point-DETR3D: Leveraging Imagery Data with Spatial Point Prior for Weakly Semi-supervised 3D Object Detection22 Mar 2024
- 2024MetaSeg: Content-Aware Meta-Net for Omni-Supervised Semantic Segmentation22 Jan 2024
- 2023JPPF: Multi-task Fusion for Consistent Panoptic-Part Segmentation30 Nov 2023
- 2023Towards Omni-supervised Referring Expression Segmentation1 Nov 2023
- 2023Point2Mask: Point-supervised Panoptic Segmentation via Optimal Transport3 Aug 2023
- 2023Cyclic Learning: Bridging Image-level Labels and Nuclei Instance Segmentation5 Jun 2023
- 2023DaTaSeg: Taming a Universal Multi-Dataset Multi-Task Segmentation Model2 Jun 2023
- 2023ReFit: A Framework for Refinement of Weakly Supervised Semantic Segmentation using Object Border Fitting for Medical Images14 Mar 2023
12 newest of 39 All 39 (JSON)