What's the Point: Semantic Segmentation with Point Supervision
Not on the map. Why?
Abstract (arXiv)
The semantic image segmentation task presents a trade-off between test time accuracy and training-time annotation cost. Detailed per-pixel annotations enable training accurate models but are very time-consuming to obtain, image-level class labels are an order of magnitude cheaper but result in less accurate models. We take a natural step from image-level annotation towards stronger supervision: we ask annotators to point to an object if one exists. We incorporate this point supervision along with a novel objectness potential in the training loss function of a CNN model. Experimental results on the PASCAL VOC 2012 benchmark reveal that the combined effect of point-level supervision and objectness potential yields an improvement of 12.9% mIOU over image-level supervision. Further, we demonstrate that models trained with point-level supervision are more accurate than models trained with image-level, squiggle-level or full supervision given a fixed annotation budget.
Key facts. Cited by 298 papers in the map (data through 14 Oct 2026). First posted on arXiv 6 Jun 2015.
Builds on
No reference list yet.
Built on by
Citing papers per year: 2021: 73; 2022: 72; 2023: 73; 2024: 43; 2025: 17; 2026: 20.
298 papers.
Sort:
By area:
- 2021Unsupervised Semantic Segmentation by Contrasting Object Mask Proposalscited by 190
- 2021Anti-Adversarially Manipulated Attributions for Weakly and Semi-Supervised Semantic Segmentationcited by 134
- 2022CLIP is Also an Efficient Segmenter: A Text-Driven Approach for Weakly Supervised Semantic Segmentationcited by 118
- 2022ReCo: Retrieve and Co-segment for Zero-shot Transfercited by 117
- 2021BBAM: Bounding Box Attribution Map for Weakly Supervised Semantic and Instance Segmentationcited by 105
- 2021Mixed supervision for surface-defect detection: from weakly to fully supervised learningcited by 101
- 2021Non-Salient Region Object Mining for Weakly Supervised Semantic Segmentationcited by 95
- 2021One Thing One Click: A Self-Training Approach for Weakly Supervised 3D Semantic Segmentationcited by 89
- 2022Self-supervised Image-specific Prototype Exploration for Weakly Supervised Semantic Segmentationcited by 87
- 2021Weakly Supervised Semantic Segmentation by Pixel-to-Prototype Contrastcited by 85
- 2021Open-Vocabulary Instance Segmentation via Robust Cross-Modal Pseudo-Labelingcited by 84
- 2021Pointly-Supervised Instance Segmentationcited by 83
38 more
- 2021Complementary Patch for Weakly Supervised Semantic Segmentationcited by 75
- 2022Cross Language Image Matching for Weakly Supervised Semantic Segmentationcited by 72
- 2021Context Decoupling Augmentation for Weakly Supervised Semantic Segmentationcited by 69
- 2023Token Contrast for Weakly-Supervised Semantic Segmentationcited by 65
- 2022Regional Semantic Contrast and Aggregation for Weakly Supervised Semantic Segmentationcited by 64
- 2021Points as Queries: Weakly Semi-supervised Object Detection by Pointscited by 60
- 2021DiscoBox: Weakly Supervised Instance Segmentation and Semantic Correspondence from Box Supervisioncited by 59
- 2022Weakly Supervised Semantic Segmentation using Out-of-Distribution Datacited by 58
- 2021A Closer Look at Self-training for Zero-Label Semantic Segmentationcited by 57
- 2022L2G: A Simple Local-to-Global Knowledge Transfer Framework for Weakly Supervised Semantic Segmentationcited by 57
- 2022Discovering Object Masks with Transformers for Unsupervised Semantic Segmentationcited by 54
- 2022Unsupervised Semantic Segmentation with Self-supervised Object-centric Representationscited by 54
- 2023Segment Anything Model (SAM) Enhanced Pseudo Labels for Weakly Supervised Semantic Segmentationcited by 53
- 2023Mapping Degeneration Meets Label Evolution: Learning Infrared Small Target Detection with Single Point Supervisioncited by 51
- 2021Temporal Action Segmentation from Timestamp Supervisioncited by 48
- 2021Pseudo-mask Matters in Weakly-supervised Semantic Segmentationcited by 48
- 2021Affinity Attention Graph Neural Network for Weakly Supervised Semantic Segmentationcited by 47
- 2022Tree Energy Loss: Towards Sparsely Annotated Semantic Segmentationcited by 47
- 2021Universal Weakly Supervised Segmentation by Pixel-to-Segment Contrastive Learningcited by 43
- 2021Multi-Layer Pseudo-Supervision for Histopathology Tissue Semantic Segmentation using Patch-level Classification Labelscited by 43
- 2021Learning Action Completeness from Points for Weakly-supervised Temporal Action Localizationcited by 42
- 2021Background-Aware Pooling and Noise-Aware Loss for Weakly-Supervised Semantic Segmentationcited by 41
- 2023CLIP in Medical Imaging: A Surveycited by 40
- 2021Unsupervised Discovery of the Long-Tail in Instance Segmentation Using Hierarchical Self-Supervisioncited by 39
- 2021Incremental Learning in Semantic Segmentation from Image Labelscited by 39
- 2021Every Annotation Counts: Multi-label Deep Supervision for Medical Image Segmentationcited by 37
- 2022Expansion and Shrinkage of Localization for Weakly-Supervised Semantic Segmentationcited by 37
- 2021All you need are a few pixels: semantic segmentation with PixelPickcited by 31
- 2021Fully Convolutional Networks for Panoptic Segmentation with Point-based Supervisioncited by 31
- 2021Semantic Segmentation of Remote Sensing Images with Sparse Annotationscited by 30
- 2021Uncertainty Estimation via Response Scaling for Pseudo-mask Noise Mitigation in Weakly-supervised Semantic Segmentationcited by 29
- 2021Activation Modulation and Recalibration Scheme for Weakly Supervised Semantic Segmentationcited by 29
- 2022Omni-DETR: Omni-Supervised Object Detection with Transformerscited by 29
- 2023Logic-induced Diagnostic Reasoning for Semi-supervised Semantic Segmentationcited by 29
- 2024EarthMarker: A Visual Prompting Multi-modal Large Language Model for Remote Sensingcited by 29
- 2023Segment Anything is A Good Pseudo-label Generator for Weakly Supervised Semantic Segmentationcited by 27
- 2021Beyond Semantic to Instance Segmentation: Weakly-Supervised Instance Segmentation via Semantic Knowledge Transfer and Self-Refinementcited by 26
- 2022TransCAM: Transformer Attention-based CAM Refinement for Weakly Supervised Semantic Segmentationcited by 26
50 most cited of 298 All 298 (JSON)
- 2026Hybrid supervised instance segmentation by learning label noise suppression14 Oct 2026
- 2026Boundary Voting Network for Ambiguity-Aware Timestamp-Supervised Action Segmentation8 Sep 2026
- 2026Weakly supervised neural network: segmentation of complex structures in X-ray microCT7 Sep 2026
- 2026GazeRefine: Expert Gaze as a Test-Time Prompt for Training-Free Medical Image Segmentation1 Sep 2026
- 2026OBBSeg: Irregular Lesion Segmentation under Oriented Bounding Box Annotations7 Jul 2026
- 2026APRIL-MedSeg: A Modular Medical Image Segmentation Toolbox Embracing Modern Paradigms29 Jun 2026
- 2026PS-MOT: Cultivating Instance Awareness from Point Seeds for Multi-Object Tracking29 Jun 2026
- 2026iSAGE: A Human-in-the-Loop Framework for Remote Sensing Semantic Segmentation via Sparse Point Supervision8 Jun 2026
- 2026Weakly Supervised Camouflaged Object Detection Based on the SAM Model and Mask Guidance25 May 2026
- 2026PrAda: Few-Shot Visual Adaptation for Text-Prompted Segmentation19 May 2026
- 2026Multi-task learning on partially labeled datasets via invariant/equivariant semi-supervised learning17 May 2026
- 2026DiCLIP: Diffusion Model Enhances CLIP's Dense Knowledge for Weakly Supervised Semantic Segmentation6 May 2026
38 more
- 2026HOI-aware Adaptive Network for Weakly-supervised Action Segmentation29 Apr 2026
- 2026Do Instance Priors Help Weakly Supervised Semantic Segmentation?13 Apr 2026
- 2026Clore: Interactive Pathology Image Segmentation with Click-based Local Refinement29 Mar 2026
- 2026Causal Attribution via Activation Patching13 Mar 2026
- 2026PLESS: Pseudo-Label Enhancement with Spreading Scribbles for Weakly Supervised Segmentation12 Feb 2026
- 2026PANC: Prior-Aware Normalized Cut via Anchor-Augmented Token Graphs6 Feb 2026
- 2026Dynamic High-frequency Convolution for Infrared Small Target Detection3 Feb 2026
- 2026DExTeR: Weakly Semi-Supervised Object Detection with Class and Instance Experts for Medical Imaging20 Jan 2026
- 2025FishDetector-R1: Unified MLLM-Based Framework with Reinforcement Fine-Tuning for Weakly Supervised Fish Detection, Segmentation, and Counting1 Dec 2025
- 2025SSR: Semantic and Spatial Rectification for CLIP-based Weakly Supervised Segmentation1 Dec 2025
- 2025ReSAM: Refine, Requery, and Reinforce: Self-Prompting Point-Supervised Segmentation for Remote Sensing Images26 Nov 2025
- 2025EmoVerse: A MLLMs-Driven Emotion Representation Dataset for Interpretable Visual Emotion Analysis16 Nov 2025
- 2025LC-SLab -- An object-based deep learning framework for large-scale land cover classification from satellite imagery and sparse in-situ labels19 Sep 2025
- 2025Mixture of Experts Guided by Gaussian Splatters Matters: A new Approach to Weakly-Supervised Video Anomaly Detection8 Aug 2025
- 2025DisFaceRep: Representation Disentanglement for Co-occurring Facial Components in Weakly Supervised Face Parsing2 Aug 2025
- 2025Diffusion-Guided Knowledge Distillation for Weakly-Supervised Low-Light Semantic Segmentation10 Jul 2025
- 2025Prompt learning with bounding box constraints for medical image segmentation3 Jul 2025
- 2025Probing Deep into Temporal Profile Makes the Infrared Small Target Detector Much Better15 Jun 2025
- 2025FMaMIL: Frequency-Driven Mamba Multi-Instance Learning for Weakly Supervised Lesion Segmentation in Medical Images9 Jun 2025
- 2025The Missing Point in Vision Transformers for Universal Image Segmentation26 May 2025
- 2025Exploring CLIP's Dense Knowledge for Weakly Supervised Semantic Segmentation26 Mar 2025
- 2025DOEI: Dual Optimization of Embedding Information for Attention-Enhanced Class Activation Maps21 Feb 2025
- 2025Wholly-WOOD: Wholly Leveraging Diversified-quality Labels for Weakly-supervised Oriented Object Detection13 Feb 2025
- 2025SketchYourSeg: Mask-Free Subjective Image Segmentation via Freehand Sketches27 Jan 2025
- 2025PointOBB-v3: Expanding Performance Boundaries of Single Point-Supervised Oriented Object Detection23 Jan 2025
- 2024HisynSeg: Weakly-Supervised Histopathological Image Segmentation via Image-Mixing Synthesis and Consistency Regularization30 Dec 2024
- 2024Unlocking the Potential of Weakly Labeled Data: A Co-Evolutionary Learning Framework for Abnormality Detection and Report Generation18 Dec 2024
- 2024From Easy to Hard: Progressive Active Learning Framework for Infrared Small Target Detection with Single Point Supervision15 Dec 2024
- 2024MoRe: Class Patch Attention Needs Regularization for Weakly Supervised Semantic Segmentation15 Dec 2024
- 2024PGRID: Power Grid Reconstruction in Informal Developments Using High-Resolution Aerial Imagery10 Dec 2024
- 2024Active Learning with Context Sampling and One-vs-Rest Entropy for Semantic Segmentation9 Dec 2024
- 2024SP 3 : Superpixel-propagated pseudo-label learning for weakly semi-supervised medical image segmentation18 Nov 2024
- 2024Free-Mask: A Novel Paradigm of Integration Between the Segmentation Diffusion Model and Image Editing4 Nov 2024
- 2024RClicks: Realistic Click Simulation for Benchmarking Interactive Segmentation15 Oct 2024
- 2024PointSAM: Pointly-Supervised Segment Anything Model for Remote Sensing Images20 Sep 2024
- 2024Hybrid Mask Generation for Infrared Small Target Detection with Single-Point Supervision6 Sep 2024
- 2024Scribbles for All: Benchmarking Scribble Supervised Segmentation Across Datasets22 Aug 2024
- 2024Bayesian Active Learning for Semantic Segmentation3 Aug 2024
50 newest of 298 All 298 (JSON)
- 2023The Big Data Myth: Using Diffusion Models for Dataset Generation to Train Deep Detection Modelscited by 7
- 2023ScribbleGen: Generative Data Augmentation Improves Scribble-supervised Semantic Segmentationcited by 5
- 2024Free-Mask: A Novel Paradigm of Integration Between the Segmentation Diffusion Model and Image Editingcited by 2
- 2026DiCLIP: Diffusion Model Enhances CLIP's Dense Knowledge for Weakly Supervised Semantic Segmentationcited by 0
- 2026DiCLIP: Diffusion Model Enhances CLIP's Dense Knowledge for Weakly Supervised Semantic Segmentation6 May 2026
- 2024Free-Mask: A Novel Paradigm of Integration Between the Segmentation Diffusion Model and Image Editing4 Nov 2024
- 2023ScribbleGen: Generative Data Augmentation Improves Scribble-supervised Semantic Segmentation28 Nov 2023
- 2023The Big Data Myth: Using Diffusion Models for Dataset Generation to Train Deep Detection Models16 Jun 2023
- 2021MUM : Mix Image Tiles and UnMix Feature Tiles for Semi-Supervised Object Detectioncited by 21
- 2021Weakly Supervised Semantic Segmentation via Alternative Self-Dual Teachingcited by 19
- 2021Seminar Learning for Click-Level Weakly Supervised Semantic Segmentationcited by 14
- 2021WeClick: Weakly-Supervised Video Semantic Segmentation with Click Annotationscited by 4
- 2021Weakly Supervised Semantic Segmentation via Alternative Self-Dual Teaching17 Dec 2021
- 2021MUM : Mix Image Tiles and UnMix Feature Tiles for Semi-Supervised Object Detection22 Nov 2021
- 2021Seminar Learning for Click-Level Weakly Supervised Semantic Segmentation30 Aug 2021
- 2021WeClick: Weakly-Supervised Video Semantic Segmentation with Click Annotations7 Jul 2021
- 2026Causal Attribution via Activation Patchingcited by 2
- 2026Causal Attribution via Activation Patching13 Mar 2026
- 2021Unsupervised Semantic Segmentation by Contrasting Object Mask Proposalscited by 190
- 2021Anti-Adversarially Manipulated Attributions for Weakly and Semi-Supervised Semantic Segmentationcited by 134
- 2022CLIP is Also an Efficient Segmenter: A Text-Driven Approach for Weakly Supervised Semantic Segmentationcited by 118
- 2022ReCo: Retrieve and Co-segment for Zero-shot Transfercited by 117
- 2021BBAM: Bounding Box Attribution Map for Weakly Supervised Semantic and Instance Segmentationcited by 105
- 2021Mixed supervision for surface-defect detection: from weakly to fully supervised learningcited by 101
- 2021Non-Salient Region Object Mining for Weakly Supervised Semantic Segmentationcited by 95
- 2021One Thing One Click: A Self-Training Approach for Weakly Supervised 3D Semantic Segmentationcited by 89
- 2022Self-supervised Image-specific Prototype Exploration for Weakly Supervised Semantic Segmentationcited by 87
- 2021Weakly Supervised Semantic Segmentation by Pixel-to-Prototype Contrastcited by 85
- 2021Open-Vocabulary Instance Segmentation via Robust Cross-Modal Pseudo-Labelingcited by 84
- 2021Pointly-Supervised Instance Segmentationcited by 83
12 most cited of 285 All 285 (JSON)
- 2026Hybrid supervised instance segmentation by learning label noise suppression14 Oct 2026
- 2026Boundary Voting Network for Ambiguity-Aware Timestamp-Supervised Action Segmentation8 Sep 2026
- 2026Weakly supervised neural network: segmentation of complex structures in X-ray microCT7 Sep 2026
- 2026GazeRefine: Expert Gaze as a Test-Time Prompt for Training-Free Medical Image Segmentation1 Sep 2026
- 2026OBBSeg: Irregular Lesion Segmentation under Oriented Bounding Box Annotations7 Jul 2026
- 2026APRIL-MedSeg: A Modular Medical Image Segmentation Toolbox Embracing Modern Paradigms29 Jun 2026
- 2026PS-MOT: Cultivating Instance Awareness from Point Seeds for Multi-Object Tracking29 Jun 2026
- 2026iSAGE: A Human-in-the-Loop Framework for Remote Sensing Semantic Segmentation via Sparse Point Supervision8 Jun 2026
- 2026Weakly Supervised Camouflaged Object Detection Based on the SAM Model and Mask Guidance25 May 2026
- 2026PrAda: Few-Shot Visual Adaptation for Text-Prompted Segmentation19 May 2026
- 2026Multi-task learning on partially labeled datasets via invariant/equivariant semi-supervised learning17 May 2026
- 2026HOI-aware Adaptive Network for Weakly-supervised Action Segmentation29 Apr 2026
12 newest of 285 All 285 (JSON)