Deep Watershed Transform for Instance Segmentation
Not on the map. Why?
Abstract (arXiv)
Most contemporary approaches to instance segmentation use complex pipelines involving conditional random fields, recurrent neural networks, object proposals, or template matching schemes. In our paper, we present a simple yet powerful end-to-end convolutional neural network to tackle this task. Our approach combines intuitions from the classical watershed transform and modern deep learning to produce an energy map of the image where object instances are unambiguously represented as basins in the energy map. We then perform a cut at a single energy level to directly yield connected components corresponding to object instances. Our model more than doubles the performance of the state-of-the-art on the challenging Cityscapes Instance Level Segmentation task.
Key facts. Cited by 77 papers in the map (data through 7 Oct 2026). First posted on arXiv 24 Nov 2016.
Builds on
No reference list yet.
Built on by
Citing papers per year: 2021: 31; 2022: 21; 2023: 7; 2024: 5; 2025: 8; 2026: 5.
77 papers.
Sort:
By area:
- 2021Exploring Cross-Image Pixel Contrast for Semantic Segmentationcited by 242
- 2021K-Net: Towards Unified Image Segmentationcited by 211
- 2022RTMDet: An Empirical Study of Designing Real-Time Object Detectorscited by 192
- 2021Hierarchical Aggregation for 3D Instance Segmentationcited by 126
- 2021MSeg: A Composite Dataset for Multi-domain Semantic Segmentationcited by 122
- 2021GENESIS-V2: Inferring Unordered Object Representations without Iterative Refinementcited by 109
- 2021Deep Occlusion-Aware Instance Segmentation with Overlapping BiLayerscited by 104
- 2021Pointly-Supervised Instance Segmentationcited by 83
- 2022CMT-DeepLab: Clustering Mask Transformers for Panoptic Segmentationcited by 60
- 2021DiscoBox: Weakly Supervised Instance Segmentation and Semantic Correspondence from Box Supervisioncited by 59
- 2023Understanding metric-related pitfalls in image analysis validationcited by 57
- 2021Semantics for Robotic Mapping, Perception and Interaction: A Surveycited by 56
38 more
- 2021Incremental Few-Shot Instance Segmentationcited by 49
- 2021Look Closer to Segment Better: Boundary Patch Refinement for Instance Segmentationcited by 43
- 2021LaneAF: Robust Multi-Lane Detection with Affinity Fieldscited by 41
- 2023CLUSTSEG: Clustering for Universal Segmentationcited by 32
- 2022OSFormer: One-Stage Camouflaged Instance Segmentation with Transformerscited by 30
- 2021Instance and Panoptic Segmentation Using Conditional Convolutionscited by 19
- 2021TA-Net: Topology-Aware Network for Gland Segmentationcited by 17
- 2022Learning Equivariant Segmentation with Instance-Unique Queryingcited by 17
- 2021Unknown Object Segmentation from Stereo Imagescited by 16
- 2021A^2-FPN: Attention Aggregation based Feature Pyramid Network for Instance Segmentationcited by 15
- 2022Panoramic Panoptic Segmentation: Insights Into Surrounding Parsing for Mobile Agents via Unsupervised Contrastive Learningcited by 14
- 20213D Instance Segmentation of MVS Buildingscited by 12
- 2022kMaX-DeepLab: k-means Mask Transformercited by 12
- 2021Sparse Object-level Supervision for Instance Segmentation with Pixel Embeddingscited by 10
- 2021VideoClick: Video Object Segmentation with a Single Clickcited by 8
- 2021Unsupervised domain adaptation for clinician pose estimation and instance segmentation in the operating roomcited by 7
- 2022Segmentation in large-scale cellular electron microscopy with deep learning: A literature surveycited by 6
- 2022Beyond mAP: Towards better evaluation of instance segmentationcited by 6
- 2021Semantic Attention and Scale Complementary Network for Instance Segmentation in Remote Sensing Imagescited by 5
- 2021SDTP: Semantic-aware Decoupled Transformer Pyramid for Dense Image Predictioncited by 5
- 2022Occlusion-Aware Instance Segmentation via BiLayer Network Architecturescited by 5
- 2022Instance Segmentation of Dense and Overlapping Objects via Layeringcited by 5
- 2021Combining Deep Learning and Mathematical Morphology for Historical Map Segmentationcited by 4
- 2021BezierSeg: Parametric Shape Representation for Fast Object Segmentation in Medical Imagescited by 4
- 2021Object-Guided Instance Segmentation With Auxiliary Feature Refinement for Biological Imagescited by 3
- 2022Learn Fast, Segment Well: Fast Object Segmentation Learning on the iCub Robotcited by 3
- 2023Structure-Preserving Instance Segmentation via Skeleton-Aware Distance Transformcited by 3
- 2021Enforcing Morphological Information in Fully Convolutional Networks to Improve Cell Instance Segmentation in Fluorescence Microscopy Imagescited by 2
- 2021Split GCN: Effective Interactive Annotation for Segmentation of Disconnected Instancecited by 2
- 2022H-EMD: A Hierarchical Earth Mover's Distance Method for Instance Segmentationcited by 2
- 2022Semantic Segmentation-Assisted Instance Feature Fusion for Multi-Level 3D Part Instance Segmentationcited by 2
- 2024ProtoSeg: A Prototype-Based Point Cloud Instance Segmentation Methodcited by 2
- 2025Pseudo-Label Quality Decoupling and Correction for Semi-Supervised Instance Segmentationcited by 2
- 2025Demeter: A Parametric Model of Crop Plant Morphology from the Real Worldcited by 2
- 2026RL-AWB: Deep Reinforcement Learning for Auto White Balance Correction in Low-Light Night-time Scenescited by 2
- 2026Breaking the Resource Wall: Geometry-Guided Sequence Modeling for Efficient Semantic Segmentationcited by 2
- 2022Automated processing of X-ray computed tomography images via panoptic segmentation for modeling woven composite textilescited by 1
- 2022ConsInstancy: Learning Instance Representations for Semi-Supervised Panoptic Segmentation of Concrete Aggregate Particlescited by 1
50 most cited of 77 All 77 (JSON)
- 2026From Reconstruction to Interpretation: Zero-Setup Multi-Phase Segmentation of X-ray Tomography Data13 Jul 2026
- 2026Boundary-by-Mask: Few-Shot Instance Segmentation with Mask-Conditioned Boundary Learning for Texture-Poor Industrial Parts19 Jun 2026
- 2026Breaking the Resource Wall: Geometry-Guided Sequence Modeling for Efficient Semantic Segmentation25 Apr 2026
- 2026Exclusivity-Guided Mask Learning for Semi-Supervised Crowd Instance Segmentation and Counting17 Mar 2026
- 2026RL-AWB: Deep Reinforcement Learning for Auto White Balance Correction in Low-Light Night-time Scenes8 Jan 2026
- 2025From Instance Segmentation to 3D Growth Trajectory Reconstruction in Planktonic Foraminifera4 Nov 2025
- 2025Demeter: A Parametric Model of Crop Plant Morphology from the Real World18 Oct 2025
- 2025Sketchpose: Learning to Segment Cells with Partial Annotations25 Aug 2025
- 2025Self-Validated Learning for Particle Separation: A Correctness-Based Self-Training Framework Without Human Labels22 Aug 2025
- 2025GEPAR3D: Geometry Prior-Assisted Learning for 3D Tooth Segmentation31 Jul 2025
- 2025CarboFormer: A Lightweight Semantic Segmentation Architecture for Efficient Carbon Dioxide Detection Using Optical Gas Imaging23 May 2025
- 2025Pseudo-Label Quality Decoupling and Correction for Semi-Supervised Instance Segmentation16 May 2025
38 more
- 2025Occlusion-Ordered Semantic Instance Segmentation18 Apr 2025
- 2024RailYolact -- A Yolact Focused on edge for Real-Time Rail Segmentation12 Oct 2024
- 2024Bayesian Fusion of Active Contour Models and ConvNet Priors for Standing Dead Tree Segmentation9 Oct 2024
- 2024ProtoSeg: A Prototype-Based Point Cloud Instance Segmentation Method3 Oct 2024
- 2024A Bottom-Up Approach to Class-Agnostic Image Segmentation20 Sep 2024
- 2024Optimizing Contrail Detection: A Deep Learning Approach with EfficientNet-b4 Encoding20 Apr 2024
- 2023Deep-Learning-Assisted Analysis of Cataract Surgery Videos10 Dec 2023
- 2023Structure-Preserving Instance Segmentation via Skeleton-Aware Distance Transform8 Oct 2023
- 2023Incremental Learning on Food Instance Segmentation28 Jun 2023
- 2023CLUSTSEG: Clustering for Universal Segmentation3 May 2023
- 2023Distributional Instance Segmentation: Modeling Uncertainty and High Confidence Predictions with Latent-MaskRCNN3 May 2023
- 2023PhagoStat a scalable and interpretable end to end framework for efficient quantification of cell phagocytosis in neurodegenerative disease studies26 Apr 2023
- 2023Understanding metric-related pitfalls in image analysis validation3 Feb 2023
- 2022RTMDet: An Empirical Study of Designing Real-Time Object Detectors14 Dec 2022
- 2022Instance Segmentation with Cross-Modal Consistency14 Oct 2022
- 2022Instance Segmentation of Dense and Overlapping Objects via Layering7 Oct 2022
- 2022Learning Equivariant Segmentation with Instance-Unique Querying3 Oct 2022
- 2022Semantic Segmentation-Assisted Instance Feature Fusion for Multi-Level 3D Part Instance Segmentation9 Aug 2022
- 2022Occlusion-Aware Instance Segmentation via BiLayer Network Architectures8 Aug 2022
- 2022Training a universal instance segmentation network for live cell images of various cell types and imaging modalities28 Jul 2022
- 2022BuyTheDips: PathLoss for improved topology-preserving deep learning-based image segmentation23 Jul 2022
- 2022YOLO2U-Net: Detection-Guided 3D Instance Segmentation for Microscopy13 Jul 2022
- 2022kMaX-DeepLab: k-means Mask Transformer8 Jul 2022
- 2022OSFormer: One-Stage Camouflaged Instance Segmentation with Transformers5 Jul 2022
- 2022Beyond mAP: Towards better evaluation of instance segmentation4 Jul 2022
- 2022Primitive Graph Learning for Unified Vector Mapping28 Jun 2022
- 2022Learn Fast, Segment Well: Fast Object Segmentation Learning on the iCub Robot27 Jun 2022
- 2022Panoramic Panoptic Segmentation: Insights Into Surrounding Parsing for Mobile Agents via Unsupervised Contrastive Learning21 Jun 2022
- 2022CMT-DeepLab: Clustering Mask Transformers for Panoptic Segmentation17 Jun 2022
- 2022Segmentation in large-scale cellular electron microscopy with deep learning: A literature survey14 Jun 2022
- 2022H-EMD: A Hierarchical Earth Mover's Distance Method for Instance Segmentation2 Jun 2022
- 2022ConsInstancy: Learning Instance Representations for Semi-Supervised Panoptic Segmentation of Concrete Aggregate Particles10 Apr 2022
- 2022Automated processing of X-ray computed tomography images via panoptic segmentation for modeling woven composite textiles2 Feb 2022
- 2022Semi-supervised Identification and Mapping of Surface Water Extent using Street-level Monitoring Videos31 Jan 2022
- 2021MSeg: A Composite Dataset for Multi-domain Semantic Segmentation27 Dec 2021
- 20213D Instance Segmentation of MVS Buildings18 Dec 2021
- 2021Split GCN: Effective Interactive Annotation for Segmentation of Disconnected Instance13 Dec 2021
- 2021TA-Net: Topology-Aware Network for Gland Segmentation27 Oct 2021
50 newest of 77 All 77 (JSON)
- 2021Exploring Cross-Image Pixel Contrast for Semantic Segmentationcited by 242
- 2021K-Net: Towards Unified Image Segmentationcited by 211
- 2022RTMDet: An Empirical Study of Designing Real-Time Object Detectorscited by 192
- 2021Hierarchical Aggregation for 3D Instance Segmentationcited by 126
- 2021MSeg: A Composite Dataset for Multi-domain Semantic Segmentationcited by 122
- 2021GENESIS-V2: Inferring Unordered Object Representations without Iterative Refinementcited by 109
- 2021Deep Occlusion-Aware Instance Segmentation with Overlapping BiLayerscited by 104
- 2021Pointly-Supervised Instance Segmentationcited by 83
- 2022CMT-DeepLab: Clustering Mask Transformers for Panoptic Segmentationcited by 60
- 2021DiscoBox: Weakly Supervised Instance Segmentation and Semantic Correspondence from Box Supervisioncited by 59
- 2023Understanding metric-related pitfalls in image analysis validationcited by 57
- 2021Semantics for Robotic Mapping, Perception and Interaction: A Surveycited by 56
12 most cited of 76 All 76 (JSON)
- 2026From Reconstruction to Interpretation: Zero-Setup Multi-Phase Segmentation of X-ray Tomography Data13 Jul 2026
- 2026Boundary-by-Mask: Few-Shot Instance Segmentation with Mask-Conditioned Boundary Learning for Texture-Poor Industrial Parts19 Jun 2026
- 2026Exclusivity-Guided Mask Learning for Semi-Supervised Crowd Instance Segmentation and Counting17 Mar 2026
- 2026RL-AWB: Deep Reinforcement Learning for Auto White Balance Correction in Low-Light Night-time Scenes8 Jan 2026
- 2025From Instance Segmentation to 3D Growth Trajectory Reconstruction in Planktonic Foraminifera4 Nov 2025
- 2025Demeter: A Parametric Model of Crop Plant Morphology from the Real World18 Oct 2025
- 2025Sketchpose: Learning to Segment Cells with Partial Annotations25 Aug 2025
- 2025Self-Validated Learning for Particle Separation: A Correctness-Based Self-Training Framework Without Human Labels22 Aug 2025
- 2025GEPAR3D: Geometry Prior-Assisted Learning for 3D Tooth Segmentation31 Jul 2025
- 2025CarboFormer: A Lightweight Semantic Segmentation Architecture for Efficient Carbon Dioxide Detection Using Optical Gas Imaging23 May 2025
- 2025Pseudo-Label Quality Decoupling and Correction for Semi-Supervised Instance Segmentation16 May 2025
- 2025Occlusion-Ordered Semantic Instance Segmentation18 Apr 2025
12 newest of 76 All 76 (JSON)