A Survey on Instance Segmentation: State of the art
Not on the map. Why?
Abstract (arXiv)
Object detection or localization is an incremental step in progression from coarse to fine digital image inference. It not only provides the classes of the image objects, but also provides the location of the image objects which have been classified. The location is given in the form of bounding boxes or centroids. Semantic segmentation gives fine inference by predicting labels for every pixel in the input image. Each pixel is labelled according to the object class within which it is enclosed. Furthering this evolution, instance segmentation gives different labels for separate instances of objects belonging to the same class. Hence, instance segmentation may be defined as the technique of simultaneously solving the problem of object detection as well as that of semantic segmentation. In this survey paper on instance segmentation -- its background, issues, techniques, evolution, popular datasets, related work up to the state of the art and future scope have been discussed. The paper provides valuable information for those who want to do research in the field of instance segmentation.
Key facts. Cited by 85 papers in the map (data through 7 Oct 2026). First posted on arXiv 28 Jun 2020.
Builds on
No reference list yet.
Built on by
Citing papers per year: 2021: 12; 2022: 13; 2023: 14; 2024: 24; 2025: 19; 2026: 3.
85 papers.
Sort:
By area:
- 2022Generalized Decoding for Pixel, Image, and Languagecited by 292
- 2023RSPrompter: Learning to Prompt for Remote Sensing Instance Segmentation based on Visual Foundation Modelcited by 180
- 2021NeSF: Neural Semantic Fields for Generalizable Semantic Segmentation of 3D Scenescited by 119
- 2025Ovis-U1 Technical Reportcited by 65
- 2023A Comprehensive Survey on Segment Anything Model for Vision and Beyondcited by 64
- 2022X-Paste: Revisiting Scalable Copy-Paste for Instance Segmentation using CLIP and StableDiffusioncited by 49
- 2021On Model Calibration for Long-Tailed Object Detection and Instance Segmentationcited by 39
- 2024SAGD: Boundary-Enhanced Segment Anything in 3D Gaussian via Gaussian Decompositioncited by 29
- 2024ObjectRelator: Enabling Cross-View Object Relation Understanding Across Ego-Centric and Exo-Centric Perspectivescited by 26
- 2023OmniTracker: Unifying Object Tracking by Tracking-with-Detectioncited by 19
- 2023FoodSAM: Any Food Segmentationcited by 19
- 2023Comparing YOLOv8 and Mask R-CNN for instance segmentation in complex orchard environmentscited by 14
38 more
- 2024Continual All-in-One Adverse Weather Removal with Knowledge Replay on a Unified Network Structurecited by 13
- 2025SAM2 for Image and Video Segmentation: A Comprehensive Surveycited by 13
- 2023MMSFormer: Multimodal Transformer for Material and Semantic Segmentationcited by 12
- 2025Reasoning Segmentation for Images and Videos: A Surveycited by 12
- 2021Dimensions of Motion: Monocular Prediction through Flow Subspacescited by 10
- 2024A Simple Background Augmentation Method for Object Detection with Diffusion Modelcited by 9
- 2025AMSnet 2.0: A Large AMS Database with AI Segmentation for Net Detectioncited by 9
- 2021Attention mechanisms and deep learning for machine vision: A survey of the state of the artcited by 8
- 2023SSR-2D: Semantic 3D Scene Reconstruction from 2D Imagescited by 7
- 2024A Refreshed Similarity-based Upsampler for Direct High-Ratio Feature Upsamplingcited by 7
- 2025Acknowledging Focus Ambiguity in Visual Questionscited by 7
- 2023AIMS: All-Inclusive Multi-Level Segmentationcited by 6
- 2024Semi-Self-Supervised Domain Adaptation: Developing Deep Learning Models with Limited Annotated Data for Wheat Head Segmentationcited by 5
- 2024From Pixels to Tokens: Revisiting Object Hallucinations in Large Vision-Language Modelscited by 5
- 2024Zero-Shot Automatic Annotation and Instance Segmentation using LLM-Generated Datasets: Eliminating Field Imaging and Manual Annotation for Deep Learning Model Developmentcited by 5
- 2025Advancing Marine Research: UWSAM Framework and UIIS10K Dataset for Precise Underwater Instance Segmentationcited by 5
- 2021Highdicom: A Python library for standardized encoding of image annotations and machine learning model outputs in pathology and radiologycited by 4
- 2022Large-batch Optimization for Dense Visual Predictionscited by 4
- 2022Data-driven Science and Machine Learning Methods in Laser-Plasma Physicscited by 4
- 2022EM-Paste: EM-guided Cut-Paste with DALL-E Augmentation for Image-level Weakly Supervised Instance Segmentationcited by 4
- 2022SupeRGB-D: Zero-shot Instance Segmentation in Cluttered Indoor Environmentscited by 4
- 2024DynaSeg: A Deep Dynamic Fusion Method for Unsupervised Image Segmentation Incorporating Feature Similarity and Spatial Continuitycited by 4
- 2024PTQ4RIS: Post-Training Quantization for Referring Image Segmentationcited by 4
- 2023TAU: A Framework for Video-Based Traffic Analytics Leveraging Artificial Intelligence and Unmanned Aerial Systemscited by 3
- 2024The Paradox of Motion: Evidence for Spurious Correlations in Skeleton-based Gait Recognition Modelscited by 3
- 2024A Simple and Generalist Approach for Panoptic Segmentationcited by 3
- 2024SAMIC: Segment Anything with In-Context Spatial Prompt Engineeringcited by 3
- 2022Semantic Segmentation-Assisted Instance Feature Fusion for Multi-Level 3D Part Instance Segmentationcited by 2
- 2022An annotated instance segmentation XXL-CT data-set from a historic airplanecited by 2
- 2024GMT: Guided Mask Transformer for Leaf Instance Segmentationcited by 2
- 2025MaSS13K: A Matting-level Semantic Segmentation Benchmarkcited by 2
- 2025DOMR: Establishing Cross-View Segmentation via Dense Object Matchingcited by 2
- 2026TSBOW -- Traffic Surveillance Benchmark for Occluded Vehicles Under Various Weather Conditionscited by 2
- 2026VGGT-Segmentor: Geometry-Enhanced Cross-View Segmentationcited by 2
- 2021Application of Computer Vision and Machine Learning for Digitized Herbarium Specimens: A Systematic Literature Reviewcited by 1
- 2021InSeGAN: A Generative Approach to Segmenting Identical Instances in Depth Imagescited by 1
- 2021On Cropped versus Uncropped Training Sets in Tabular Structure Detectioncited by 1
- 2021Bounding Box-Free Instance Segmentation Using Semi-Supervised Learning for Generating a City-Scale Vehicle Datasetcited by 1
50 most cited of 85 All 85 (JSON)
- 2026Optimizing YOLO27, YOLO26, YOLO11, and YOLOv8 for Fine-Grained Small-Object Detection and Segmentation in Complex Orchard Environments23 Aug 2026
- 2026VGGT-Segmentor: Geometry-Enhanced Cross-View Segmentation15 Apr 2026
- 2026TSBOW -- Traffic Surveillance Benchmark for Occluded Vehicles Under Various Weather Conditions5 Feb 2026
- 2025Break Out the Silverware -- Semantic Understanding of Stored Household Items25 Dec 2025
- 2025Ideal Observer for Segmentation of Dead Leaves Images5 Dec 2025
- 2025From Instance Segmentation to 3D Growth Trajectory Reconstruction in Planktonic Foraminifera4 Nov 2025
- 2025Focal Modulation and Bidirectional Feature Fusion Network for Medical Image Segmentation23 Oct 2025
- 2025Do Superpixel Segmentation Methods Influence Deforestation Image Classification?6 Oct 2025
- 2025Multimodal SAM-adapter for Semantic Segmentation12 Sep 2025
- 2025Deep Learning-based Scalable Image-to-3D Facade Parser for Generating Thermal 3D Building Models6 Aug 2025
- 2025DOMR: Establishing Cross-View Segmentation via Dense Object Matching6 Aug 2025
- 2025Ovis-U1 Technical Report29 Jun 2025
38 more
- 2025Reasoning Segmentation for Images and Videos: A Survey24 May 2025
- 2025Advancing Marine Research: UWSAM Framework and UIIS10K Dataset for Precise Underwater Instance Segmentation21 May 2025
- 2025AMSnet 2.0: A Large AMS Database with AI Segmentation for Net Detection14 May 2025
- 2025Back to Fundamentals: Low-Level Visual Features Guided Progressive Token Pruning25 Apr 2025
- 2025Semantic segmentation for building houses from wooden cubes28 Mar 2025
- 2025MaSS13K: A Matting-level Semantic Segmentation Benchmark24 Mar 2025
- 2025SAM2 for Image and Video Segmentation: A Comprehensive Survey17 Mar 2025
- 2025On the use of neural networks for the structural characterization of polymeric porous materials25 Jan 2025
- 2025Static Segmentation by Tracking: A Label-Efficient Approach for Fine-Grained Specimen Image Segmentation12 Jan 2025
- 2025Acknowledging Focus Ambiguity in Visual Questions4 Jan 2025
- 2024SAMIC: Segment Anything with In-Context Spatial Prompt Engineering16 Dec 2024
- 2024ObjectRelator: Enabling Cross-View Object Relation Understanding Across Ego-Centric and Exo-Centric Perspectives28 Nov 2024
- 2024Zero-Shot Automatic Annotation and Instance Segmentation using LLM-Generated Datasets: Eliminating Field Imaging and Manual Annotation for Deep Learning Model Development18 Nov 2024
- 2024Configurable Embodied Data Generation for Class-Agnostic RGB-D Video Segmentation16 Oct 2024
- 2024From Pixels to Tokens: Revisiting Object Hallucinations in Large Vision-Language Models9 Oct 2024
- 2024PTQ4RIS: Post-Training Quantization for Referring Image Segmentation25 Sep 2024
- 2024A Simple and Generalist Approach for Panoptic Segmentation29 Aug 2024
- 2024A Simple Background Augmentation Method for Object Detection with Diffusion Model1 Aug 2024
- 2024A Refreshed Similarity-based Upsampler for Direct High-Ratio Feature Upsampling2 Jul 2024
- 2024GMT: Guided Mask Transformer for Leaf Instance Segmentation24 Jun 2024
- 2024Video Prediction Models as General Visual Encoders25 May 2024
- 2024Semi-Self-Supervised Domain Adaptation: Developing Deep Learning Models with Limited Annotated Data for Wheat Head Segmentation12 May 2024
- 2024DynaSeg: A Deep Dynamic Fusion Method for Unsupervised Image Segmentation Incorporating Feature Similarity and Spatial Continuity9 May 2024
- 2024AugmenTory: A Fast and Flexible Polygon Augmentation Library7 May 2024
- 2024Reference-Free Image Quality Metric for Degradation and Reconstruction Artifacts1 May 2024
- 2024CarcassFormer: An End-to-end Transformer-based Framework for Simultaneous Localization, Segmentation and Classification of Poultry Carcass Defect17 Apr 2024
- 2024AI-Guided Feature Segmentation Techniques to Model Features from Single Crystal Diamond Growth10 Apr 2024
- 2024AI-Guided Defect Detection Techniques to Model Single Crystal Diamond Growth10 Apr 2024
- 2024Continual All-in-One Adverse Weather Removal with Knowledge Replay on a Unified Network Structure12 Mar 2024
- 2024FusionVision: A comprehensive approach of 3D object reconstruction and segmentation from RGB-D cameras using YOLO and fast segment anything29 Feb 2024
- 2024Robust semi-automatic vessel tracing in the human retinal image by an instance segmentation neural network15 Feb 2024
- 2024The Paradox of Motion: Evidence for Spurious Correlations in Skeleton-based Gait Recognition Models13 Feb 2024
- 2024Adapting SAM for Volumetric X-Ray Data-sets of Arbitrary Sizes9 Feb 2024
- 2024SAGD: Boundary-Enhanced Segment Anything in 3D Gaussian via Gaussian Decomposition31 Jan 2024
- 2023Comparing YOLOv8 and Mask R-CNN for instance segmentation in complex orchard environments13 Dec 2023
- 2023WATUNet: A Deep Neural Network for Segmentation of Volumetric Sweep Imaging Ultrasound17 Nov 2023
- 2023Intelligent Debris Mass Estimation Model for Autonomous Underwater Vehicle19 Sep 2023
- 2023MMSFormer: Multimodal Transformer for Material and Semantic Segmentation7 Sep 2023
50 newest of 85 All 85 (JSON)
- 2022Generalized Decoding for Pixel, Image, and Languagecited by 292
- 2023RSPrompter: Learning to Prompt for Remote Sensing Instance Segmentation based on Visual Foundation Modelcited by 180
- 2021NeSF: Neural Semantic Fields for Generalizable Semantic Segmentation of 3D Scenescited by 119
- 2025Ovis-U1 Technical Reportcited by 65
- 2023A Comprehensive Survey on Segment Anything Model for Vision and Beyondcited by 64
- 2022X-Paste: Revisiting Scalable Copy-Paste for Instance Segmentation using CLIP and StableDiffusioncited by 49
- 2021On Model Calibration for Long-Tailed Object Detection and Instance Segmentationcited by 39
- 2024SAGD: Boundary-Enhanced Segment Anything in 3D Gaussian via Gaussian Decompositioncited by 29
- 2024ObjectRelator: Enabling Cross-View Object Relation Understanding Across Ego-Centric and Exo-Centric Perspectivescited by 26
- 2023OmniTracker: Unifying Object Tracking by Tracking-with-Detectioncited by 19
- 2023FoodSAM: Any Food Segmentationcited by 19
- 2023Comparing YOLOv8 and Mask R-CNN for instance segmentation in complex orchard environmentscited by 14
12 most cited of 81 All 81 (JSON)
- 2026Optimizing YOLO27, YOLO26, YOLO11, and YOLOv8 for Fine-Grained Small-Object Detection and Segmentation in Complex Orchard Environments23 Aug 2026
- 2026VGGT-Segmentor: Geometry-Enhanced Cross-View Segmentation15 Apr 2026
- 2026TSBOW -- Traffic Surveillance Benchmark for Occluded Vehicles Under Various Weather Conditions5 Feb 2026
- 2025Break Out the Silverware -- Semantic Understanding of Stored Household Items25 Dec 2025
- 2025Ideal Observer for Segmentation of Dead Leaves Images5 Dec 2025
- 2025From Instance Segmentation to 3D Growth Trajectory Reconstruction in Planktonic Foraminifera4 Nov 2025
- 2025Focal Modulation and Bidirectional Feature Fusion Network for Medical Image Segmentation23 Oct 2025
- 2025Do Superpixel Segmentation Methods Influence Deforestation Image Classification?6 Oct 2025
- 2025Multimodal SAM-adapter for Semantic Segmentation12 Sep 2025
- 2025Deep Learning-based Scalable Image-to-3D Facade Parser for Generating Thermal 3D Building Models6 Aug 2025
- 2025DOMR: Establishing Cross-View Segmentation via Dense Object Matching6 Aug 2025
- 2025Ovis-U1 Technical Report29 Jun 2025
12 newest of 81 All 81 (JSON)