mlsanityData to 7 Oct 2026

YOLACT: Real-time Instance Segmentation

arXiv 1904.02689 ↗First posted 4 Apr 2019cs.CVcited by 441

Not on the map. Why?

Abstract (arXiv)

We present a simple, fully-convolutional model for real-time instance segmentation that achieves 29.8 mAP on MS COCO at 33.5 fps evaluated on a single Titan Xp, which is significantly faster than any previous competitive approach. Moreover, we obtain this result after training on only one GPU. We accomplish this by breaking instance segmentation into two parallel subtasks: (1) generating a set of prototype masks and (2) predicting per-instance mask coefficients. Then we produce instance masks by linearly combining the prototypes with the mask coefficients. We find that because this process doesn't depend on repooling, this approach produces very high-quality masks and exhibits temporal stability for free. Furthermore, we analyze the emergent behavior of our prototypes and show they learn to localize instances on their own in a translation variant manner, despite being fully-convolutional. Finally, we also propose Fast NMS, a drop-in 12 ms faster replacement for standard NMS that only has a marginal performance penalty.

Key facts. Cited by 441 papers in the map (data through 7 Oct 2026). First posted on arXiv 4 Apr 2019.

Builds on

No reference list yet.

Built on by

Cited by year (2026 to 7 Oct)

Citing papers per year: 2021: 90; 2022: 83; 2023: 114; 2024: 64; 2025: 56; 2026: 34.

441 papers.

Sort:

By area:

  1. 2023Segment Everything Everywhere All at Oncecited by 546
  2. 2022Generalized Decoding for Pixel, Image, and Languagecited by 292
  3. 2023Fast Segment Anythingcited by 286
  4. 2021K-Net: Towards Unified Image Segmentationcited by 211
  5. 2023Convolutions Die Hard: Open-Vocabulary Segmentation with Single Frozen Convolutional CLIPcited by 199
  6. 2023SegGPT: Segmenting Everything In Contextcited by 193
  7. 2022RTMDet: An Empirical Study of Designing Real-Time Object Detectorscited by 192
  8. 2023Universal Instance Perception as Object Discovery and Retrievalcited by 190
  9. 2023Semantic-SAM: Segment and Recognize Anything at Any Granularitycited by 185
  10. 2023RSPrompter: Learning to Prompt for Remote Sensing Instance Segmentation based on Visual Foundation Modelcited by 180
  11. 2023ZipIt! Merging Models from Different Tasks without Trainingcited by 178
  12. 2023Towards Open Vocabulary Learning: A Surveycited by 165
38 more
  1. 2021Instances as Queriescited by 157
  2. 2023PolyFormer: Referring Image Segmentation as Sequential Polygon Generationcited by 147
  3. 2023Transformer-Based Visual Segmentation: A Surveycited by 124
  4. 2022Learning What Not to Segment: A New Perspective on Few-Shot Segmentationcited by 120
  5. 2023Foundational Models Defining a New Era in Vision: A Survey and Outlookcited by 109
  6. 2021Video Instance Segmentation using Inter-Frame Communication Transformerscited by 105
  7. 2021Deep Occlusion-Aware Instance Segmentation with Overlapping BiLayerscited by 104
  8. 2022FreeSOLO: Learning to Segment Objects without Annotationscited by 102
  9. 2021SG-Net: Spatial Granularity Network for One-Stage Video Instance Segmentationcited by 87
  10. 2023Hi4D: 4D Instance Segmentation of Close Human Interactioncited by 87
  11. 2022AutoLaparo: A New Dataset of Integrated Multi-tasks for Image-guided Surgical Automation in Laparoscopic Hysterectomycited by 85
  12. 2021Crossover Learning for Fast Online Video Instance Segmentationcited by 83
  13. 2021Video Instance Segmentation with a Propose-Reduce Paradigmcited by 74
  14. 2025RF-DETR: Neural Architecture Search for Real-Time Detection Transformerscited by 70
  15. 2021SOLQ: Segmenting Objects by Learning Queriescited by 68
  16. 2021Multimodal Object Detection via Probabilistic Ensemblingcited by 67
  17. 2021Mask Transfiner for High-Quality Instance Segmentationcited by 64
  18. 2023A Comprehensive Survey on Segment Anything Model for Vision and Beyondcited by 64
  19. 2022Sparse Instance Activation for Real-Time Instance Segmentationcited by 63
  20. 2021DiscoBox: Weakly Supervised Instance Segmentation and Semantic Correspondence from Box Supervisioncited by 59
  21. 2021ISTR: End-to-End Instance Segmentation with Transformerscited by 52
  22. 2021OpenForensics: Large-Scale Challenging Dataset For Multi-Face Forgery Detection And Segmentation In-The-Wildcited by 50
  23. 2021How Well Do Sparse Imagenet Models Transfer?cited by 50
  24. 2022DiffusionInst: Diffusion Model for Instance Segmentationcited by 49
  25. 2021RefineMask: Towards High-Quality Instance Segmentation with Fine-Grained Featurescited by 47
  26. 2026Ultralytics YOLO26: Unified Real-Time End-to-End Vision Modelscited by 47
  27. 2022A Survey on Label-efficient Deep Image Segmentation: Bridging the Gap between Weak Supervision and Dense Predictioncited by 46
  28. 2023Instance Segmentation in the Darkcited by 45
  29. 2021Look Closer to Segment Better: Boundary Patch Refinement for Instance Segmentationcited by 43
  30. 2021Prototypical Cross-Attention Networks for Multiple Object Tracking and Segmentationcited by 43
  31. 2021Unity Perception: Generate Synthetic Data for Computer Visioncited by 43
  32. 2021Spatial Feature Calibration and Temporal Fusion for Effective One-stage Video Instance Segmentationcited by 42
  33. 2021SOTR: Segmenting Objects with Transformerscited by 42
  34. 2022Box-supervised Instance Segmentation with Level Set Evolutioncited by 41
  35. 2021Zero-Shot Instance Segmentationcited by 40
  36. 2023You Only Segment Once: Towards Real-Time Panoptic Segmentationcited by 40
  37. 2023EdgeSAM: Prompt-In-the-Loop Distillation for SAMcited by 40
  38. 2023Mask Grounding for Referring Image Segmentationcited by 40

50 most cited of 441 All 441 (JSON)