mlsanityData to 7 Oct 2026

ISINet: An Instance-Based Approach for Surgical Instrument Segmentation

arXiv 2007.05533 ↗First posted 10 Jul 2020cs.CVcited by 67

Not on the map. Why?

Abstract (arXiv)

We study the task of semantic segmentation of surgical instruments in robotic-assisted surgery scenes. We propose the Instance-based Surgical Instrument Segmentation Network (ISINet), a method that addresses this task from an instance-based segmentation perspective. Our method includes a temporal consistency module that takes into account the previously overlooked and inherent temporal information of the problem. We validate our approach on the existing benchmark for the task, the Endoscopic Vision 2017 Robotic Instrument Segmentation Dataset, and on the 2018 version of the dataset, whose annotations we extended for the fine-grained version of instrument segmentation. Our results show that ISINet significantly outperforms state-of-the-art methods, with our baseline version duplicating the Intersection over Union (IoU) of previous methods and our complete model triplicating the IoU.

Key facts. Cited by 67 papers in the map (data through 7 Oct 2026). First posted on arXiv 10 Jul 2020.

Builds on

No reference list yet.

Built on by

Cited by year (2026 to 7 Oct)

Citing papers per year: 2021: 2; 2022: 7; 2023: 15; 2024: 19; 2025: 17; 2026: 7.

67 papers.

Sort:

By area:

  1. 2023SurgicalSAM: Efficient Class Promptable Surgical Instrument Segmentationcited by 103
  2. 2024Pixel-Wise Recognition for Holistic Surgical Scene Understandingcited by 48
  3. 2024Surgical SAM 2: Real-time Segment Anything in Surgical Video by Efficient Frame Pruningcited by 46
  4. 2022TraSeTR: Track-to-Segment Transformer with Contrastive Query for Instance-level Instrument Segmentation in Robotic Surgerycited by 40
  5. 2023AdaptiveSAM: Towards Efficient Tuning of SAM for Surgical Scene Segmentationcited by 37
  6. 2023MATIS: Masked-Attention Transformers for Surgical Instrument Segmentationcited by 36
  7. 2022Towards Holistic Surgical Scene Understandingcited by 33
  8. 2022From Forks to Forceps: A New Framework for Instance Segmentation of Surgical Instrumentscited by 32
  9. 2023SAM Meets Robotic Surgery: An Empirical Study on Generalization, Robustness and Adaptationcited by 30
  10. 2023Text Promptable Surgical Instrument Segmentation with Vision-Language Modelscited by 27
  11. 2023SAM Meets Robotic Surgery: An Empirical Study in Robustness Perspectivecited by 24
  12. 2024SAM 2 in Robotic Surgery: An Empirical Evaluation for Robustness and Generalization in Surgical Video Segmentationcited by 21
38 more
  1. 2023Rethinking Exemplars for Continual Semantic Segmentation in Endoscopy Scenes: Entropy-based Mini-Batch Pseudo-Replaycited by 20
  2. 2023Methods and datasets for segmentation of minimally invasive surgical instruments in endoscopic images and videos: A review of the state of the artcited by 18
  3. 2023A spatio-temporal network for video semantic segmentation in surgical videoscited by 17
  4. 2024MedViLaM: A multimodal large language model with advanced generalizability and explainability for medical data understanding and generationcited by 17
  5. 2024Biomedical SAM 2: Segment Anything in Biomedical Images and Videoscited by 14
  6. 2024LighTDiff: Surgical Endoscopic Image Low-Light Enhancement with T-Diffusioncited by 12
  7. 2024ASI-Seg: Audio-Driven Surgical Instrument Segmentation with Surgeon Intention Understandingcited by 12
  8. 2021Simulation-to-Real domain adaptation with teacher-student learning for endoscopic instrument segmentationcited by 9
  9. 2022Joint Class-Affinity Loss Correction for Robust Medical Image Segmentation with Noisy Labelscited by 8
  10. 2023Enhancing Visual Grounding and Generalization: A Multi-Task Cycle Training Approach for Vision-Language Modelscited by 8
  11. 2023SurgicalPart-SAM: Part-to-Whole Collaborative Prompting for Surgical Instrument Segmentationcited by 8
  12. 2024Surgical-DeSAM: Decoupling SAM for Instrument Segmentation in Robotic Surgerycited by 8
  13. 2025Surgical Scene Understanding in the Era of Foundation AI Models: A Comprehensive Reviewcited by 8
  14. 2025Memory-Augmented SAM2 for Training-Free Surgical Video Segmentationcited by 8
  15. 2025Does DINOv3 Set a New Medical Vision Standard? Benchmarking 2D and 3D Classification, Segmentation, and Registrationcited by 7
  16. 2021How can we learn (more) from challenges? A statistical approach to driving future algorithm developmentcited by 5
  17. 2023SegMatch: A semi-supervised learning method for surgical instrument segmentationcited by 5
  18. 2024Systematic Evaluation and Guidelines for Segment Anything Model in Surgical Video Analysiscited by 5
  19. 2024Privacy-Preserving Synthetic Continual Semantic Segmentation for Robotic Surgerycited by 4
  20. 2025Imbalanced Medical Image Segmentation with Pixel-dependent Noisy Labelscited by 4
  21. 2022A comprehensive survey on recent deep learning-based methods applied to surgical datacited by 3
  22. 2024Revisiting Surgical Instrument Segmentation Without Human Intervention: A Graph Partitioning Viewcited by 3
  23. 2024AMNCutter: Affinity-Attention-Guided Multi-View Normalized Cutter for Unsupervised Surgical Instrument Segmentationcited by 3
  24. 2024Phase-Informed Tool Segmentation for Manual Small-Incision Cataract Surgerycited by 3
  25. 2025EgoSurgery-HTS: A Dataset for Egocentric Hand-Tool Segmentation in Open Surgery Videoscited by 3
  26. 2023Robotic Scene Segmentation with Memory Network for Runtime Surgical Context Inferencecited by 2
  27. 2023SAF-IS: a Spatial Annotation Free Framework for Instance Segmentation of Surgical Toolscited by 2
  28. 2024Rethinking RGB-D Fusion for Semantic Segmentation in Surgical Datasetscited by 2
  29. 2024Personalizing Federated Instrument Segmentation with Visual Trait Priors in Robotic Surgerycited by 2
  30. 2025Recognize Any Surgical Object: Unleashing the Power of Weakly-Supervised Datacited by 2
  31. 2025Segment Anything for Video: A Comprehensive Review of Video Object Segmentation and Tracking from Past to Futurecited by 2
  32. 2025SurgMLLMBench: A Multimodal Large Language Model Benchmark Dataset for Surgical Scene Understandingcited by 2
  33. 2022Confidence-Aware Paced-Curriculum Learning by Label Smoothing for Surgical Scene Understandingcited by 1
  34. 2024Weakly Semi-supervised Tool Detection in Minimally Invasive Surgery Videoscited by 1
  35. 2025TSMS-SAM2: Multi-scale Temporal Sampling Augmentation and Memory-Splitting Pruning for Promptable Video Object Segmentation and Tracking in Surgical Scenarioscited by 1
  36. 2025More than Segmentation: Benchmarking SAM 3 for Segmentation, 3D Perception, and Reconstruction in Robotic Surgerycited by 1
  37. 2026Unlocking Positive Transfer in Incrementally Learning Surgical Instruments: A Self-reflection Hierarchical Prompt Frameworkcited by 1
  38. 2026Hierarchical Prototype-Memory Adaptation of SAM for Surgical Instrument Segmentationcited by 1

50 most cited of 67 All 67 (JSON)