mlsanityData to 7 Oct 2026

Exploring Deep Learning Methods for Real-Time Surgical Instrument Segmentation in Laparoscopy

arXiv 2107.02319 ↗First posted 5 Jul 2021eess.IV cs.CVcited by 3

Not on the map. Why?

Abstract (arXiv)

Minimally invasive surgery is a surgical intervention used to examine the organs inside the abdomen and has been widely used due to its effectiveness over open surgery. Due to the hardware improvements such as high definition cameras, this procedure has significantly improved and new software methods have demonstrated potential for computer-assisted procedures. However, there exists challenges and requirements to improve detection and tracking of the position of the instruments during these surgical procedures. To this end, we evaluate and compare some popular deep learning methods that can be explored for the automated segmentation of surgical instruments in laparoscopy, an important step towards tool tracking. Our experimental results exhibit that the Dual decoder attention network (DDANet) produces a superior result compared to other recent deep learning methods. DDANet yields a Dice coefficient of 0.8739 and mean intersection-over-union of 0.8183 for the Robust Medical Instrument Segmentation (ROBUST-MIS) Challenge 2019 dataset, at a real-time speed of 101.36 frames-per-second that is critical for such procedures.

Key facts. Cited by 3 papers in the map (data through 7 Oct 2026). Builds on 19 of its 28 references that are in the map. First posted on arXiv 5 Jul 2021.

Builds on

19 of 28 references.

References · 19

  1. 2015Deep Residual Learning for Image Recognitioncited by 51,809
  2. 2015U-Net: Convolutional Networks for Biomedical Image Segmentationcited by 19,604
  3. 2017Mask R-CNNcited by 7,259
  4. 2014Fully Convolutional Networks for Semantic Segmentationcited by 4,845
  5. 2017MobileNets: Efficient Convolutional Neural Networks for Mobile Vision Applicationscited by 3,827
  6. 2018Encoder-Decoder with Atrous Separable Convolution for Semantic Image Segmentationcited by 3,210
  7. 2016Pyramid Scene Parsing Networkcited by 2,472
  8. 2017Road Extraction by Deep Residual U-Netcited by 333
  9. 2019ResUNet++: An Advanced Architecture for Medical Image Segmentationcited by 211
  10. 2020Heidelberg Colorectal Data Set for Surgical Data Science in the Sensor Operating Roomcited by 47
  11. 2018Comparative evaluation of instrument segmentation and tracking methods in minimally invasive surgerycited by 36
  12. 2020DDANet: Dual Decoder Attention Network for Automatic Polyp Segmentationcited by 31
7 more
  1. 2017Deep Residual Learning for Instrument Segmentation in Robotic Surgerycited by 22
  2. 2019Attention-Guided Lightweight Network for Real-Time Segmentation of Robotic Surgical Instrumentscited by 15
  3. 2020Real-Time Polyp Detection, Localization and Segmentation in Colonoscopy Using Deep Learningcited by 13
  4. 2019RASNet: Segmentation for Tracking Surgical Instruments in Surgical Videos Using Refined Attention Segmentation Networkcited by 11
  5. 2020OR-UNet: an Optimized Robust Residual U-Net for Instrument Segmentation in Endoscopic Imagescited by 10
  6. 2021Assessing YOLACT++ for real time and robust instance segmentation of medical instruments in endoscopic procedurescited by 6
  7. 2020Segmentation of Surgical Instruments for Minimally-Invasive Robot-Assisted Procedures Using Generative Deep Neural Networkscited by 1

Built on by

Cited by year

Citing papers per year: 2021: 1; 2022: 0; 2023: 1; 2024: 1.

3 papers.