Exploring Deep Learning Methods for Real-Time Surgical Instrument Segmentation in Laparoscopy
Not on the map. Why?
Abstract (arXiv)
Minimally invasive surgery is a surgical intervention used to examine the organs inside the abdomen and has been widely used due to its effectiveness over open surgery. Due to the hardware improvements such as high definition cameras, this procedure has significantly improved and new software methods have demonstrated potential for computer-assisted procedures. However, there exists challenges and requirements to improve detection and tracking of the position of the instruments during these surgical procedures. To this end, we evaluate and compare some popular deep learning methods that can be explored for the automated segmentation of surgical instruments in laparoscopy, an important step towards tool tracking. Our experimental results exhibit that the Dual decoder attention network (DDANet) produces a superior result compared to other recent deep learning methods. DDANet yields a Dice coefficient of 0.8739 and mean intersection-over-union of 0.8183 for the Robust Medical Instrument Segmentation (ROBUST-MIS) Challenge 2019 dataset, at a real-time speed of 101.36 frames-per-second that is critical for such procedures.
Key facts. Cited by 3 papers in the map (data through 7 Oct 2026). Builds on 19 of its 28 references that are in the map. First posted on arXiv 5 Jul 2021.
Builds on
19 of 28 references.
References · 19
- 2015Deep Residual Learning for Image Recognitioncited by 51,809
- 2015U-Net: Convolutional Networks for Biomedical Image Segmentationcited by 19,604
- 2017Mask R-CNNcited by 7,259
- 2014Fully Convolutional Networks for Semantic Segmentationcited by 4,845
- 2017MobileNets: Efficient Convolutional Neural Networks for Mobile Vision Applicationscited by 3,827
- 2018Encoder-Decoder with Atrous Separable Convolution for Semantic Image Segmentationcited by 3,210
- 2016Pyramid Scene Parsing Networkcited by 2,472
- 2017Road Extraction by Deep Residual U-Netcited by 333
- 2019ResUNet++: An Advanced Architecture for Medical Image Segmentationcited by 211
- 2020Heidelberg Colorectal Data Set for Surgical Data Science in the Sensor Operating Roomcited by 47
- 2018Comparative evaluation of instrument segmentation and tracking methods in minimally invasive surgerycited by 36
- 2020DDANet: Dual Decoder Attention Network for Automatic Polyp Segmentationcited by 31
7 more
- 2017Deep Residual Learning for Instrument Segmentation in Robotic Surgerycited by 22
- 2019Attention-Guided Lightweight Network for Real-Time Segmentation of Robotic Surgical Instrumentscited by 15
- 2020Real-Time Polyp Detection, Localization and Segmentation in Colonoscopy Using Deep Learningcited by 13
- 2019RASNet: Segmentation for Tracking Surgical Instruments in Surgical Videos Using Refined Attention Segmentation Networkcited by 11
- 2020OR-UNet: an Optimized Robust Residual U-Net for Instrument Segmentation in Endoscopic Imagescited by 10
- 2021Assessing YOLACT++ for real time and robust instance segmentation of medical instruments in endoscopic procedurescited by 6
- 2020Segmentation of Surgical Instruments for Minimally-Invasive Robot-Assisted Procedures Using Generative Deep Neural Networkscited by 1
Built on by
Citing papers per year: 2021: 1; 2022: 0; 2023: 1; 2024: 1.
3 papers.
- 2023Methods and datasets for segmentation of minimally invasive surgical instruments in endoscopic images and videos: A review of the state of the artcited by 18
- 2021Real-time Instance Segmentation of Surgical Instruments using Attention and Multi-scale Feature Fusioncited by 17
- 2024Polyp and Surgical Instrument Segmentation with Double Encoder-Decoder Networkscited by 0
- 2024Polyp and Surgical Instrument Segmentation with Double Encoder-Decoder Networks6 Jun 2024
- 2023Methods and datasets for segmentation of minimally invasive surgical instruments in endoscopic images and videos: A review of the state of the art25 Apr 2023
- 2021Real-time Instance Segmentation of Surgical Instruments using Attention and Multi-scale Feature Fusion9 Nov 2021