mlsanityData to 13 Oct 2026

Deep-Learning-Assisted Analysis of Cataract Surgery Videos

arXiv 2312.05900 ↗First posted 10 Dec 2023cs.CVcited by 0

Not on the map. Why?

Abstract (arXiv)

Following the technological advancements in medicine, the operation rooms are evolving into intelligent environments. The context-aware systems (CAS) can comprehensively interpret the surgical state, enable real-time warning, and support decision-making, especially for novice surgeons. These systems can automatically analyze surgical videos and perform indexing, documentation, and post-operative report generation. The ever-increasing demand for such automatic systems has sparked machine-learning-based approaches for surgical video analysis. This thesis addresses the significant challenges in cataract surgery video analysis to pave the way for building efficient context-aware systems. The main contributions of this thesis are five folds: (1) This thesis demonstrates that spatio-temporal localization of the relevant content can considerably improve phase recognition accuracy. (2) This thesis proposes a novel deep-learning-based framework for relevance-based compression to enable real-time streaming and adaptive storage of cataract surgery videos. (3) Several convolutional modules are proposed to boost the networks' semantic interpretation performance in challenging conditions. These challenges include blur and reflection distortion, transparency, deformability, color and texture variation, blunt edges, and scale variation. (4) This thesis proposes and evaluates the first framework for automatic irregularity detection in cataract surgery videos. (5) To alleviate the requirement for manual pixel-based annotations, this thesis proposes novel strategies for self-supervised representation learning adapted to semantic segmentation.

Key facts. No citing papers in the map yet (data through 13 Oct 2026). Builds on 39 of its 278 references that are in the map. First posted on arXiv 10 Dec 2023.

Builds on

39 of 278 references.

References · 39

  1. 2014Adam: A Method for Stochastic Optimizationcited by 37,093
  2. 2014Microsoft COCO: Common Objects in Contextcited by 17,550
  3. 2020A Simple Framework for Contrastive Learning of Visual Representationscited by 12,009
  4. 2015Faster R-CNN: Towards Real-Time Object Detection with Region Proposal Networkscited by 9,625
  5. 2014Fully Convolutional Networks for Semantic Segmentationcited by 4,849
  6. 2014Learning Phrase Representations using RNN Encoder-Decoder for Statistical Machine Translationcited by 4,024
  7. 2017Quo Vadis, Action Recognition? A New Model and the Kinetics Datasetcited by 3,264
  8. 2016DeepLab: Semantic Image Segmentation with Deep Convolutional Nets, Atrous Convolution, and Fully Connected CRFscited by 3,240
  9. 2013Visualizing and Understanding Convolutional Networkscited by 2,282
  10. 2015Unsupervised Representation Learning with Deep Convolutional Generative Adversarial Networkscited by 2,051
  11. 2016Unsupervised Learning of Visual Representations by Solving Jigsaw Puzzlescited by 1,381
  12. 2015FlowNet: Learning Optical Flow with Convolutional Networkscited by 1,057
27 more
  1. 2019Learning Representations by Maximizing Mutual Information Across Viewscited by 733
  2. 2016R-FCN: Object Detection via Region-based Fully Convolutional Networkscited by 414
  3. 2017DeblurGAN: Blind Motion Deblurring Using Conditional Adversarial Networkscited by 366
  4. 2019Mask Scoring R-CNNcited by 265
  5. 2016Associative Embedding: End-to-End Learning for Joint Detection and Groupingcited by 211
  6. 20192017 Robotic Instrument Segmentation Challengecited by 167
  7. 20202018 Robotic Scene Segmentation Challengecited by 123
  8. 2016Deep Watershed Transform for Instance Segmentationcited by 77
  9. 2016Examining the Impact of Blur on Recognition by Convolutional Networkscited by 58
  10. 2018Tool Detection and Operative Skill Assessment in Surgical Videos Using Region-Based Convolutional Neural Networkscited by 56
  11. 2017MaskLab: Instance Segmentation by Refining Object Detection with Semantic and Direction Featurescited by 54
  12. 2016InstanceCut: from Edges to Instances with MultiCutcited by 48
  13. 2018DeepPhase: Surgical Phase Recognition in CATARACTS Videoscited by 47
  14. 20163D Deeply Supervised Network for Automatic Liver Segmentation from CT Volumescited by 43
  15. 2016The TUM LapChole dataset for the M2CAI 2016 workflow challengecited by 37
  16. 2017Semantic Instance Segmentation via Deep Metric Learningcited by 37
  17. 2018Comparative evaluation of instrument segmentation and tracking methods in minimally invasive surgerycited by 36
  18. 2017Segmentation-Aware Convolutional Networks Using Local Attention Maskscited by 31
  19. 2016Visual Saliency Detection Based on Multiscale Deep CNN Featurescited by 26
  20. 2018RSDNet: Learning to Predict Remaining Surgery Duration from Laparoscopic Videos Without Manual Annotationscited by 26
  21. 2018Less is More: Surgical Phase Recognition with Less Annotations through Self-Supervised Pre-training of CNN-LSTM Networkscited by 24
  22. 2018Learning from a tiny dataset of manual annotations: a teacher/student approach for surgical phase recognitioncited by 21
  23. 2017Pixelwise Instance Segmentation with a Dynamically Instantiated Networkcited by 20
  24. 2018Temporal coherence-based self-supervised learning for laparoscopic workflow analysiscited by 16
  25. 2017Deep Generative Filter for Motion Deblurringcited by 14
  26. 2017Unsupervised temporal context learning using convolutional neural networks for laparoscopic workflow analysiscited by 7
  27. 2019Automatic Tip Detection of Surgical Instruments in Biportal Endoscopic Spine Surgerycited by 1

Built on by

Not cited yet.