DeepPhase: Surgical Phase Recognition in CATARACTS Videos
Not on the map. Why?
Abstract (arXiv)
Automated surgical workflow analysis and understanding can assist surgeons to standardize procedures and enhance post-surgical assessment and indexing, as well as, interventional monitoring. Computer-assisted interventional (CAI) systems based on video can perform workflow estimation through surgical instruments' recognition while linking them to an ontology of procedural phases. In this work, we adopt a deep learning paradigm to detect surgical instruments in cataract surgery videos which in turn feed a surgical phase inference recurrent network that encodes temporal aspects of phase steps within the phase classification. Our models present comparable to state-of-the-art results for surgical tool detection and phase recognition with accuracies of 99 and 78% respectively.
Key facts. Cited by 47 papers in the map (data through 14 Oct 2026). First posted on arXiv 17 Jul 2018.
Builds on
No reference list yet.
Built on by
Citing papers per year: 2021: 14; 2022: 9; 2023: 10; 2024: 6; 2025: 5; 2026: 3.
47 papers.
Sort:
- 2021Rendezvous: Attention Mechanisms for the Recognition of Surgical Action Triplets in Endoscopic Videoscited by 141
- 2021Trans-SVNet: Accurate Phase Recognition from Surgical Videos via Hybrid Embedding Aggregation Transformercited by 94
- 2021Temporal Memory Relation Network for Workflow Recognition from Surgical Videocited by 66
- 2024Pixel-Wise Recognition for Holistic Surgical Scene Understandingcited by 49
- 2022Dissecting Self-Supervised Learning Methods for Surgical Computer Visioncited by 48
- 2023IndustReal: A Dataset for Procedure Step Recognition Handling Execution Errors in Egocentric Videos in an Industrial-Like Settingcited by 48
- 2022CholecTriplet2021: A benchmark challenge for surgical action triplet recognitioncited by 44
- 2021Multi-Task Temporal Convolutional Networks for Joint Recognition of Surgical Phases and Steps in Gastric Bypass Procedurescited by 42
- 2022Latent Graph Representations for Critical View of Safety Assessmentcited by 37
- 2021Exploring Segment-level Semantics for Online Phase Recognition from Surgical Videoscited by 23
- 2023Dynamic Scene Graph Representation for Surgical Videocited by 21
- 2023The Endoscapes Dataset for Surgical Scene Segmentation, Object Detection, and Critical View of Safety Assessment: Official Splits and Benchmarkcited by 21
35 more
- 2022On the Pitfalls of Batch Normalization for End-to-End Video Learning: A Study on Surgical Workflow Analysiscited by 19
- 2021Relevance Detection in Cataract Surgery Videos by Spatio-Temporal Action Localizationcited by 15
- 2021CataNet: Predicting remaining cataract surgery durationcited by 15
- 2021LensID: A CNN-RNN-Based Framework Towards Lens Irregularity Detection in Cataract Surgery Videoscited by 15
- 2021Surgical Visual Domain Adaptation: Results from the MICCAI 2020 SurgVisDom Challengecited by 14
- 2023SurgPLAN: Surgical Phase Localization Network for Phase Recognitioncited by 12
- 2024Surgical Workflow Recognition and Blocking Effectiveness Detection in Laparoscopic Liver Resections with Pringle Maneuvercited by 12
- 2021Effective semantic segmentation in Cataract Surgery: What matters most?cited by 11
- 2023Pelphix: Surgical Phase Recognition from X-ray Images in Percutaneous Pelvic Fixationcited by 8
- 2022DeepPyramid: Enabling Pyramid View and Deformable Pyramid Reception for Semantic Segmentation in Cataract Surgery Videoscited by 7
- 2022ARST: Auto-Regressive Surgical Transformer for Phase Recognition from Laparoscopic Videoscited by 6
- 2023Weakly Supervised Temporal Convolutional Networks for Fine-grained Surgical Activity Recognitioncited by 5
- 2023GLSFormer: Gated - Long, Short Sequence Transformer for Step Recognition in Surgical Videoscited by 5
- 2021"Train one, Classify one, Teach one" -- Cross-surgery transfer learning for surgical step recognitioncited by 4
- 2021Open surgery tool classification and hand utilization using a multi-camera systemcited by 4
- 2022Why Deep Surgical Models Fail?: Revisiting Surgical Action Triplet Recognition through the Lens of Robustnesscited by 4
- 2024CycleSAM: Few-Shot Surgical Scene Segmentation with Cycle- and Scene-Consistent Feature Matchingcited by 3
- 2022PoCaP Corpus: A Multimodal Dataset for Smart Operating Room Speech Assistant using Interventional Radiology Workflow Analysiscited by 2
- 2023Cross-Dataset Adaptation for Instrument Classification in Cataract Surgery Videoscited by 2
- 2024SurgPLAN++: Universal Surgical Phase Localization Network for Online and Offline Inferencecited by 2
- 2025Surgeons vs. Computer Vision: A comparative analysis on surgical phase recognition capabilitiescited by 2
- 2025StepAL: Step-aware Active Learning for Cataract Surgical Videoscited by 2
- 2022Human Gaze Guided Attention for Surgical Activity Recognitioncited by 1
- 2023Surgical Phase and Instrument Recognition: How to identify appropriate Dataset Splitscited by 1
- 2024SURGIVID: Annotation-Efficient Surgical Video Object Discoverycited by 1
- 2025A Temporal Convolutional Network-Based Approach and a Benchmark Dataset for Colonoscopy Video Temporal Segmentationcited by 1
- 2025Mistake Attribution: Fine-Grained Mistake Understanding in Egocentric Videoscited by 1
- 2021DeepPyram: Enabling Pyramid View and Deformable Pyramid Reception for Semantic Segmentation in Cataract Surgery Videoscited by 0
- 2021Workflow Augmentation of Video Data for Event Recognition with Time-Sensitive Neural Networkscited by 0
- 2023Deep-Learning-Assisted Analysis of Cataract Surgery Videoscited by 0
- 2024Robust Surgical Phase Recognition From Annotation Efficient Supervisioncited by 0
- 2025CataractCompDetect: Intraoperative Complication Detection in Cataract Surgerycited by 0
- 2026CataractSAM-2: A Domain-Adapted Model for Anterior Segment Surgery Segmentation and Scalable Ground-Truth Annotationcited by 0
- 2026Clinically-Grounded Counterfactual Reasoning for Medical Video Diagnosiscited by 0
- 2026OphBiWSSD: Scaling Temporal Action Localization in Ophthalmic Surgeries with Bidirectional Weight-tied State Space Dualitycited by 0
- 2026OphBiWSSD: Scaling Temporal Action Localization in Ophthalmic Surgeries with Bidirectional Weight-tied State Space Duality11 Sep 2026
- 2026Clinically-Grounded Counterfactual Reasoning for Medical Video Diagnosis26 May 2026
- 2026CataractSAM-2: A Domain-Adapted Model for Anterior Segment Surgery Segmentation and Scalable Ground-Truth Annotation23 Mar 2026
- 2025Mistake Attribution: Fine-Grained Mistake Understanding in Egocentric Videos25 Nov 2025
- 2025CataractCompDetect: Intraoperative Complication Detection in Cataract Surgery24 Nov 2025
- 2025StepAL: Step-aware Active Learning for Cataract Surgical Videos29 Jul 2025
- 2025Surgeons vs. Computer Vision: A comparative analysis on surgical phase recognition capabilities26 Apr 2025
- 2025A Temporal Convolutional Network-Based Approach and a Benchmark Dataset for Colonoscopy Video Temporal Segmentation5 Feb 2025
- 2024SurgPLAN++: Universal Surgical Phase Localization Network for Online and Offline Inference19 Sep 2024
- 2024SURGIVID: Annotation-Efficient Surgical Video Object Discovery12 Sep 2024
- 2024Surgical Workflow Recognition and Blocking Effectiveness Detection in Laparoscopic Liver Resections with Pringle Maneuver20 Aug 2024
- 2024CycleSAM: Few-Shot Surgical Scene Segmentation with Cycle- and Scene-Consistent Feature Matching9 Jul 2024
35 more
- 2024Robust Surgical Phase Recognition From Annotation Efficient Supervision26 Jun 2024
- 2024Pixel-Wise Recognition for Holistic Surgical Scene Understanding20 Jan 2024
- 2023The Endoscapes Dataset for Surgical Scene Segmentation, Object Detection, and Critical View of Safety Assessment: Official Splits and Benchmark19 Dec 2023
- 2023Deep-Learning-Assisted Analysis of Cataract Surgery Videos10 Dec 2023
- 2023SurgPLAN: Surgical Phase Localization Network for Phase Recognition16 Nov 2023
- 2023IndustReal: A Dataset for Procedure Step Recognition Handling Execution Errors in Egocentric Videos in an Industrial-Like Setting26 Oct 2023
- 2023Dynamic Scene Graph Representation for Surgical Video25 Sep 2023
- 2023Cross-Dataset Adaptation for Instrument Classification in Cataract Surgery Videos31 Jul 2023
- 2023GLSFormer: Gated - Long, Short Sequence Transformer for Step Recognition in Surgical Videos20 Jul 2023
- 2023Surgical Phase and Instrument Recognition: How to identify appropriate Dataset Splits29 Jun 2023
- 2023Pelphix: Surgical Phase Recognition from X-ray Images in Percutaneous Pelvic Fixation18 Apr 2023
- 2023Weakly Supervised Temporal Convolutional Networks for Fine-grained Surgical Activity Recognition21 Feb 2023
- 2022Latent Graph Representations for Critical View of Safety Assessment8 Dec 2022
- 2022Why Deep Surgical Models Fail?: Revisiting Surgical Action Triplet Recognition through the Lens of Robustness18 Sep 2022
- 2022ARST: Auto-Regressive Surgical Transformer for Phase Recognition from Laparoscopic Videos2 Sep 2022
- 2022DeepPyramid: Enabling Pyramid View and Deformable Pyramid Reception for Semantic Segmentation in Cataract Surgery Videos4 Jul 2022
- 2022Dissecting Self-Supervised Learning Methods for Surgical Computer Vision1 Jul 2022
- 2022PoCaP Corpus: A Multimodal Dataset for Smart Operating Room Speech Assistant using Interventional Radiology Workflow Analysis24 Jun 2022
- 2022CholecTriplet2021: A benchmark challenge for surgical action triplet recognition10 Apr 2022
- 2022On the Pitfalls of Batch Normalization for End-to-End Video Learning: A Study on Surgical Workflow Analysis15 Mar 2022
- 2022Human Gaze Guided Attention for Surgical Activity Recognition9 Mar 2022
- 2021Exploring Segment-level Semantics for Online Phase Recognition from Surgical Videos22 Nov 2021
- 2021Open surgery tool classification and hand utilization using a multi-camera system11 Nov 2021
- 2021Workflow Augmentation of Video Data for Event Recognition with Time-Sensitive Neural Networks30 Sep 2021
- 2021DeepPyram: Enabling Pyramid View and Deformable Pyramid Reception for Semantic Segmentation in Cataract Surgery Videos11 Sep 2021
- 2021Rendezvous: Attention Mechanisms for the Recognition of Surgical Action Triplets in Endoscopic Videos7 Sep 2021
- 2021Effective semantic segmentation in Cataract Surgery: What matters most?13 Aug 2021
- 2021LensID: A CNN-RNN-Based Framework Towards Lens Irregularity Detection in Cataract Surgery Videos2 Jul 2021
- 2021CataNet: Predicting remaining cataract surgery duration21 Jun 2021
- 2021Relevance Detection in Cataract Surgery Videos by Spatio-Temporal Action Localization29 Apr 2021
- 2021Temporal Memory Relation Network for Workflow Recognition from Surgical Video30 Mar 2021
- 2021Trans-SVNet: Accurate Phase Recognition from Surgical Videos via Hybrid Embedding Aggregation Transformer17 Mar 2021
- 2021Surgical Visual Domain Adaptation: Results from the MICCAI 2020 SurgVisDom Challenge26 Feb 2021
- 2021"Train one, Classify one, Teach one" -- Cross-surgery transfer learning for surgical step recognition24 Feb 2021
- 2021Multi-Task Temporal Convolutional Networks for Joint Recognition of Surgical Phases and Steps in Gastric Bypass Procedures24 Feb 2021
- 2021Rendezvous: Attention Mechanisms for the Recognition of Surgical Action Triplets in Endoscopic Videoscited by 141
- 2021Trans-SVNet: Accurate Phase Recognition from Surgical Videos via Hybrid Embedding Aggregation Transformercited by 94
- 2021Temporal Memory Relation Network for Workflow Recognition from Surgical Videocited by 66
- 2024Pixel-Wise Recognition for Holistic Surgical Scene Understandingcited by 49
- 2022Dissecting Self-Supervised Learning Methods for Surgical Computer Visioncited by 48
- 2023IndustReal: A Dataset for Procedure Step Recognition Handling Execution Errors in Egocentric Videos in an Industrial-Like Settingcited by 48
- 2022CholecTriplet2021: A benchmark challenge for surgical action triplet recognitioncited by 44
- 2021Multi-Task Temporal Convolutional Networks for Joint Recognition of Surgical Phases and Steps in Gastric Bypass Procedurescited by 42
- 2022Latent Graph Representations for Critical View of Safety Assessmentcited by 37
- 2021Exploring Segment-level Semantics for Online Phase Recognition from Surgical Videoscited by 23
- 2023Dynamic Scene Graph Representation for Surgical Videocited by 21
- 2023The Endoscapes Dataset for Surgical Scene Segmentation, Object Detection, and Critical View of Safety Assessment: Official Splits and Benchmarkcited by 21
12 most cited of 47 All 47 (JSON)
- 2026OphBiWSSD: Scaling Temporal Action Localization in Ophthalmic Surgeries with Bidirectional Weight-tied State Space Duality11 Sep 2026
- 2026Clinically-Grounded Counterfactual Reasoning for Medical Video Diagnosis26 May 2026
- 2026CataractSAM-2: A Domain-Adapted Model for Anterior Segment Surgery Segmentation and Scalable Ground-Truth Annotation23 Mar 2026
- 2025Mistake Attribution: Fine-Grained Mistake Understanding in Egocentric Videos25 Nov 2025
- 2025CataractCompDetect: Intraoperative Complication Detection in Cataract Surgery24 Nov 2025
- 2025StepAL: Step-aware Active Learning for Cataract Surgical Videos29 Jul 2025
- 2025Surgeons vs. Computer Vision: A comparative analysis on surgical phase recognition capabilities26 Apr 2025
- 2025A Temporal Convolutional Network-Based Approach and a Benchmark Dataset for Colonoscopy Video Temporal Segmentation5 Feb 2025
- 2024SurgPLAN++: Universal Surgical Phase Localization Network for Online and Offline Inference19 Sep 2024
- 2024SURGIVID: Annotation-Efficient Surgical Video Object Discovery12 Sep 2024
- 2024Surgical Workflow Recognition and Blocking Effectiveness Detection in Laparoscopic Liver Resections with Pringle Maneuver20 Aug 2024
- 2024CycleSAM: Few-Shot Surgical Scene Segmentation with Cycle- and Scene-Consistent Feature Matching9 Jul 2024
12 newest of 47 All 47 (JSON)