Metrics Matter in Surgical Phase Recognition
Not on the map. Why?
Abstract (arXiv)
Surgical phase recognition is a basic component for different context-aware applications in computer- and robot-assisted surgery. In recent years, several methods for automatic surgical phase recognition have been proposed, showing promising results. However, a meaningful comparison of these methods is difficult due to differences in the evaluation process and incomplete reporting of evaluation details. In particular, the details of metric computation can vary widely between different studies. To raise awareness of potential inconsistencies, this paper summarizes common deviations in the evaluation of phase recognition algorithms on the Cholec80 benchmark. In addition, a structured overview of previously reported evaluation results on Cholec80 is provided, taking known differences in evaluation protocols into account. Greater attention to evaluation details could help achieve more consistent and comparable results on the surgical phase recognition task, leading to more reliable conclusions about advancements in the field and, finally, translation into clinical practice.
Key facts. Cited by 14 papers in the map (data through 14 Oct 2026). Builds on 43 of its 95 references that are in the map. First posted on arXiv 23 May 2023.
Builds on
43 of 95 references.
References · 43
- 2017Attention Is All You Needcited by 60,361
- 2015Deep Residual Learning for Image Recognitioncited by 52,096
- 2020An Image is Worth 16x16 Words: Transformers for Image Recognition at Scalecited by 30,186
- 2021Swin Transformer: Hierarchical Vision Transformer using Shifted Windowscited by 12,139
- 2015Batch Normalization: Accelerating Deep Network Training by Reducing Internal Covariate Shiftcited by 7,005
- 2017Squeeze-and-Excitation Networkscited by 4,789
- 2014Neural Machine Translation by Jointly Learning to Align and Translatecited by 4,548
- 2018How Powerful are Graph Neural Networks?cited by 4,393
- 2014Learning Phrase Representations using RNN Encoder-Decoder for Statistical Machine Translationcited by 4,057
- 2022A ConvNet for the 2020scited by 3,579
- 2017Quo Vadis, Action Recognition? A New Model and the Kinetics Datasetcited by 3,270
- 2018CBAM: Convolutional Block Attention Modulecited by 2,477
31 more
- 2017Non-local Neural Networkscited by 2,293
- 2018SlowFast Networks for Video Recognitioncited by 1,867
- 2021Is Space-Time Attention All You Need for Video Understanding?cited by 1,620
- 2021Video Swin Transformercited by 1,091
- 2013Exact solutions to the nonlinear dynamics of learning in deep linear neural networkscited by 763
- 2020X3D: Expanding Architectures for Efficient Video Recognitioncited by 637
- 2021Twins: Revisiting the Design of Spatial Attention in Vision Transformerscited by 565
- 2018Albumentations: fast and flexible image augmentationscited by 560
- 2020Principal Neighbourhood Aggregation for Graph Netscited by 478
- 2020ResNeSt: Split-Attention Networkscited by 445
- 2019MS-TCN: Multi-Stage Temporal Convolutional Network for Action Segmentationcited by 373
- 2016EndoNet: A Deep Architecture for Recognition Tasks on Laparoscopic Videoscited by 367
- 2018Long-Term Feature Banks for Detailed Video Understandingcited by 239
- 2017Super-Convergence: Very Fast Training of Neural Networks Using Large Learning Ratescited by 199
- 2021ASFormer: Transformer for Action Segmentationcited by 168
- 2020TeCNO: Surgical Phase Recognition with Multi-Stage Temporal Convolutional Networkscited by 141
- 2020CholecSeg8k: A Semantic Segmentation Dataset for Laparoscopic Cholecystectomy Based on Cholec80cited by 106
- 2021Trans-SVNet: Accurate Phase Recognition from Surgical Videos via Hybrid Embedding Aggregation Transformercited by 94
- 2019Multi-Task Recurrent Convolutional Network with Correlation Loss for Surgical Video Analysiscited by 76
- 2019Macro F1 and Macro F1cited by 70
- 2021Temporal Memory Relation Network for Workflow Recognition from Surgical Videocited by 66
- 2021OperA: Attention-Regularized Transformers for Surgical Phase Recognitioncited by 60
- 2021Exploring Segment-level Semantics for Online Phase Recognition from Surgical Videoscited by 23
- 2021Not End-to-End: Explore Multi-Stage Architecture for Online Surgical Phase Recognitioncited by 20
- 2022On the Pitfalls of Batch Normalization for End-to-End Video Learning: A Study on Surgical Workflow Analysiscited by 19
- 2022An Empirical Study on Activity Recognition in Long Surgical Videoscited by 13
- 2020Aggregating Long-Term Context for Learning Laparoscopic and Robot-Assisted Surgical Workflowscited by 10
- 2022Retrieval of surgical phase transitions using reinforcement learningcited by 7
- 2022Surgical Workflow Recognition: from Analysis of Challenges to Architectural Studycited by 6
- 2022ARST: Auto-Regressive Surgical Transformer for Phase Recognition from Laparoscopic Videoscited by 6
- 2019IndyLSTMs: Independently Recurrent LSTMscited by 3
Built on by
Citing papers per year: 2023: 3; 2024: 2; 2025: 7; 2026: 2.
14 papers.
Sort:
By area:
- 2025SurgLaVi: Large-Scale Hierarchical Dataset for Surgical Vision-Language Representation Learningcited by 16
- 2023TUNeS: A Temporal U-Net with Self-Attention for Video-based Surgical Phase Recognitioncited by 6
- 2023SF-TMN: SlowFast Temporal Modeling Network for Surgical Phase Recognitioncited by 5
- 2024Neural Finite-State Machines for Surgical Phase Recognitioncited by 5
- 2025CAT-SG: A Large Dynamic Scene Graph Dataset for Fine-Grained Understanding of Cataract Surgerycited by 4
- 2025Federated EndoViT: Pretraining Vision Transformers via Federated Learning on Endoscopic Image Collectionscited by 3
- 2024Benchmarking and Enhancing Surgical Phase Recognition Models for Robotic-Assisted Esophagectomycited by 2
- 2025Efficient Frame Extraction: A Novel Approach Through Frame Similarity and Surgical Tool Tracking for Video Segmentationcited by 2
- 2025MoSFormer: Augmenting Temporal Context with Memory of Surgery for Surgical Phase Recognitioncited by 2
- 2025SemiVT-Surge: Semi-Supervised Video Transformer for Surgical Phase Recognitioncited by 2
- 2023Surgical Phase and Instrument Recognition: How to identify appropriate Dataset Splitscited by 1
- 2025ReSW-VL: Representation Learning for Surgical Workflow Analysis Using Vision-Language Modelcited by 0
- 2026HTT-Net: Hierarchical Text-guided Transition Modeling for Surgical Video Phase Recognition18 Jul 2026
- 2026SurgicalMamba: Dual-Path SSD with State Regramming for Online Surgical Phase Recognition14 May 2026
- 2025SurgLaVi: Large-Scale Hierarchical Dataset for Surgical Vision-Language Representation Learning9 Sep 2025
- 2025CAT-SG: A Large Dynamic Scene Graph Dataset for Fine-Grained Understanding of Cataract Surgery26 Jun 2025
- 2025SemiVT-Surge: Semi-Supervised Video Transformer for Surgical Phase Recognition2 Jun 2025
- 2025ReSW-VL: Representation Learning for Surgical Workflow Analysis Using Vision-Language Model19 May 2025
- 2025Federated EndoViT: Pretraining Vision Transformers via Federated Learning on Endoscopic Image Collections23 Apr 2025
- 2025MoSFormer: Augmenting Temporal Context with Memory of Surgery for Surgical Phase Recognition2 Mar 2025
- 2025Efficient Frame Extraction: A Novel Approach Through Frame Similarity and Surgical Tool Tracking for Video Segmentation19 Jan 2025
- 2024Benchmarking and Enhancing Surgical Phase Recognition Models for Robotic-Assisted Esophagectomy5 Dec 2024
- 2024Neural Finite-State Machines for Surgical Phase Recognition27 Nov 2024
- 2023TUNeS: A Temporal U-Net with Self-Attention for Video-based Surgical Phase Recognition19 Jul 2023
- 2023TUNeS: A Temporal U-Net with Self-Attention for Video-based Surgical Phase Recognitioncited by 6
- 2023SF-TMN: SlowFast Temporal Modeling Network for Surgical Phase Recognitioncited by 5
- 2024Neural Finite-State Machines for Surgical Phase Recognitioncited by 5
- 2025CAT-SG: A Large Dynamic Scene Graph Dataset for Fine-Grained Understanding of Cataract Surgerycited by 4
- 2025Federated EndoViT: Pretraining Vision Transformers via Federated Learning on Endoscopic Image Collectionscited by 3
- 2024Benchmarking and Enhancing Surgical Phase Recognition Models for Robotic-Assisted Esophagectomycited by 2
- 2025Efficient Frame Extraction: A Novel Approach Through Frame Similarity and Surgical Tool Tracking for Video Segmentationcited by 2
- 2025MoSFormer: Augmenting Temporal Context with Memory of Surgery for Surgical Phase Recognitioncited by 2
- 2025SemiVT-Surge: Semi-Supervised Video Transformer for Surgical Phase Recognitioncited by 2
- 2023Surgical Phase and Instrument Recognition: How to identify appropriate Dataset Splitscited by 1
- 2025ReSW-VL: Representation Learning for Surgical Workflow Analysis Using Vision-Language Modelcited by 0
- 2026SurgicalMamba: Dual-Path SSD with State Regramming for Online Surgical Phase Recognitioncited by 0
12 most cited of 13 All 13 (JSON)
- 2026HTT-Net: Hierarchical Text-guided Transition Modeling for Surgical Video Phase Recognition18 Jul 2026
- 2026SurgicalMamba: Dual-Path SSD with State Regramming for Online Surgical Phase Recognition14 May 2026
- 2025CAT-SG: A Large Dynamic Scene Graph Dataset for Fine-Grained Understanding of Cataract Surgery26 Jun 2025
- 2025SemiVT-Surge: Semi-Supervised Video Transformer for Surgical Phase Recognition2 Jun 2025
- 2025ReSW-VL: Representation Learning for Surgical Workflow Analysis Using Vision-Language Model19 May 2025
- 2025Federated EndoViT: Pretraining Vision Transformers via Federated Learning on Endoscopic Image Collections23 Apr 2025
- 2025MoSFormer: Augmenting Temporal Context with Memory of Surgery for Surgical Phase Recognition2 Mar 2025
- 2025Efficient Frame Extraction: A Novel Approach Through Frame Similarity and Surgical Tool Tracking for Video Segmentation19 Jan 2025
- 2024Benchmarking and Enhancing Surgical Phase Recognition Models for Robotic-Assisted Esophagectomy5 Dec 2024
- 2024Neural Finite-State Machines for Surgical Phase Recognition27 Nov 2024
- 2023TUNeS: A Temporal U-Net with Self-Attention for Video-based Surgical Phase Recognition19 Jul 2023
- 2023Surgical Phase and Instrument Recognition: How to identify appropriate Dataset Splits29 Jun 2023
12 newest of 13 All 13 (JSON)