Surgical Workflow Recognition: from Analysis of Challenges to Architectural Study
Not on the map. Why?
Abstract (arXiv)
Algorithmic surgical workflow recognition is an ongoing research field and can be divided into laparoscopic (Internal) and operating room (External) analysis. So far many different works for the internal analysis have been proposed with the combination of a frame-level and an additional temporal model to address the temporal ambiguities between different workflow phases. For the External recognition task, Clip-level methods are in the focus of researchers targeting the local ambiguities present in the OR scene. In this work we evaluate combinations of different model architectures for the task of surgical workflow recognition to provide a fair comparison of the methods for both Internal and External analysis. We show that methods designed for the Internal analysis can be transferred to the external task with comparable performance gains for different architectures.
Key facts. Cited by 6 papers in the map (data through 7 Oct 2026). Builds on 24 of its 35 references that are in the map. First posted on arXiv 17 Mar 2022.
Builds on
24 of 35 references.
References · 24
- 2017Attention Is All You Needcited by 59,932
- 2015Deep Residual Learning for Image Recognitioncited by 51,809
- 2021Swin Transformer: Hierarchical Vision Transformer using Shifted Windowscited by 12,082
- 2014Neural Machine Translation by Jointly Learning to Align and Translatecited by 4,530
- 2019RandAugment: Practical automated data augmentation with a reduced search spacecited by 2,261
- 2017The Kinetics Human Action Video Datasetcited by 1,894
- 2020X3D: Expanding Architectures for Efficient Video Recognitioncited by 635
- 2019MS-TCN: Multi-Stage Temporal Convolutional Network for Action Segmentationcited by 370
- 2016EndoNet: A Deep Architecture for Recognition Tasks on Laparoscopic Videoscited by 366
- 2016The THUMOS Challenge on Action Recognition for Videos "in the Wild"cited by 213
- 2020TeCNO: Surgical Phase Recognition with Multi-Stage Temporal Convolutional Networkscited by 139
- 2021Trans-SVNet: Accurate Phase Recognition from Surgical Videos via Hybrid Embedding Aggregation Transformercited by 93
12 more
- 2020A Short Note on the Kinetics-700-2020 Human Action Datasetcited by 89
- 2019Multi-Task Recurrent Convolutional Network with Correlation Loss for Surgical Video Analysiscited by 75
- 2021OperA: Attention-Regularized Transformers for Surgical Phase Recognitioncited by 60
- 2021Comparative Validation of Machine Learning Algorithms for Surgical Workflow and Skill Analysis with the HeiChole Benchmarkcited by 58
- 2018MVOR: A Multi-view RGB-D Operating Room Dataset for 2D and 3D Human Pose Estimationcited by 49
- 2016The TUM LapChole dataset for the M2CAI 2016 workflow challengecited by 37
- 2020Automatic Operating Room Surgical Activity Recognition for Robot-Assisted Surgerycited by 34
- 2021Confidence-based Out-of-Distribution Detection: A Comparative Study and Analysiscited by 34
- 2021MIcro-Surgical Anastomose Workflow recognition challenge reportcited by 27
- 2019Offline identification of surgical deviations in laparoscopic rectopexycited by 12
- 2017Unsupervised temporal context learning using convolutional neural networks for laparoscopic workflow analysiscited by 7
- 2018Prediction of laparoscopic procedure duration using unlabeled, multimodal sensor datacited by 6
Built on by
Citing papers per year: 2023: 3; 2024: 0; 2025: 2; 2026: 1.
6 papers.
- 2023LABRAD-OR: Lightweight Memory Scene Graphs for Accurate Bimodal Reasoning in Dynamic Operating Roomscited by 21
- 2023Metrics Matter in Surgical Phase Recognitioncited by 13
- 2023TUNeS: A Temporal U-Net with Self-Attention for Video-based Surgical Phase Recognitioncited by 6
- 2025Beyond Role-Based Surgical Domain Modeling: Generalizable Re-Identification in the Operating Roomcited by 6
- 2025TrackOR: Towards Personalized Intelligent Operating Rooms Through Robust Trackingcited by 2
- 2026Self-Supervised Uncalibrated Multi-View Video Anonymization in the Operating Roomcited by 0
- 2026Self-Supervised Uncalibrated Multi-View Video Anonymization in the Operating Room2 Feb 2026
- 2025TrackOR: Towards Personalized Intelligent Operating Rooms Through Robust Tracking11 Aug 2025
- 2025Beyond Role-Based Surgical Domain Modeling: Generalizable Re-Identification in the Operating Room17 Mar 2025
- 2023TUNeS: A Temporal U-Net with Self-Attention for Video-based Surgical Phase Recognition19 Jul 2023
- 2023Metrics Matter in Surgical Phase Recognition23 May 2023
- 2023LABRAD-OR: Lightweight Memory Scene Graphs for Accurate Bimodal Reasoning in Dynamic Operating Rooms23 Mar 2023