TeCNO: Surgical Phase Recognition with Multi-Stage Temporal Convolutional Networks
Not on the map. Why?
Abstract (arXiv)
Automatic surgical phase recognition is a challenging and crucial task with the potential to improve patient safety and become an integral part of intra-operative decision-support systems. In this paper, we propose, for the first time in workflow analysis, a Multi-Stage Temporal Convolutional Network (MS-TCN) that performs hierarchical prediction refinement for surgical phase recognition. Causal, dilated convolutions allow for a large receptive field and online inference with smooth predictions even during ambiguous transitions. Our method is thoroughly evaluated on two datasets of laparoscopic cholecystectomy videos with and without the use of additional surgical tool information. Outperforming various state-of-the-art LSTM approaches, we verify the suitability of the proposed causal MS-TCN for surgical phase recognition.
Key facts. Cited by 139 papers in the map (data through 7 Oct 2026). First posted on arXiv 24 Mar 2020.
Builds on
No reference list yet.
Built on by
Citing papers per year: 2021: 9; 2022: 19; 2023: 28; 2024: 27; 2025: 36; 2026: 20.
139 papers.
Sort:
By area:
- 2021Trans-SVNet: Accurate Phase Recognition from Surgical Videos via Hybrid Embedding Aggregation Transformercited by 93
- 2021MedPerf: Open Benchmarking Platform for Medical Artificial Intelligence using Federated Evaluationcited by 88
- 2022AutoLaparo: A New Dataset of Integrated Multi-tasks for Image-guided Surgical Automation in Laparoscopic Hysterectomycited by 85
- 2023Learning Multi-modal Representations by Watching Hundreds of Surgical Video Lecturescited by 68
- 2021OperA: Attention-Regularized Transformers for Surgical Phase Recognitioncited by 60
- 2023LoViT: Long Video Transformer for Surgical Phase Recognitioncited by 56
- 20224D-OR: Semantic Scene Graphs for OR Domain Modelingcited by 49
- 2022Dissecting Self-Supervised Learning Methods for Surgical Computer Visioncited by 48
- 2022CholecTriplet2021: A benchmark challenge for surgical action triplet recognitioncited by 44
- 2021Multi-Task Temporal Convolutional Networks for Joint Recognition of Surgical Phases and Steps in Gastric Bypass Procedurescited by 42
- 2024HecVL: Hierarchical Video-Language Pretraining for Zero-shot Surgical Phase Recognitioncited by 41
- 2023Challenges in Multi-centric Generalization: Phase and Step Recognition in Roux-en-Y Gastric Bypass Surgerycited by 40
38 more
- 2022Latent Graph Representations for Critical View of Safety Assessmentcited by 37
- 2024LLaVA-Surg: Towards Multimodal Surgical Assistant via Structured Surgical Video Learningcited by 34
- 2024Surgformer: Surgical Transformer with Hierarchical Temporal Attention for Surgical Phase Recognitioncited by 32
- 2024OphNet: A Large-Scale Video Benchmark for Ophthalmic Surgical Workflow Understandingcited by 31
- 2022Rendezvous in Time: An Attention-based Temporal Fusion approach for Surgical Triplet Recognitioncited by 27
- 2024General surgery vision transformer: A video pre-trained foundation model for general surgerycited by 25
- 2025Scaling up self-supervised learning for improved surgical foundation modelscited by 25
- 2021Exploring Segment-level Semantics for Online Phase Recognition from Surgical Videoscited by 23
- 2023CholecTriplet2022: Show me a tool and tell me the triplet -- an endoscopic vision challenge for surgical action triplet detectioncited by 22
- 2023Self-Supervised Learning for Endoscopic Video Analysiscited by 22
- 2023LABRAD-OR: Lightweight Memory Scene Graphs for Accurate Bimodal Reasoning in Dynamic Operating Roomscited by 21
- 2023Dynamic Scene Graph Representation for Surgical Videocited by 21
- 2021Not End-to-End: Explore Multi-Stage Architecture for Online Surgical Phase Recognitioncited by 20
- 2024EgoSurgery-Phase: A Dataset of Surgical Phase Recognition from Egocentric Open Surgery Videoscited by 20
- 2022On the Pitfalls of Batch Normalization for End-to-End Video Learning: A Study on Surgical Workflow Analysiscited by 19
- 2025LEMON: A Large Endoscopic MONocular Dataset and Foundation Model for Perception in Surgical Settingscited by 19
- 2022Federated Cycling (FedCy): Semi-supervised Federated Learning of Surgical Phasescited by 18
- 2023CholecTrack20: A Multi-Perspective Tracking Dataset for Surgical Toolscited by 17
- 2025SurgLaVi: Large-Scale Hierarchical Dataset for Surgical Vision-Language Representation Learningcited by 16
- 2023Encoding Surgical Videos as Latent Spatiotemporal Graphs for Object and Anatomy-Driven Reasoningcited by 14
- 2024ORacle: Large Vision-Language Models for Knowledge-Guided Holistic OR Domain Modelingcited by 14
- 2022Less is More: Surgical Phase Recognition from Timestamp Supervisioncited by 13
- 2022An Empirical Study on Activity Recognition in Long Surgical Videoscited by 13
- 2023Metrics Matter in Surgical Phase Recognitioncited by 13
- 2023SurgPLAN: Surgical Phase Localization Network for Phase Recognitioncited by 12
- 2024Surgical Workflow Recognition and Blocking Effectiveness Detection in Laparoscopic Liver Resections with Pringle Maneuvercited by 12
- 2024VidLPRO: A underlineVideo-underlineLanguage underlinePre-training Framework for underlineRobotic and Laparoscopic Surgerycited by 12
- 2021Efficient Global-Local Memory for Real-time Instrument Segmentation of Robotic Surgical Videocited by 10
- 2024PitVis-2023 Challenge: Workflow Recognition in videos of Endoscopic Pituitary Surgerycited by 10
- 2025Large-scale Self-supervised Video Foundation Model for Intelligent Surgerycited by 10
- 2023Self-distillation for surgical action recognitioncited by 9
- 2023DisguisOR: Holistic Face Anonymization for the Operating Roomcited by 9
- 2023Whether and When does Endoscopy Domain Pretraining Make Sense?cited by 8
- 2023Jumpstarting Surgical Computer Visioncited by 8
- 2024MuST: Multi-Scale Transformers for Surgical Phase Recognitioncited by 8
- 2025Surgical Scene Understanding in the Era of Foundation AI Models: A Comprehensive Reviewcited by 8
- 2022Retrieval of surgical phase transitions using reinforcement learningcited by 7
- 2023SurgMAE: Masked Autoencoders for Long Surgical Video Analysiscited by 7
50 most cited of 139 All 139 (JSON)
- 2026A Hierarchy-Aware Video-Language Model Evaluation and Hyperbolic Baseline for Surgery22 Sep 2026
- 2026An Integrated Video-AI Platform for Action-Level Microanastomosis Training and Performance Feedback6 Sep 2026
- 2026Multimodal Shared Latent Representation of Narration, Microscope and iOCT Images for Phase Recognition in Vitreoretinal Surgery31 Aug 2026
- 2026SurgNarrator: A Generative Retrieval Framework for Surgical Video Understanding5 Aug 2026
- 2026SPIRIT: Spatio-temporal Pairwise Relational Modeling of Instrument-Tissue Interactions for Surgical Action Triplet Recognition3 Aug 2026
- 2026Extended KAFR: A kinematic-adaptive paradigm for the efficient analysis of surgical video2 Aug 2026
- 2026Temporally Consistent Label Interpolation for Robust Surgical Multi-Task Learning under Challenging Conditions25 Jun 2026
- 2026GeoCFNet: Geometry-Aware Confidence Field Network for Robot-Assisted Endoscopic Submucosal Dissection11 Jun 2026
- 2026SURGENT: A Surgical Multi-Agent Assistance System Across the Perioperative Workflow28 May 2026
- 2026ST-ColoNet: Spatio-Temporal Colon Segment Recognition via Hybrid Attention and Edge-Guided Feature Learning27 May 2026
- 2026OSS: Open Suturing Skills Vision-Based Assessment Challenge 2024-202521 May 2026
- 2026SurgicalMamba: Dual-Path SSD with State Regramming for Online Surgical Phase Recognition14 May 2026
38 more
- 2026Stabilizing Temporal Inference Dynamics for Online Surgical Phase Recognition11 May 2026
- 2026Event-Level Detection of Surgical Instrument Handovers in Videos with Interpretable Vision Models8 Apr 2026
- 2026Towards Next-Generation Healthcare: A Survey of Medical Embodied AI for Perception, Decision-Making, and Action5 Apr 2026
- 2026SurgPhase: Time efficient pituitary tumor surgery phase recognition via an interactive web platform26 Mar 2026
- 2026Multimodal Optimal Transport for Training-free Temporal Segmentation in Surgical Robotics27 Feb 2026
- 2026Strategy-Supervised Autonomous Laparoscopic Camera Control via Event-Driven Graph Mining24 Feb 2026
- 2026Loss Knows Best: Detecting Annotation Errors in Videos via Loss Trajectories16 Feb 2026
- 2026CurConMix+: A Unified Spatio-Temporal Framework for Hierarchical Surgical Workflow Understanding18 Jan 2026
- 2025Kinematic-Based Assessment of Surgical Actions in Microanastomosis30 Dec 2025
- 2025DSTED: Decoupling Temporal Stabilization and Discriminative Enhancement for Surgical Workflow Recognition22 Dec 2025
- 2025CataractCompDetect: Intraoperative Complication Detection in Cataract Surgery24 Nov 2025
- 2025Cataract-LMM Large-Scale Multi-Source Multi-Task Benchmark for Deep Learning in Surgical Video Analysis18 Oct 2025
- 2025State-Change Learning for Prediction of Future Events in Endoscopic Videos14 Oct 2025
- 2025Token Merging via Spatiotemporal Information Mining for Surgical Video Understanding28 Sep 2025
- 2025Multi-scale Temporal Prediction via Incremental Generation and Multi-agent Collaboration22 Sep 2025
- 2025SurgLaVi: Large-Scale Hierarchical Dataset for Surgical Vision-Language Representation Learning9 Sep 2025
- 2025Analysis of Transferability Estimation Metrics for Surgical Phase Recognition22 Aug 2025
- 2025Data-Efficient Learning for Generalizable Surgical Video Understanding13 Aug 2025
- 2025StepAL: Step-aware Active Learning for Cataract Surgical Videos29 Jul 2025
- 2025Comparative validation of surgical phase recognition, instrument keypoint estimation, and instrument instance segmentation in endoscopy: Results of the PhaKIR 2024 challenge22 Jul 2025
- 2025Geo-RepNet: Geometry-Aware Representation Learning for Surgical Phase Recognition in Endoscopic Submucosal Dissection12 Jul 2025
- 2025CPKD: Clinical Prior Knowledge-Constrained Diffusion Models for Surgical Phase Recognition in Endoscopic Submucosal Dissection4 Jul 2025
- 2025Recognizing Surgical Phases Anywhere: Few-Shot Test-time Adaptation and Task-graph Guided Refinement25 Jun 2025
- 2025Meta-SurDiff: Classification Diffusion Model Optimized by Meta Learning is Reliable for Online Surgical Phase Recognition17 Jun 2025
- 2025Challenging Vision-Language Models with Surgical Data: A New Dataset and Broad Benchmarking Study6 Jun 2025
- 2025Large-scale Self-supervised Video Foundation Model for Intelligent Surgery3 Jun 2025
- 2025SemiVT-Surge: Semi-Supervised Video Transformer for Surgical Phase Recognition2 Jun 2025
- 2025ReSW-VL: Representation Learning for Surgical Workflow Analysis Using Vision-Language Model19 May 2025
- 2025Surgical Foundation Model Leveraging Compression and Entropy Maximization for Image-Guided Surgical Assistance16 May 2025
- 2025Multimodal Graph Representation Learning for Robust Surgical Workflow Recognition with Adversarial Feature Disentanglement3 May 2025
- 2025Surgeons vs. Computer Vision: A comparative analysis on surgical phase recognition capabilities26 Apr 2025
- 2025Multi-Stage Boundary-Aware Transformer Network for Action Segmentation in Untrimmed Surgical Videos26 Apr 2025
- 2025Federated EndoViT: Pretraining Vision Transformers via Federated Learning on Endoscopic Image Collections23 Apr 2025
- 2025LEMON: A Large Endoscopic MONocular Dataset and Foundation Model for Perception in Surgical Settings25 Mar 2025
- 2025CoStoDet-DDPM: Collaborative Training of Stochastic and Deterministic Models Improves Surgical Workflow Anticipation and Recognition13 Mar 2025
- 2025MoSFormer: Augmenting Temporal Context with Memory of Surgery for Surgical Phase Recognition2 Mar 2025
- 2025Hierarchical Context Transformer for Multi-level Semantic Scene Understanding21 Feb 2025
- 2025Multi-view Video-Pose Pretraining for Operating Room Surgical Activity Recognition19 Feb 2025
50 newest of 139 All 139 (JSON)
- 2024LLaVA-Surg: Towards Multimodal Surgical Assistant via Structured Surgical Video Learningcited by 34
- 2025SurgLaVi: Large-Scale Hierarchical Dataset for Surgical Vision-Language Representation Learningcited by 16
- 2024ORacle: Large Vision-Language Models for Knowledge-Guided Holistic OR Domain Modelingcited by 14
- 2025Challenging Vision-Language Models with Surgical Data: A New Dataset and Broad Benchmarking Studycited by 1
- 2025SurgLaVi: Large-Scale Hierarchical Dataset for Surgical Vision-Language Representation Learning9 Sep 2025
- 2025Challenging Vision-Language Models with Surgical Data: A New Dataset and Broad Benchmarking Study6 Jun 2025
- 2024LLaVA-Surg: Towards Multimodal Surgical Assistant via Structured Surgical Video Learning15 Aug 2024
- 2024ORacle: Large Vision-Language Models for Knowledge-Guided Holistic OR Domain Modeling10 Apr 2024
- 2025CoStoDet-DDPM: Collaborative Training of Stochastic and Deterministic Models Improves Surgical Workflow Anticipation and Recognitioncited by 0
- 2025Meta-SurDiff: Classification Diffusion Model Optimized by Meta Learning is Reliable for Online Surgical Phase Recognitioncited by 0
- 2025CPKD: Clinical Prior Knowledge-Constrained Diffusion Models for Surgical Phase Recognition in Endoscopic Submucosal Dissectioncited by 0
- 2025CPKD: Clinical Prior Knowledge-Constrained Diffusion Models for Surgical Phase Recognition in Endoscopic Submucosal Dissection4 Jul 2025
- 2025Meta-SurDiff: Classification Diffusion Model Optimized by Meta Learning is Reliable for Online Surgical Phase Recognition17 Jun 2025
- 2025CoStoDet-DDPM: Collaborative Training of Stochastic and Deterministic Models Improves Surgical Workflow Anticipation and Recognition13 Mar 2025
- 2024SR-Mamba: Effective Surgical Phase Recognition with State Space Modelcited by 5
- 2024SEDMamba: Enhancing Selective State Space Modelling with Bottleneck Mechanism and Fine-to-Coarse Temporal Fusion for Efficient Error Detection in Robot-Assisted Surgerycited by 3
- 2024SPRMamba: Surgical Phase Recognition for Endoscopic Submucosal Dissection with Mambacited by 3
- 2024SPRMamba: Surgical Phase Recognition for Endoscopic Submucosal Dissection with Mamba18 Sep 2024
- 2024SR-Mamba: Effective Surgical Phase Recognition with State Space Model11 Jul 2024
- 2024SEDMamba: Enhancing Selective State Space Modelling with Bottleneck Mechanism and Fine-to-Coarse Temporal Fusion for Efficient Error Detection in Robot-Assisted Surgery22 Jun 2024
- 2021Trans-SVNet: Accurate Phase Recognition from Surgical Videos via Hybrid Embedding Aggregation Transformercited by 93
- 2021MedPerf: Open Benchmarking Platform for Medical Artificial Intelligence using Federated Evaluationcited by 88
- 2022AutoLaparo: A New Dataset of Integrated Multi-tasks for Image-guided Surgical Automation in Laparoscopic Hysterectomycited by 85
- 2023Learning Multi-modal Representations by Watching Hundreds of Surgical Video Lecturescited by 68
- 2021OperA: Attention-Regularized Transformers for Surgical Phase Recognitioncited by 60
- 2023LoViT: Long Video Transformer for Surgical Phase Recognitioncited by 56
- 20224D-OR: Semantic Scene Graphs for OR Domain Modelingcited by 49
- 2022Dissecting Self-Supervised Learning Methods for Surgical Computer Visioncited by 48
- 2022CholecTriplet2021: A benchmark challenge for surgical action triplet recognitioncited by 44
- 2021Multi-Task Temporal Convolutional Networks for Joint Recognition of Surgical Phases and Steps in Gastric Bypass Procedurescited by 42
- 2024HecVL: Hierarchical Video-Language Pretraining for Zero-shot Surgical Phase Recognitioncited by 41
- 2023Challenges in Multi-centric Generalization: Phase and Step Recognition in Roux-en-Y Gastric Bypass Surgerycited by 40
12 most cited of 126 All 126 (JSON)
- 2026A Hierarchy-Aware Video-Language Model Evaluation and Hyperbolic Baseline for Surgery22 Sep 2026
- 2026An Integrated Video-AI Platform for Action-Level Microanastomosis Training and Performance Feedback6 Sep 2026
- 2026Multimodal Shared Latent Representation of Narration, Microscope and iOCT Images for Phase Recognition in Vitreoretinal Surgery31 Aug 2026
- 2026SurgNarrator: A Generative Retrieval Framework for Surgical Video Understanding5 Aug 2026
- 2026SPIRIT: Spatio-temporal Pairwise Relational Modeling of Instrument-Tissue Interactions for Surgical Action Triplet Recognition3 Aug 2026
- 2026Extended KAFR: A kinematic-adaptive paradigm for the efficient analysis of surgical video2 Aug 2026
- 2026Temporally Consistent Label Interpolation for Robust Surgical Multi-Task Learning under Challenging Conditions25 Jun 2026
- 2026GeoCFNet: Geometry-Aware Confidence Field Network for Robot-Assisted Endoscopic Submucosal Dissection11 Jun 2026
- 2026ST-ColoNet: Spatio-Temporal Colon Segment Recognition via Hybrid Attention and Edge-Guided Feature Learning27 May 2026
- 2026OSS: Open Suturing Skills Vision-Based Assessment Challenge 2024-202521 May 2026
- 2026SurgicalMamba: Dual-Path SSD with State Regramming for Online Surgical Phase Recognition14 May 2026
- 2026Stabilizing Temporal Inference Dynamics for Online Surgical Phase Recognition11 May 2026
12 newest of 126 All 126 (JSON)