mlsanityData to 14 Oct 2026

Extended KAFR: A kinematic-adaptive paradigm for the efficient analysis of surgical video

arXiv 2608.01058 ↗First posted 2 Aug 2026cs.CVcited by 0

Not on the map. Why?

Abstract (arXiv)

Artificial Intelligence is increasingly applied to surgical video analysis for phase segmentation, skill assessment, and workflow optimization. A key challenge is the length of surgical recordings, often one to several hours, creating substantial computational burden. We previously developed Kinematics-Adaptive Frame Recognition (KAFR) for robotic surgery, showing that tracking tool motion effectively identifies informative frames while filtering redundant content. However, laparoscopic surgery introduces additional challenges: manual camera control causes frequent motion artifacts, and image quality is generally lower than robotic systems. This study evaluates whether KAFR generalizes to laparoscopic surgery using the Cholec80 benchmark, comprising 80 laparoscopic cholecystectomy procedures annotated for seven surgical phases. KAFR operates in three stages: a fine-tuned YOLO model detects and segments surgical tools; frames are adaptively selected based on tool displacement or velocity variation; and an X3D model classifies selected frames into surgical phases. KAFR achieved a 91.0% F1 score using only 0.58% of frames for phase classification, representing an approximately seven-fold reduction compared to typical 4% frame sampling, while maintaining performance comparable to LoViT (90.2%) and Trans-SVNet (89.7%). These results demonstrate that kinematics-based frame selection transfers effectively to the challenging laparoscopic environment.

Key facts. No citing papers in the map yet (data through 14 Oct 2026). Builds on 29 of its 59 references that are in the map. First posted on arXiv 2 Aug 2026.

Builds on

29 of 59 references.

References · 29

  1. 2014Microsoft COCO: Common Objects in Contextcited by 17,608
  2. 2015You Only Look Once: Unified, Real-Time Object Detectioncited by 4,852
  3. 2018MobileNetV2: Inverted Residuals and Linear Bottleneckscited by 4,795
  4. 2017Quo Vadis, Action Recognition? A New Model and the Kinetics Datasetcited by 3,270
  5. 2020X3D: Expanding Architectures for Efficient Video Recognitioncited by 637
  6. 2016EndoNet: A Deep Architecture for Recognition Tasks on Laparoscopic Videoscited by 367
  7. 2020TeCNO: Surgical Phase Recognition with Multi-Stage Temporal Convolutional Networkscited by 141
  8. 2021Rendezvous: Attention Mechanisms for the Recognition of Surgical Action Triplets in Endoscopic Videoscited by 141
  9. 2020Surgical Data Science -- from Concepts toward Clinical Translationcited by 105
  10. 2021Trans-SVNet: Accurate Phase Recognition from Surgical Videos via Hybrid Embedding Aggregation Transformercited by 94
  11. 2019Multi-Task Recurrent Convolutional Network with Correlation Loss for Surgical Video Analysiscited by 76
  12. 2021Temporal Memory Relation Network for Workflow Recognition from Surgical Videocited by 66
17 more
  1. 2021OperA: Attention-Regularized Transformers for Surgical Phase Recognitioncited by 60
  2. 2023LoViT: Long Video Transformer for Surgical Phase Recognitioncited by 56
  3. 2017Exploiting the potential of unlabeled endoscopic video data with self-supervised learningcited by 33
  4. 2025Scaling up self-supervised learning for improved surgical foundation modelscited by 25
  5. 2022Less is More: Surgical Phase Recognition from Timestamp Supervisioncited by 13
  6. 2022An Empirical Study on Activity Recognition in Long Surgical Videoscited by 13
  7. 2023Preserving Privacy in Surgical Video Analysis Using Artificial Intelligence: A Deep Learning Classifier to Identify Out-of-Body Scenes in Endoscopic Videoscited by 8
  8. 2023TUNeS: A Temporal U-Net with Self-Attention for Video-based Surgical Phase Recognitioncited by 6
  9. 2023Video Action Recognition Collaborative Learning with Dynamics via PSO-ConvNet Transformercited by 4
  10. 2019Advanced Capsule Networks via Context Awarenesscited by 3
  11. 2020An Improvement for Capsule Networks using Depthwise Separable Convolutioncited by 3
  12. 2024Evaluating Model Performance with Hard-Swish Activation Function Adjustmentscited by 3
  13. 2019Offline and Online Deep Learning for Image Recognitioncited by 2
  14. 2022Action Recognition for American Sign Languagecited by 2
  15. 2024Friends Across Time: Multi-Scale Action Segmentation Transformer for Surgical Phase Recognitioncited by 2
  16. 2024Machine Learning-Based Automated Assessment of Intracorporeal Suturing in Laparoscopic Fundoplicationcited by 2
  17. 2025Efficient Frame Extraction: A Novel Approach Through Frame Similarity and Surgical Tool Tracking for Video Segmentationcited by 2

Built on by

Not cited yet.