mlsanityData to 7 Oct 2026

Video-based Formative and Summative Assessment of Surgical Tasks using Deep Learning

arXiv 2203.09589 ↗First posted 17 Mar 2022cs.CV cs.AIcited by 8

Not on the map. Why?

Abstract (arXiv)

To ensure satisfactory clinical outcomes, surgical skill assessment must be objective, time-efficient, and preferentially automated - none of which is currently achievable. Video-based assessment (VBA) is being deployed in intraoperative and simulation settings to evaluate technical skill execution. However, VBA remains manually- and time-intensive and prone to subjective interpretation and poor inter-rater reliability. Herein, we propose a deep learning (DL) model that can automatically and objectively provide a high-stakes summative assessment of surgical skill execution based on video feeds and low-stakes formative assessment to guide surgical skill acquisition. Formative assessment is generated using heatmaps of visual features that correlate with surgical performance. Hence, the DL model paves the way to the quantitative and reproducible evaluation of surgical tasks from videos with the potential for broad dissemination in surgical training, certification, and credentialing.

Key facts. Cited by 8 papers in the map (data through 7 Oct 2026). Builds on 23 of its 46 references that are in the map. First posted on arXiv 17 Mar 2022.

Builds on

23 of 46 references.

References · 23

  1. 2015Deep Residual Learning for Image Recognitioncited by 51,809
  2. 2014Microsoft COCO: Common Objects in Contextcited by 17,498
  3. 2015Faster R-CNN: Towards Real-Time Object Detection with Region Proposal Networkscited by 9,617
  4. 2017Mask R-CNNcited by 7,259
  5. 2015Fast R-CNNcited by 2,930
  6. 2015Learning Deep Features for Discriminative Localizationcited by 2,430
  7. 2015Multi-Scale Context Aggregation by Dilated Convolutionscited by 1,128
  8. 2013Network In Networkcited by 600
  9. 2019The VIA Annotation Software for Images, Audio and Videocited by 166
  10. 2018Concurrent Spatial and Channel Squeeze & Excitation in Fully Convolutional Networkscited by 120
  11. 2019Video-based surgical skill assessment using 3D convolutional neural networkscited by 57
  12. 2018Tool Detection and Operative Skill Assessment in Surgical Videos Using Region-Based Convolutional Neural Networkscited by 56
11 more
  1. 2019Deep Learning on Small Datasets without Pre-Training using Cosine Losscited by 41
  2. 2017Automated Surgical Skill Assessment in RMIS Trainingcited by 21
  3. 2018Evaluating surgical skills from kinematic data using convolutional neural networkscited by 19
  4. 2020How Much Can We Really Trust You? Towards Simple, Interpretable Trust Quantification Metrics for Deep Neural Networkscited by 19
  5. 2019Accurate and interpretable evaluation of surgical skills from kinematic data using fully convolutional neural networkscited by 18
  6. 2018Deep Learning with Convolutional Neural Network for Objective Skill Evaluation in Robot-assisted Surgerycited by 17
  7. 2021Video-based fully automatic assessment of open surgery suturing skillscited by 12
  8. 2021Deep Neural Networks for the Assessment of Surgical Skills: A Systematic Reviewcited by 9
  9. 2020Where Does Trust Break Down? A Quantitative Trust Analysis of Deep Neural Networks via Trust Matrix and Conditional Trust Densitiescited by 7
  10. 2016Machine Learning Approach for Skill Evaluation in Robotic-Assisted Surgerycited by 5
  11. 2017Who's Better? Who's Best? Pairwise Deep Ranking for Skill Determinationcited by 4

Built on by

Cited by year (2026 to 7 Oct)

Citing papers per year: 2022: 1; 2023: 0; 2024: 5; 2025: 1; 2026: 1.

8 papers.

  1. 2022One-shot skill assessment in high-stakes domains with limited data via meta learningcited by 4
  2. 2024Machine Learning-Based Automated Assessment of Intracorporeal Suturing in Laparoscopic Fundoplicationcited by 2
  3. 2024ZEAL: Surgical Skill Assessment with Zero-shot Tool Inference Using Unified Foundation Modelcited by 1
  4. 2024ReCAP: Recursive Cross Attention Network for Pseudo-Label Generation in Robotic Surgical Skill Assessmentcited by 1
  5. 2025End-to-End Deep Learning for Real-Time Neuroimaging-Based Assessment of Bimanual Motor Skillscited by 1
  6. 2024Cognitive-Motor Integration in Assessing Bimanual Motor Skillscited by 0
  7. 2024Deep Learning for Video-Based Assessment of Endotracheal Intubation Skillscited by 0
  8. 2026Video-based Surgical Skill Assessment Using Dynamics-and-Uncertainty-Aware Tree-based Gaussian Process Classifiercited by 0