mlsanityData to 7 Oct 2026

Towards Unified Surgical Skill Assessment

arXiv 2106.01035 ↗First posted 2 Jun 2021cs.CVcited by 49

Not on the map. Why?

Abstract (arXiv)

Surgical skills have a great influence on surgical safety and patients' well-being. Traditional assessment of surgical skills involves strenuous manual efforts, which lacks efficiency and repeatability. Therefore, we attempt to automatically predict how well the surgery is performed using the surgical video. In this paper, a unified multi-path framework for automatic surgical skill assessment is proposed, which takes care of multiple composing aspects of surgical skills, including surgical tool usage, intraoperative event pattern, and other skill proxies. The dependency relationships among these different aspects are specially modeled by a path dependency module in the framework. We conduct extensive experiments on the JIGSAWS dataset of simulated surgical tasks, and a new clinical dataset of real laparoscopic surgeries. The proposed framework achieves promising results on both datasets, with the state-of-the-art on the simulated dataset advanced from 0.71 Spearman's correlation to 0.80. It is also shown that combining multiple skill aspects yields better performance than relying on a single aspect.

Key facts. Cited by 49 papers in the map (data through 7 Oct 2026). Builds on 26 of its 66 references that are in the map. First posted on arXiv 2 Jun 2021.

Builds on

26 of 66 references.

References · 26

  1. 2015Deep Residual Learning for Image Recognitioncited by 51,809
  2. 2014Adam: A Method for Stochastic Optimizationcited by 36,960
  3. 2019PyTorch: An Imperative Style, High-Performance Deep Learning Librarycited by 20,160
  4. 2018Spatial Temporal Graph Convolutional Networks for Skeleton-Based Action Recognitioncited by 1,199
  5. 2016Temporal Segment Networks: Towards Good Practices for Deep Action Recognitioncited by 899
  6. 2016Temporal Convolutional Networks for Action Segmentation and Detectioncited by 504
  7. 2019MS-TCN: Multi-Stage Temporal Convolutional Network for Action Segmentationcited by 370
  8. 2020Memory-augmented Dense Predictive Coding for Video Representation Learningcited by 137
  9. 2019What and How Well You Performed? A Multitask Learning Approach to Action Quality Assessmentcited by 100
  10. 2016Learning To Score Olympic Eventscited by 87
  11. 2020Uncertainty-aware Score Distribution Learning for Action Quality Assessmentcited by 80
  12. 2018Action Quality Assessment Across Multiple Actionscited by 78
14 more
  1. 2018Learning to score the figure skating sports videoscited by 72
  2. 2018The Pros and Cons: Rank-aware Temporal Attention for Skill Determination in Long Videoscited by 68
  3. 2019Video-based surgical skill assessment using 3D convolutional neural networkscited by 57
  4. 2018Tool Detection and Operative Skill Assessment in Surgical Videos Using Region-Based Convolutional Neural Networkscited by 56
  5. 2016Am I a Baller? Basketball Performance Assessment from First-Person Videoscited by 40
  6. 2019Manipulation-skill Assessment from Videos with Spatial Attention Networkcited by 29
  7. 2017Video and Accelerometer-Based Motion Analysis for Automated Surgical Skills Assessmentcited by 28
  8. 2017Automated Surgical Skill Assessment in RMIS Trainingcited by 21
  9. 2018Evaluating surgical skills from kinematic data using convolutional neural networkscited by 19
  10. 2018Deep Learning with Convolutional Neural Network for Objective Skill Evaluation in Robot-assisted Surgerycited by 17
  11. 2020Unsupervised Surgical Instrument Segmentation via Anchor Generation and Semantic Diffusioncited by 14
  12. 2015Augmenting Bag-of-Words: Data-Driven Discovery of Temporal and Structural Information for Activity Recognitioncited by 6
  13. 2020Deep learning-based computer vision to recognize and classify suturing gestures in robot-assisted surgerycited by 5
  14. 2020Surgical Skill Assessment on In-Vivo Clinical Data via the Clearness of Operating Fieldcited by 2

Built on by

Cited by year (2026 to 7 Oct)

Citing papers per year: 2022: 5; 2023: 7; 2024: 12; 2025: 14; 2026: 11.

49 papers.

Sort:

By area:

  1. 2023Ego-Exo4D: Understanding Skilled Human Activity from First- and Third-Person Perspectivescited by 477
  2. 2023SurgicalSAM: Efficient Class Promptable Surgical Instrument Segmentationcited by 103
  3. 2024EgoExoLearn: A Dataset for Bridging Asynchronous Ego- and Exo-centric View of Procedural Activities in Real Worldcited by 93
  4. 2023Diffusion Action Segmentationcited by 74
  5. 2025MM-OR: A Large Multimodal Operating Room Dataset for Semantic Understanding of High-Intensity Surgical Environmentscited by 28
  6. 2022Exploring Intra- and Inter-Video Relation for Surgical Semantic Scene Segmentationcited by 27
  7. 2022Domain Knowledge-Informed Self-Supervised Representations for Workout Form Assessmentcited by 25
  8. 2024Multimodal Action Quality Assessmentcited by 20
  9. 2024A Comprehensive Survey of Action Quality Assessment: Method and Benchmarkcited by 20
  10. 2023PECoP: Parameter Efficient Continual Pretraining for Action Quality Assessmentcited by 19
  11. 2024ExpertAF: Expert Actionable Feedback from Videocited by 17
  12. 2025BASKET: A Large-Scale Video Dataset for Fine-Grained Skill Estimationcited by 17
37 more
  1. 2024Hierarchical NeuroSymbolic Approach for Comprehensive and Explainable Action Quality Assessmentcited by 14
  2. 2022Less is More: Surgical Phase Recognition from Timestamp Supervisioncited by 13
  3. 2022Surgical Skill Assessment via Video Semantic Aggregationcited by 13
  4. 2024RICA2: Rubric-Informed, Calibrated Assessment of Actionscited by 13
  5. 2023Continual Action Assessment via Task-Consistent Score-Discriminative Feature Distribution Modelingcited by 12
  6. 2023SurgicalPart-SAM: Part-to-Whole Collaborative Prompting for Surgical Instrument Segmentationcited by 8
  7. 2024SegSTRONG-C: Segmenting Surgical Tools Robustly On Non-adversarial Generated Corruptions -- An EndoVis'24 Challengecited by 7
  8. 2025A Decade of Action Quality Assessment: Largest Systematic Survey of Trends, Challenges, and Future Directionscited by 7
  9. 2022Using Hand Pose Estimation To Automate Open Surgery Training Feedbackcited by 6
  10. 2025Beyond Role-Based Surgical Domain Modeling: Generalizable Re-Identification in the Operating Roomcited by 6
  11. 2026Towards a Medical AI Scientistcited by 5
  12. 2023Prompt-enhanced Hierarchical Transformer Elevating Cardiopulmonary Resuscitation Instruction via Temporal Action Segmentationcited by 4
  13. 2024Surgical Triplet Recognition via Diffusion Modelcited by 4
  14. 2025HuMoCon: Concept Discovery for Human Motion Understandingcited by 4
  15. 2024CycleSAM: Few-Shot Surgical Scene Segmentation with Cycle- and Scene-Consistent Feature Matchingcited by 3
  16. 2025EgoSurgery-HTS: A Dataset for Egocentric Hand-Tool Segmentation in Open Surgery Videoscited by 3
  17. 2025Leadership Assessment in Pediatric Intensive Care Unit Team Trainingcited by 3
  18. 2025Hierarchical Context Transformer for Multi-level Semantic Scene Understandingcited by 2
  19. 2025Towards Dynamic 3D Reconstruction of Hand-Instrument Interaction in Ophthalmic Surgerycited by 2
  20. 2025Exploring Pre-training Across Domains for Few-Shot Surgical Skill Assessmentcited by 2
  21. 2024ZEAL: Surgical Skill Assessment with Zero-shot Tool Inference Using Unified Foundation Modelcited by 1
  22. 2024ReCAP: Recursive Cross Attention Network for Pseudo-Label Generation in Robotic Surgical Skill Assessmentcited by 1
  23. 2025Multi-Modal Gesture Recognition from Video and Surgical Tool Pose Information via Motion Invariantscited by 1
  24. 2025End-to-End Deep Learning for Real-Time Neuroimaging-Based Assessment of Bimanual Motor Skillscited by 1
  25. 2026A benchmark for video-based laparoscopic skill analysis and assessmentcited by 1
  26. 2026CoRe-DA: Contrastive Regression for Unsupervised Domain Adaptation in Surgical Skill Assessmentcited by 1
  27. 2026SurgTEMP: Temporal-Aware Surgical Video Question Answering with Text-guided Visual Memory for Laparoscopic Cholecystectomycited by 1
  28. 2024Robust Surgical Phase Recognition From Annotation Efficient Supervisioncited by 0
  29. 2025Meta-SurDiff: Classification Diffusion Model Optimized by Meta Learning is Reliable for Online Surgical Phase Recognitioncited by 0
  30. 2025Explainable AI for Automated User-specific Feedback in Surgical Skill Acquisitioncited by 0
  31. 2026SurgFusion-Net: Diversified Adaptive Multimodal Fusion Network for Surgical Skill Assessmentcited by 0
  32. 2026How good was my shot? Quantifying Player Skill Level in Table Tenniscited by 0
  33. 2026MoAKE: Toward Unified All-in-One Action Quality Assessment via Mixture of Action Knowledge Expertscited by 0
  34. 2026Bootstrapping Vision-Language Model for Hysteroscopic Surgical Scene Segmentationcited by 0
  35. 2026SurgSkill-Bench: A Benchmark for Multimodal Surgical Skill Assessmentcited by 0
  36. 2026DART: Depth-as-Target Pretraining for Surgical Vision Foundation Modelscited by 0
  37. 2026Semantic RGB--Depth Based Surgical Skill Assessment in Microscopic Stereo Videoscited by 0