mlsanityData to 14 Oct 2026

An Integrated Video-AI Platform for Action-Level Microanastomosis Training and Performance Feedback

arXiv 2609.06380 ↗First posted 6 Sep 2026cs.CVcited by 0

Not on the map. Why?

Abstract (arXiv)

Developing microanastomosis skill requires repeated practice with timely, action-specific feedback, yet expert review of lengthy microscope videos does not scale to frequent or distributed training. We present an integrated video-AI platform that turns a complete simulated procedure into inspectable, interactive feedback through three connected modules. First, a proposed transformer segments the video into six surgical actions. Second, object detection and tracking localize instrument tips within each action; the resulting kinematic features and action statistics drive supervised classification of five NOMAT-aligned performance dimensions. Third, a grounded large language model (LLM) uses these structured outputs to answer user questions about the current scene, actions, motion, and predicted performance through a unified interface. In a two-site study, 17 participants completed 72 procedures comprising 576 suture placements. The action-segmentation module achieved 87.66% accuracy and 82.86% F1, increasing to 93.62% and 88.32% after workflow-aware refinement. The five performance classifiers achieved 76.0% mean accuracy, with Cohen's kappa from 0.63 to 0.93. Although the language interface and educational benefit require prospective evaluation, these results establish the technical basis for an expert-supervised platform that can shorten review, expose the evidence behind performance estimates, and support scalable formative microsurgical training.

Key facts. No citing papers in the map yet (data through 14 Oct 2026). Builds on 15 of its 23 references that are in the map. First posted on arXiv 6 Sep 2026.

Builds on

15 of 23 references.

References · 15

  1. 2015You Only Look Once: Unified, Real-Time Object Detectioncited by 4,852
  2. 2017The Kinetics Human Action Video Datasetcited by 1,909
  3. 2021Is Space-Time Attention All You Need for Video Understanding?cited by 1,620
  4. 2017Simple Online and Realtime Tracking with a Deep Association Metriccited by 910
  5. 2019MS-TCN: Multi-Stage Temporal Convolutional Network for Action Segmentationcited by 373
  6. 2022ActionFormer: Localizing Moments of Actions with Transformerscited by 311
  7. 2021ASFormer: Transformer for Action Segmentationcited by 168
  8. 2020TeCNO: Surgical Phase Recognition with Multi-Stage Temporal Convolutional Networkscited by 141
  9. 2019Video-based surgical skill assessment using 3D convolutional neural networkscited by 57
  10. 2024Surgformer: Surgical Transformer with Hierarchical Temporal Attention for Surgical Phase Recognitioncited by 32
  11. 2020Interpretable Machine Learning with an Ensemble of Gradient Boosting Machinescited by 14
  12. 2022Surgical Skill Assessment via Video Semantic Aggregationcited by 13
3 more
  1. 2021Video-based fully automatic assessment of open surgery suturing skillscited by 12
  2. 2018SATR-DL: Improving Surgical Skill Assessment and Task Recognition in Robot-assisted Surgery with Deep Neural Networkscited by 6
  3. 2026An AI Framework for Microanastomosis Motion Assessmentcited by 1

Built on by

Not cited yet.

Similar, not cited

Close in wording, no citation either way

  1. 2026SAW: Toward a Surgical Action World Model via Controllable and Scalable Video Generation
  2. 2025Towards Suturing World Models: Learning Predictive Models for Robotic Surgical Tasks
  3. 2025Cosmos-Surg-dVRK: World Foundation Model-based Automated Online Evaluation of Surgical Robot Policy Learning
  4. 2026Surgical WAM: A World-Action Model for Data-Efficient Surgical Robot Learning
  5. 2026A Comparative Study in Surgical AI: Potential and Limitations of Data, Compute, and Scaling
  6. 2025SG2VID: Scene Graphs Enable Fine-Grained Control for Video Synthesis
  7. 2026Surg-UniWorld: A Unified Surgical World Model with Multimodal Control Experts
  8. 2025How Far Are Surgeons from Surgical World Models? A Pilot Study on Zero-shot Surgical Video Generation with Expert Assessment