mlsanityData to 7 Oct 2026

YOLOv10-Based Multi-Task Framework for Hand Localization and Laterality Classification in Surgical Videos

arXiv 2602.18959 ↗First posted 21 Feb 2026cs.CVcited by 0

Not on the map. Why?

Abstract (arXiv)

Real-time hand tracking in trauma surgery is essential for supporting rapid and precise intraoperative decisions. We propose a YOLOv10-based framework that simultaneously localizes hands and classifies their laterality (left or right) in complex surgical scenes. The model is trained on the Trauma THOMPSON Challenge 2025 Task 2 dataset, consisting of first-person surgical videos with annotated hand bounding boxes. Extensive data augmentation and a multi-task detection design improve robustness against motion blur, lighting variations, and diverse hand appearances. Evaluation demonstrates accurate left-hand (67%) and right-hand (71%) classification, while distinguishing hands from the background remains challenging. The model achieves an mAP[0.5:0.95] of 0.33 and maintains real-time inference, highlighting its potential for intraoperative deployment. This work establishes a foundation for advanced hand-instrument interaction analysis in emergency surgical procedures.

Key facts. No citing papers in the map yet (data through 7 Oct 2026). Builds on 7 of its 12 references that are in the map. First posted on arXiv 21 Feb 2026.

Builds on

7 of 12 references.

References · 7

  1. 2014Two-Stream Convolutional Networks for Action Recognition in Videoscited by 1,067
  2. 2024YOLOv10: Real-Time End-to-End Object Detectioncited by 508
  3. 2016EndoNet: A Deep Architecture for Recognition Tasks on Laparoscopic Videoscited by 366
  4. 2020MediaPipe Hands: On-device Real-time Hand Trackingcited by 157
  5. 2020Maximum-Entropy Adversarial Data Augmentation for Improved Generalization and Robustnesscited by 121
  6. 2024EgoSurgery-Tool: A Dataset of Surgical Tool and Hand Detection from Egocentric Open Surgery Videoscited by 7
  7. 2024How Important are Data Augmentations to Close the Domain Gap for Object Detection in Orbit?cited by 3

Built on by

Not cited yet.