cs.CVFeb 21, 2026

YOLOv10-Based Multi-Task Framework for Hand Localization and Laterality Classification in Surgical Videos

Authors: Kedi Sun, Le Zhang

Organizations: School of Engineering, College of Engineering and Physical Sciences, University of Birmingham, Birmingham, UK

Abstract

Real-time hand tracking in trauma surgery is essential for supporting rapid and precise intraoperative decisions. We propose a YOLOv10-based framework that simultaneously localizes hands and classifies their laterality (left or right) in complex surgical scenes. The model is trained on the Trauma THOMPSON Challenge 2025 Task 2 dataset, consisting of first-person surgical videos with annotated hand bounding boxes. Extensive data augmentation and a multi-task detection design improve robustness against motion blur, lighting variations, and diverse hand appearances. Evaluation demonstrates accurate left-hand (67%) and right-hand (71%) classification, while distinguishing hands from the background remains challenging. The model achieves an mAP[0.5:0.95]mAP_{[0.5:0.95]} of 0.33 and maintains real-time inference, highlighting its potential for intraoperative deployment. This work establishes a foundation for advanced hand-instrument interaction analysis in emergency surgical procedures.

Figures & tables

Explore similar work

CardsList
  1. Event-Level Detection of Surgical Instrument Handovers in Videos with Interpretable Vision Models

    Apr 8, 2026Katerina Katsarou, George Zountsas, Karam Tomotaki-Dawoud +6Surgical Video UnderstandingTemporal Video Understanding

  2. Detecting Precise Hand Touch Moments in Egocentric Video

    Apr 14, 2026Huy Anh Nguyen, Feras Dayoub, Minh HoaiHand-Object Interaction DetectionEgocentric Video Understanding

  3. SHANDS: A Multi-View Dataset and Benchmark for Surgical Hand-Gesture and Error Recognition Toward Medical Training

    Mar 27, 2026Le Ma, Thiago Freitas dos Santos, Nadia Magnenat-Thalmann +1Surgical Video UnderstandingGesture Recognition