cs.CVNov 11, 2026

Toward Cross-Rubric Surgical Skill Assessment via Joint Embedding Prediction

Authors: Jiajun Cheng, Haidar M. Abdul-Muhsin, Juha Choi, Shan Lin

Organizations: School of Electrical, Computer and Energy Engineering, Arizona State University, Tempe, AZ, USA · Department of Urology, Mayo Clinic, Phoenix, AZ, USA

Abstract

Expert review of surgical videos is essential for surgical training but labor-intensive, motivating AI-assisted skill assessment to provide feedback at scale. Although surgical assessment rubrics may use different language to describe similar skills, existing automated methods commonly predict predefined skill levels or numerical scores tied to fixed rubrics, limiting their ability to transfer across semantically equivalent assessment criteria. We propose Predictive Rubric Alignment (PRA), a joint embedding prediction approach that scores surgical videos using natural-language descriptions of skill levels. Rather than matching level probabilities, PRA predicts a rater-weighted combination of skill-level description embeddings. Adjacent description features define a score-parameterized path, and the predicted embedding is projected onto this path to read the score. We introduce two variants: PRA-item, which uses learned queries for predefined assessment items, and PRA-cond, which generates queries from textual item names to enable assessment of unseen items without retraining. On AIxSuture, a dataset of expert-rated suturing videos, PRA outperforms published baselines in skill classification. We further evaluate zero-shot transfer to the smaller surgical skill assessment benchmark JIGSAWS. Trained on only two AIxSuture rubric items, PRA-cond assesses unseen JIGSAWS items without further training, yielding positive score correlations and greater Grad-CAM overlap with instruments and suture than a description-matching baseline. These results support predictive rubric alignment as a promising direction for flexible and explainable automated surgical skill assessment.

Figures & tables

Explore similar work

CardsList
  1. SurgSkill-Bench: A Benchmark for Multimodal Surgical Skill Assessment

    Aug 31, 2026Chaohui Dang, Zheheng Jiang, James Glasbey +3Surgical Video UnderstandingMultimodal Model Evaluation

  2. Looking Beyond the Scale: Do Surgical Skill Models Learn Transferable Representations Across Assessment Rubrics?

    Aug 18, 2026Hanna Hoffmann, Felix von Bechtolsheim, Stefanie Speidel +1Cross-Domain Transfer LearningSurgical Video Understanding

  3. Explainable AI-Powered Framework for Video-Based Skill Assessment in Cataract Surgery

    Aug 18, 2026Mohammad Javad Ahmadi, Hamid D. TaghiradAutomated EvaluationSurgical Video Understanding