cs.CVApr 10, 2026

Fine-Grained Action Segmentation for Renorrhaphy in Robot-Assisted Partial Nephrectomy

Authors: Jiaheng Dai, Huanrong Liu, Tailai Zhou, Tongyu Jia, Qin Liu, Yutong Ban, Zeju Li, Yu Gao, 

Organizations: Fudan University, Shanghai, China · University of Macau, Macau, China · The Chinese PLA General Hospital, Beijing, China · Shanghai Jiao Tong University, Shanghai, China

Abstract

Fine-grained action segmentation during renorrhaphy in robot-assisted partial nephrectomy requires frame-level recognition of visually similar suturing gestures with variable duration and substantial class imbalance. The SIA-RAPN benchmark defines this problem on 50 clinical videos acquired with the da Vinci Xi system and annotated with 12 frame-level labels. The benchmark compares four temporal models built on I3D features: MS-TCN++, AsFormer, TUT, and DiffAct. Evaluation uses balanced accuracy, edit score, segmental F1 at overlap thresholds of 10, 25, and 50, frame-wise accuracy, and frame-wise mean average precision. In addition to the primary evaluation across five released split configurations on SIA-RAPN, the benchmark reports cross-domain results on a separate single-port RAPN dataset. Across the strongest reported values over those five runs on the primary dataset, DiffAct achieves the highest F1, frame-wise accuracy, edit score, and frame mAP, while MS-TCN++ attains the highest balanced accuracy.

Figures & tables

Explore similar work

CardsList
  1. Multimodal Optimal Transport for Training-free Temporal Segmentation in Surgical Robotics

    Feb 27, 2026Omar Mohamed, Edoardo Fazzari, Ayah Al-Naji +5Temporal Action SegmentationSurgical Video Understanding

  2. OR-Action: Multi-Role Video Understanding with Fine-Grained Actions

    Jun 11, 2026Felix Tristram, Ege Özsoy, Christian Benz +3Temporal Action SegmentationHuman Activity Recognition