cs.CVNov 9, 2026

Instance-preserving graded semantic reporting for surgical action triplets

Authors: Yanchong Xue, Wanting Zhang, Lingtao Yu, Guochao Zhang

Organizations: College of Mechanical and Electrical Engineering, Harbin Engineering University, No. 145 Nantong Street, Nangang District, Harbin, 150001, Heilongjiang Province, P. R. China · Department of Thoracic Surgery I, Hainan Cancer Hospital, No. 6 Changbin West 4th Street, Xiuying District, Haikou, 570312, Hainan Province, P. R. China

Abstract

Complete-or-reject reporting of surgical action triplets can discard a correctly identified instrument and action when the target is uncertain. We introduce instance-preserving graded semantic reporting, which separates instance selection from the choice of semantic detail. Each selected instance retains its predicted mask and labels while hierarchical correctness scores guide instrument (I), instrument-verb (IV), or complete instrument-verb-target (IVT) reporting. The utility-increment rule DELTA weighs the expected gain from finer reporting against its error cost. We compare three decision rules on 5,641 test frames from eight surgical videos using fixed predictions and scores. At the 10% development calibration target, DELTA retains correct partial reports for 80.0% of candidates rejected by a matched complete-or-reject baseline (5,329/6,662). Adding IV increases source-normalized weighted correct-report yield by 19.13 to 23.13 per 100 frames across all three rules relative to separately recalibrated I/IVT controls. Weighted reporting risk changes by -0.77 to +1.01 percentage points, with complete correct-triplet counts unchanged or reduced. Graded reporting makes partial surgical predictions available as localized descriptions, with an explicit trade-off between report utility and completeness.

Figures & tables

Explore similar work

CardsList
  1. SPIRIT: Spatio-temporal Pairwise Relational Modeling of Instrument-Tissue Interactions for Surgical Action Triplet Recognition

    Aug 3, 2026Saurav Sharma, Lorenzo Arboit, Nabani Banik +11Domain GeneralizationRelational Reasoning

  2. GRAC: Graph-Based Retrieval-Augmented Captioning for Surgical Scene Description

    Nov 6, 2026Rochak Dhakal, Chen Zhao, Soup Cobb +3Image CaptioningSurgical Video Understanding

  3. TRCoRSurg: Temporal-Relational Co-Reasoning for Surgical Video Triplet Recognition

    Aug 5, 2026Fang Li, Shihao Zou, Weixin Si +3Surgical Video UnderstandingRelational Deep Learning