cs.CVNov 18, 2026

When accuracy hides risk: risk-controlled confirmation of the critical view of safety under expert disagreement

Authors: Bowen Xiang, Xiao Yu, Mingze Xu

Organizations: Department of Biomedical Engineering, Vanderbilt University, 2301 Vanderbilt Place, Nashville, TN, 37235, USA · Xiangshu MedTech, Hangzhou, China

Abstract

Automated assessment of the critical view of safety (CVS) in laparoscopic cholecystectomy has advanced rapidly, but a deployed check must decide, before the first clip, whether to confirm CVS. The standard rule calibrates a threshold so that false confirmations are rare on average. We show that this rule concentrates its errors on disputed videos, which one of three expert raters judged sufficient, and that the failure is structural. When reference labels are votes of a panel sampled from a larger expert pool, the rule that maximizes sensitivity at a fixed average false-confirmation rate also maximizes false confirmation of disputed videos, and for recognizers that recover expert judgement with less noise this rate rises with accuracy. We propose certified confirmation, a risk-controlled monitoring rule whose threshold is selected by multiple testing so that, with probability at least 1 - δ, false confirmation is at most α overall, among disputed videos, within vendor and country groups, and before CVS is visible, using disputed labels only to calibrate. In a pre-specified, hash-locked evaluation on the 300 test videos (18 countries) of the SAGES CVS Challenge, standard calibration falsely confirmed 8 of 39 disputed videos (0.21; one-sided p = 0.037 against α = 0.10), whereas certified confirmation confirmed 2 (one-sided 95% upper bound 0.15). On development data, protection held for vendor and country groups left out of calibration. The cost was confirming 10% rather than 35% of sufficient videos on time. Average accuracy hides this risk; disputed cases must be protected explicitly.

Figures & tables

Appendix figures & tables3 assets

Supplementary material from the paper’s appendix.

Appendix

Explore similar work

CardsList
  1. Sum-of-Checks: Structured Reasoning for Surgical Safety with Large Vision-Language Models

    Apr 24, 2026Weiqiu You, Cassandra Goldberg, Amin Madani +2EndoscopySurgical Video Understanding

  2. CasCVS-Net: A Staged Multi-Task Cascade for Critical View of Safety Assessment

    Sep 23, 2026Bock-Zien Toh, Yuanchuan Ren, Tay Aw Yu +3Multi-Task LearningSurgical Video Understanding

  3. Structured Reasoning Agentic Framework for Interpretable Critical View of Safety Assessment

    Sep 25, 2026Qing Xu, Yuxiang Luo, Zhen ChenSurgical Video UnderstandingExplainable Medical Image Analysis