cs.CVNov 14, 2026

EndoComparer: Comparative Surgical Video Question Answering with Pseudo-Siamese Visual Adaptation and Perceive-then-Compare Reasoning

Authors: Shi Li, Lalith Sharan, Joël L. Lavanchy, Kun Yuan, Lorenzo Arboit, Nabani Banik, Elif Yazici, Maria Vannucci, 

Organizations: ICube, UMR7357, University of Strasbourg, CNRS, INSERM, Strasbourg, 67000, France. · Institute of Image-Guided Surgery, IHU Strasbourg, Strasbourg, 67000, France. · University Digestive Health Care Center – Clarunis, Basel, 4002, Switzerland. · Department of Biomedical Engineering, University of Basel, Allschwil, 4123, Switzerland. · 

Abstract

Purpose: Surgical training benefits from explicit comparison between cases: in patient condition, in technique and in skill proficiency. Surgical vision-language models (VLMs) offer a promising and flexible interface for this purpose. Yet current VLMs typically see one video at a time, and they often fall short when asked to compare videos. Methods: We propose EndoComparer, a VLM for comparative surgical video question answering with two components. (a) A Pseudo-Siamese Visual LoRA (PSVL) gives each video slot its own low-rank adapter over a shared frozen vision encoder, separating the two videos in the visual pathway at the cost of a single encoder pass. (b) A Perceive-then-Compare chain of thought (PtC-CoT) trains the model to first state what each video shows, then derive the answer from these statements. We further curate EndoDiffVQA, a benchmark of nearly 11K multiple-choice questions on video-pair over cholecystectomy and gastric bypass procedures, covering anatomy, tool, action and skill. Results: EndoComparer outperforms strong generalist and surgical VLMs on detecting and specifying difference between videos. Ablations show that two proposed components contribute complimentarily, and the model remains more robust under a video-swap control that exposes confusion between the two videos. Conclusion: Providing a dedicated visual reasoning path through PSVL and PtC-CoT makes cross-case comparison of surgical videos more robust for VLMs. EndoDiffVQA and EndoComparer provide a benchmark and a strong baseline for this task. Project page: https://camma-public.github.io/endocomparer

Figures & tables

Explore similar work

CardsList
  1. SurgCheck: Do Vision-Language Models Really Look at Images in Surgical VQA?

    May 3, 2026Jongmin Shin, Ka Young Kim, Eunki Cho +2VLM EvaluationMedical Visual Question Answering

  2. SUREON: A Benchmark and Vision-Language Model for Surgical Reasoning

    Mar 6, 2026Alejandra Perez, Anita Rau, Busisiwe Mlambo +9Surgical VQASurgical Video Reasoning Benchmarks