Surgical Video Understanding

Ask about this topic

Momentum

8 papers in the last four weeks, up 167% on the four weeks before. 0.1% of all new papers.

Jul 13Week of Sep 28
View on map

Latest papers 61

All topics
CardsList

  1. HeiCo-FOCUS: A Clinically Grounded Dataset for Long-Context Video Understanding

    Oct 7, 2026Leon Mayer, Lucas Luttner, Patrick Godau +42Long-Video UnderstandingSurgical Video Understanding

  2. Robust Surgical Robotic Instrument Tracking via Sequential Multi-Cue Fusion and Sim-to-Real Self-Training

    Oct 4, 2026Hanyang Hu, Zekai Liang, Florian Richter +1Self-TrainingSim-to-Real Transfer

    Department of Electrical and Computer Engineering, University of California San Diego, La Jolla, CA 92093 USA.

  3. Semantic RGB--Depth Based Surgical Skill Assessment in Microscopic Stereo Videos

    Oct 1, 2026Jecia Z. Y. Mao, Sue M. Cho, Francis X. Creighton +3Surgical Video Understanding

    Laboratory of Computational Sensing and Robotics, Johns Hopkins University, MD, USA · Department of Otolaryngology–Head and Neck Surgery, Johns Hopkins University School of Medicine, MD, USA

  4. CasCVS-Net: A Staged Multi-Task Cascade for Critical View of Safety Assessment

    Sep 23, 2026Bock-Zien Toh, Yuanchuan Ren, Tay Aw Yu +3Multi-Task LearningSurgical Video Understanding

    Department of Computer Science, University College London, London, UK · UCL Hawkes Institute, University College London, UK

  5. A Hierarchy-Aware Video-Language Model Evaluation and Hyperbolic Baseline for Surgery

    Sep 22, 2026Ana Manzano Rodríguez, Pascal Mettes, Marlies P. Schijven +1Video-Language Model EvaluationHierarchical Representation Learning

    Data Science Center HAVA-Lab, University of Amsterdam · Video & Image Sense Lab, Informatics Institute, University of Amsterdam · Amsterdam UMC Location University of Amsterdam, Surgery +2

  6. Video-based Surgical Skill Assessment Using Dynamics-and-Uncertainty-Aware Tree-based Gaussian Process Classifier

    Sep 21, 2026Arefeh Rezaei, Mohammad Javad Ahmadi, Amir Molaei +1Gaussian ProcessesSurgical Video Understanding

    Applied Robotics and AI Solutions (ARAS), Faculties of Electrical and Computer Engineering, K.N. Toosi University of Technology, Tehran, Iran · Gina Cody School of Engineering and Computer Science, Concordia University, Montreal, Quebec, Canada

  7. RAUL: Reference-Assisted Ureteroscopy Localization for Skill Assessment

    Sep 16, 2026Fangjie Li, Mai Bui, Charan Mohan +43D ReconstructionSurgical Video Understanding

    Department of Biomedical Engineering, Vanderbilt University, Nashville, TN 37240 USA · Department of Computer Science, Vanderbilt University, Nashville, TN 37240 USA · Department of Urology, Vanderbilt University Medical Center, Nashville, TN 37232 USA

  8. OphBiWSSD: Scaling Temporal Action Localization in Ophthalmic Surgeries with Bidirectional Weight-tied State Space Duality

    Sep 14, 2026Yang Liu, Qionghong Ma, Joongwon Chae +10Surgical Video UnderstandingTemporal Action Detection

    Institute of Biopharmaceutics and Health Engineering, Tsinghua Shenzhen International Graduate School, Shenzhen 518055, China · Department of Ophthalmology, The Fifth Affiliated Hospital of Wenzhou Medical University, Wenzhou Medical University, Lishui 323000, China · School of Optometry, The Hong Kong Polytechnic University +4

  9. STSG-VQA: Evidence-Grounded Temporal Question Answering from Surgical Spatio-Temporal Scene Graphs

    Sep 8, 2026Jing Li, Duygu SarikayaMedical VQAQuestion Answering

    School of Computer Science, University of Leeds, UK

  10. Multimodal Shared Latent Representation of Narration, Microscope and iOCT Images for Phase Recognition in Vitreoretinal Surgery

    Aug 31, 2026Onur Izmitlioglu, Shervin Dehghani, Tarek Ghannoum +2Surgical Video UnderstandingMultimodal Contrastive Learning

    Computer Aided Medical Procedures, Technical University of Munich, Germany · SynthesEyes GmbH, Munich, Germany · Department of Ophthalmology, LMU University Hospital, Munich, Germany

  11. SurgSkill-Bench: A Benchmark for Multimodal Surgical Skill Assessment

    Aug 31, 2026Chaohui Dang, Zheheng Jiang, James Glasbey +3Surgical Video UnderstandingMultimodal Model Evaluation

    Department of Electronic, Electrical and Systems Engineering, School of Engineering, University of Birmingham, Birmingham, UK · School of Computing and Mathematical Science, University of Leicester, Leicester, UK · Department of Applied Health Sciences, College of Medicine and Health, University of Birmingham, Birmingham, UK +1

  12. Hallucinations and Constraints : Regulating surgical workflow recognition beyond accuracy

    Aug 10, 2026John S. H. Baxter, Pierre JanninHallucination DetectionProbabilistic Graphical Models

    Université de Rennes, Inserm, Laboratoire Traitement du Signal et de l’Image (LTSI - UMR 1099), F-35000 Rennes, France

  13. SurgLAT: Surgical Latent Attention Tracking for Depth-Aware Robotic Laparoscope Control

    Aug 8, 2026Rulin Zhou, Qiujie Song, Yujie Ma +10Surgical Video UnderstandingVision-Based Robot Control

    Department of Electronic Engineering, The Chinese University of Hong Kong, Hong Kong SAR 999077, China · Shenzhen Loop Area Institute, Shen Zhen 518055, China · College of Mechatronics and Engineering, Shenzhen University, Shenzhen 518060, China +2

  14. SurgNarrator: A Generative Retrieval Framework for Surgical Video Understanding

    Aug 5, 2026Yuqing Feng, Jiawei Ma, Kevin Qinghong Lin +6Surgical Video UnderstandingGenerative Retrieval

    Department of Computer Science, University of Liverpool, Liverpool L69 3BX, U.K. · Department of Computer Science, City University of Hong Kong, Hong Kong SAR, China · Department of Engineering, University of Oxford, Oxford OX1 3PJ, U.K. +2

  15. TRCoRSurg: Temporal-Relational Co-Reasoning for Surgical Video Triplet Recognition

    Aug 5, 2026Fang Li, Shihao Zou, Weixin Si +3Surgical Video UnderstandingRelational Deep Learning

    State Key Laboratory of Virtual Reality Technology and Systems, Beihang University · Shenzhen Institutes of Advanced Technology, Chinese Academy of Sciences · Faculty of Computer Science and Control Engineering, Shenzhen University of Advanced Technology

  16. Action-grounded tissue affordance enables anticipatory auto-framing that lowers surgeon cognitive workload during laparoscopic surgery

    Aug 3, 2026Jiayu Gu, Yiwei Wang, Jie Zhang +14Medical Image AnalysisSurgical Video Understanding

    Department of Hepatobiliary Surgery, Union Hospital, Tongji Medical College, Huazhong University of Science and Technology, Wuhan, China · School of Mechanical Science and Engineering, Huazhong University of Science and Technology, Wuhan, China · Institute of Medical Equipment Science and Engineering, Huazhong University of Science and Technology, Wuhan, China +3

  17. SPIRIT: Spatio-temporal Pairwise Relational Modeling of Instrument-Tissue Interactions for Surgical Action Triplet Recognition

    Aug 3, 2026Saurav Sharma, Lorenzo Arboit, Nabani Banik +11Domain GeneralizationRelational Reasoning

    University of Strasbourg, CNRS, INSERM, ICube, UMR7357, France · IHU Strasbourg, France · University of Pavia, Italy +6

  18. Extended KAFR: A kinematic-adaptive paradigm for the efficient analysis of surgical video

    Aug 2, 2026Huu Phong Nguyen, Shekhar Madhav Khairnar, Ganesh SankaranarayananSurgical Video UnderstandingAdaptive Sampling

    Department of Surgery, University of Texas Southwestern Medical Center, 5323 Harry Hines Blvd, Dallas, 75390, Texas, USA.

  19. Surgical Re-enactment for Operating Room Workflow Datasets

    Jul 27, 2026Jana Nina Friedrich, Andrea Karin Maria Ross, Angelo Henriques +3Synthetic Data GenerationSurgical Video Understanding

    Medical Autonomy and Precision Surgery Lab, TUM University Hospital, Munich, Germany · TUM School of Medicine and Health, Department of Ophthalmology, TUM University Hospital, Munich, Germany · TUM School of Computation, Information, and Technology, TUM, Munich, Germany +1

  20. Latent-Action-Guided Video-Language Feature Learning for Surgical Instrument-Tissue Interaction Recognition

    Jul 22, 2026Jiajun Cheng, Sainan Liu, Subarna Tripathi +2Latent Action LearningSurgical Video Understanding

    Arizona State University, Tempe, AZ, USA · Intel Corporation, USA · University of California, Merced, CA, USA

  21. HTT-Net: Hierarchical Text-guided Transition Modeling for Surgical Video Phase Recognition

    Jul 18, 2026Kunjie Deng, Jinghui Zhang, Weidong Chen +4Surgical Video UnderstandingTemporal Video Understanding

  22. Active Learning for Efficient Annotation of Surgical Videos with Weak Supervision

    Jul 14, 2026Manasa Dendukuri, Matjaz Jogan, Daniel A. Hashimoto +1Video Object SegmentationHuman-in-the-Loop Annotation

    1*GRASP Laboratory, University of Pennsylvania, 3330 Walnut Street, Philadelphia, PA, 19104, USA. · 2PCASO Laboratory, Dept. of Surgery, University of Pennsylvania, 3400 Spruce Street, Philadelphia, PA, 19104, USA. · 3Dept. of Computer and Information Science, University of Pennsylvania, 3330 Walnut Street, Philadelphia, PA, 19104, USA.

  23. Point Tracking in Surgery--The 2025 Surgical Tattoos in Infrared Challenge (STIRC2025)

    Jul 14, 2026Adam Schmidt, Mert Asim Karaoglu, Zijian Wu +32Point TrackingSurgical Video Understanding

    Intuitive Surgical Inc., Sunnyvale, USA · ImFusion GmbH, Munich, Germany · Technical University of Munich, Munich, Germany +14

  24. DeGenseGS: Geometrically and Semantically Decoupled Surgical Scene Understanding in 4D Gaussian Splatting

    Jul 6, 2026Yimo Wang, Bin Kang, Shuojue Yang +13D Gaussian SplattingDynamic Scene Reconstruction

    School of Automation, Southeast University, Nanjing 210096, China · Department of Biomedical Engineering, National University of Singapore, Singapore · School of Internet of Things, Nanjing University of Posts and Telecommunications, Nanjing, China

  25. HyperVLP: Enhancing Hierarchical Surgical Video-Language Pre-training in Hyperbolic Space

    Jun 30, 2026Yaojun Hu, Kun Yuan, Nassir Navab +3Hierarchical Representation LearningSurgical Video Understanding

    Zhejiang University, Hangzhou, China · University of Strasbourg, CNRS, INSERM, ICube, UMR7357, Strasbourg, France · IHU Strasbourg, Strasbourg, France +1

  26. Dense Structural Priors for Sparse Functional Landmark Localization in Surgical Videos

    Jun 30, 2026Chenyan Jing, Hao Ding, Lalithkumar Seenivasan +2Surgical Video UnderstandingMedical Image Localization

    Johns Hopkins University, Baltimore, MD, USA

  27. Temporally Consistent Label Interpolation for Robust Surgical Multi-Task Learning under Challenging Conditions

    Jun 25, 2026Garam Kim, Juyoun ParkMulti-Task LearningSurgical Video Understanding

    Center for Humanoid Research, Korea Institute of Science and Technology, Seoul, Republic of Korea · School of Electrical and Electronic Engineering, Yonsei University, Seoul, Republic of Korea

  28. SurgAtlas: A Large-Scale Surgical Video-Language Dataset with 2,391 Hours of Open and Minimally Invasive Surgery

    Jun 24, 2026Filippos Bellos, Andre S. Gala-Garza, Miaowei Wang +8Medical VQASurgical Video Understanding

    University of Michigan Ann Arbor, Michigan, USA · University of Edinburgh Edinburgh, United Kingdom · Vanderbilt University Medical Center Nashville, Tennessee, USA +3

  29. Expert Consensus on Criteria for the Automated Assessment of Laparoscopic Camera Navigation

    Jun 22, 2026Amir Ebrahimzadeh, Nazila Esmaeili, Michael Ghadimi +1Surgical Video UnderstandingAutomated Evaluation

    Center for Digital Surgery, Department of General, Visceral and Pediatric Surgery, University Medical Center Göttingen, Robert-Koch-Straße 40, Göttingen, 37075, Germany · Fraunhofer Research Institution for Individualized and Cell-based Medical Engineering (IMTE), Mönkhofer Weg 239a, Lübeck, 23562, Germany

  30. DBT-Bleed: Dual-Branch Temporal Modeling with Key-Frame Selection for Surgical Bleeding Detection

    Jun 22, 2026Sudhanshu Mishra, Jialang Xu, Jensen Ang +3Surgical Video UnderstandingVideo Frame Selection

    Department of Electrical and Computer Engineering, National University of Singapore, Singapore · UCL Hawkes Institute, Department of Medical Physics and Biomedical Engineering, University College London, London, United Kingdom · Department of Neurosurgery, National Neuroscience Institute, Singapore +1