cs.CVNov 6, 2026

ATLAS: A Multi-Procedure Benchmark and Context-Aware Model for Surgical Anatomy Segmentation

Authors: Ronald L. P. D. de Jong, Tim J. M. Jaspers, Raf A. H. Vervoort, Aron F. H. A. Bakker, Anna L. Dijk, Yiping Li, Jip L. Tolenaar, Jelle P. Ruurda, 

Organizations: Department of Biomedical Engineering, Eindhoven University of Technology, Groene Loper 3, 5612 AE Eindhoven, The Netherlands · Department of Electrical Engineering, Eindhoven University of Technology, Groene Loper 3, 5612 AE Eindhoven, The Netherlands · Department of Oncological Urology, University Medical Center Utrecht, Heidelberglaan 100, 3584 CX Utrecht, The Netherlands · Department of Urology, Catharina Hospital, Michelangelolaan 2, 5623 EJ Eindhoven, The Netherlands · 

Abstract

Recognizing anatomical structures during minimally invasive surgery (MIS) could support intraoperative navigation and improve patient safety, but progress is limited by small, single-procedure datasets and by segmentation methods developed for natural scenes. This work addresses both limitations through a new dataset and model. First, we introduce ATLAS-120k, a clip-level semantic segmentation dataset of 121,018 annotated frames from 100 surgical videos, covering 14 laparoscopic and robot-assisted procedures and 41 classes. Annotations were created with a pipeline that combines manual labeling, tracker-based propagation, and review by surgeons. Second, we propose ATLAS (Anatomy Recognition with Context Learning using Foundation Representations), a video semantic segmentation model for surgical anatomy recognition. ATLAS builds on in-domain foundation-model embeddings and adds context queries for the procedure and surgical phase, together with query propagation between frames for short-term memory. ATLAS outperforms state-of-the-art natural-image and in-domain foundation models in both segmentation accuracy and temporal consistency, achieving a Dice score of 0.70 with ViT-L while running in real time at 76.2 FPS. Ablations show that the context queries improve accuracy and that query propagation improves temporal consistency. ATLAS also generalizes well, matching a dedicated model zero-shot on CholecSeg8k and improving phase recognition on AutoLaparo over SurgeNet initialization. The model weights, dataset annotations, and annotation tool are publicly available at https://github.com/TimJaspers0801/ATLAS.

Figures & tables

Appendix figures & tables1 asset

Supplementary material from the paper’s appendix.

Appendix

Explore similar work

CardsList
  1. Surgical Anatomy Recognition with Context Learning using Foundation Representations

    Jun 20, 2026Ronald L. P. D. de Jong, Tim J. M. Jaspers, Raf A. H. Vervoort +9Medical Image AnalysisSurgical Video Understanding

  2. SurgAtlas: A Large-Scale Surgical Video-Language Dataset with 2,391 Hours of Open and Minimally Invasive Surgery

    Jun 24, 2026Filippos Bellos, Andre S. Gala-Garza, Miaowei Wang +8Medical Visual Question AnsweringSurgical Video Understanding

  3. Atlas is Your Perfect Context: One-Shot Customization for Generalizable Foundational Medical Image Segmentation

    Dec 20, 2025Ziyu Zhang, Yi Yu, Simeng Zhu +4Image SegmentationMedical Imaging Foundation Models