Surgical Instrument Segmentation
Surgical instrument segmentation aims to automatically identify and delineate surgical tools within endoscopic or laparoscopic video footage, crucial for improving minimally invasive surgery. Current research emphasizes improving segmentation accuracy and robustness using various deep learning architectures, including transformers, encoder-decoder networks, and those incorporating temporal and stereo information from video sequences, often leveraging techniques like optical flow analysis and multi-modal fusion (e.g., audio cues). These advancements are driven by the need for more reliable computer-assisted interventions, enabling improved surgical precision, automation, and training. Ultimately, accurate and efficient surgical instrument segmentation promises to enhance surgical safety and outcomes.
Papers
Exploring Optical Flow Inclusion into nnU-Net Framework for Surgical Instrument Segmentation
Marcos Fernández-Rodríguez, Bruno Silva, Sandro Queirós, Helena R. Torres, Bruno Oliveira, Pedro Morais, Lukas R. Buschle, Jorge Correia-Pinto, Estevão Lima, João L. Vilaça
Rethinking Low-quality Optical Flow in Unsupervised Surgical Instrument Segmentation
Peiran Wu, Yang Liu, Jiayu Huo, Gongyu Zhang, Christos Bergeles, Rachel Sparks, Prokar Dasgupta, Alejandro Granados, Sebastien Ourselin