Organizations: LaTIM UMR 1101, Inserm, Brest, France · University of Western Brittany, Brest, France · University Hospital of Brest, Brest, France · University Hospital of Poitiers, Poitiers, France · ICube UMR 7357, CNRS, Strasbourg, France · IMT Atlantique, Brest, France
Extracting hepatic vessels from abdominal images is of high interest for clinicians since it allows to divide the liver into functionally-independent Couinaud segments. In this respect, an automated liver blood vessel extraction is widely summoned. Despite the significant growth in performance of semantic segmentation methodologies, preserving the complex multi-scale geometry of main vessels and ramifications remains a major challenge. This paper provides a new deep supervised approach for vessel segmentation, with a strong focus on representations arising from the different scales inherent to the vascular tree geometry. In particular, we propose a new clustering technique to decompose the tree into various scale levels, from tiny to large vessels. Then, we extend standard 3D UNet to multi-task learning by incorporating scale-specific auxiliary tasks and contrastive learning to encourage the discrimination between scales in the shared representation. Promising results, depicted in several evaluation metrics, are revealed on the public 3D-IRCADb dataset.
Figures & tables
Figure 1: Proposed pipeline for deep liver vessel segmentation using scale-specific auxiliary multi-task contrastive learning.
Figure 2: ( a ) Visual aid to interpret notations related to multi-scale vessel clustering (Sect. 2.1 ). ( b ) Example of 3-scale vasculature clustering applied on a synthetic vasculature [ 8 ] .
Figure 3: Encoder-decoder architecture involved in our multi-task contrastive pipeline. PReLu stands for Parametric ReLU.
Models
DSC ↑ score ( % )
Jacc ↑ score ( % )
clDSC ↑ score ( % )
HD ↓ dist. ( mm )
3D ResUNet
binary
54.25±3.65
37.65±3.46
46.84±3.63
80.09±4.83
multi-class
50.31±4.43
34.13±3.98
44.34±2.89
114.3±10.9
Ours
λc=0
54.27±4.16
37.73±3.87
46.90±2.44
86.07±8.07
λc=0
55.04±2.79
38.50±2.71
48.13±3.52
82.36±12.3
Table 1: Liver vessel segmentation on CT scans from the 3D-IRCADb [ 16 ] dataset using 3D ResUNet in binary and multi-class settings as well as the proposed approach without and with contrastive learning. Best results are displayed in bold.
Figure 4: Letter-value plot of branch radii r^j(mm) per ground truth volume yi from the 3D-IRCADb [ 16 ] dataset.
Figure 5: Qualitative liver vessel segmentation results on CT scans from the 3D-IRCADb [ 16 ] dataset.
Pujian Medical Technology Co., Ltd., Hangzhou, China · Keyi College of Zhejiang Sci-tech University, ShaoXing, China · College of Computer Science and Technology, Zhejiang University, Hangzhou, China
Huawei Türkiye R&D Center, Istanbul, 34768, Türkiye · Department of Radiology, Dokuz Eylul University, Izmir, 35100, Türkiye · Department of Computer Engineering, Istanbul Technical University, Istanbul, 34469, Türkiye +8
College of Computer Science and Artificial Intelligence, Southwest Minzu University, Chengdu 610225, China · Institute of Artificial Intelligence and Robotics, Xi’an Jiaotong University, Xi’an 710049, China · College of Mechanical and Electrical Engineering, Northeast Forestry University, Harbin 150040, China +4