TopoVST: Toward Topology-fidelitous Vessel Skeleton Tracking

Yaoyu Liu; Minghui Zhang; Junjun He; Yun Gu

cs.CVMar 16, 2026

TopoVST: Toward Topology-fidelitous Vessel Skeleton Tracking

Authors: Yaoyu Liu, Minghui Zhang, Junjun He, Yun Gu

Organizations: Institute of Medical Robotics, Shanghai Jiao Tong University, Shanghai, China. · School of Automation and Intelligent Sensing, Shanghai Jiao Tong University, Shanghai, China. · Shanghai AI Lab, Shanghai, China.

Abstract

Automatic extraction of vessel skeletons is crucial for many clinical applications. However, achieving topologically faithful delineation of thin vessel skeletons remains highly challenging, primarily due to frequent discontinuities and the presence of spurious skeleton segments. To address these difficulties, we propose TopoVST, a topology-fidelitious vessel skeleton tracker. TopoVST constructs multi-scale sphere graphs to sample the input image and employs graph neural networks to jointly estimate tracking directions and vessel radii. The utilization of multi-scale representations is enhanced through a gating-based feature fusion mechanism, while the issue of class imbalance during training is mitigated by embedding a geometry-aware weighting scheme into the directional loss. In addition, we design a wave-propagation-based skeleton tracking algorithm that explicitly mitigates the generation of spurious skeletons through space-occupancy filtering. We evaluate TopoVST on two vessel datasets with different geometries. Extensive comparisons with state-of-the-art baselines demonstrate that TopoVST achieves competitive performance in both overlapping and topological metrics. Our source code is available at: https://github.com/EndoluminalSurgicalVision-IMR/TopoVST.

Figures & tables

Fig. 1: On the left, we provide a visual description and results of two vessel skeleton extraction pipelines, highlighting breakage and redundancy in colored boxes. On the right, we provide the results of TopoVST. (a) Segmentation-based skeleton extraction . The CT image is first segmented and then thinned. This method may cause $\beta_{0}$ -errors due to false-negative breakage during segmentation. (b) Tracking-based skeleton extraction . A number of seed points are first acquired from the CT image. Then a tracker starts from these seed points and extracts the skeleton. This method is $\beta_{1}$ -error-prone due to the aggregation of redundant skeleton branches during tracking.

Fig. 2: Our Framework . (a) Offline Training . At a given position in the image, multi-scale sampling is performed to obtain graphs at different scales. These graphs are processed by a GNN encoder in parallel to extract node representations at different scales, which are passed through a gating module and summed to obtain aggregated node features. The aggregated node features are then used to decode node-level direction prediction $G_{pred}$ and graph-level radius prediction $R_{pred}$ . (b) Online Tracking . We apply local maximum operation on the predicted graph to obtain candidate directions. The estimated radius provides both the tracking step size and radial-ball occupation in 3D space. Using the candidate directions and tracking step size, we determine the next-step positions in the vessel. These positions are subsequently filtered by the radial-ball occupations. We adopted a wave-propagation skeleton tree expansion algorithm to extract the final skeleton.

Fig. 3: Correspondence between unit directions and graph nodes in two similar sphere graphs at different scales, $S_{1}$ and $S_{2}$ . Four unit directions, $\mathbf{d_{1}},\mathbf{d_{2}},\mathbf{d_{3}},\mathbf{d_{4}}$ are plotted with orange arrows. Four nodes, $V_{1},V_{2},V_{3},V_{4}$ represent four points on the sphere mesh. Correspondence between each unit direction $\mathbf{d_{i}}$ and node $V_{i}$ can be found consistently in both scales, as denoted by orange dotted lines. Thus, direction modeling by the sphere graph is scale-invariant .

Fig. 4: Illustration of multi-scale sampling, direction target formulation and loss weighting . (a) Multi-scale sampling . Given a sampling position inside the vessel, $n$ sphere mesh graphs $G_{1},G_{2},\dots,G_{n}$ at scales $S_{1},S_{2},\dots,S_{n}$ are constructed. Each graph covers a different spherical region around the sampling point. For a node $V_{i}$ on graph $G_{m}$ , we draw a line from the sampling position to $V_{i}$ and sample image intensities at $C=64$ points along the line. These intensities are concatenated into a feature vector in $\mathbb{R}^{C}$ , denoted by $f_{m}^{0}(V_{i})$ . (b) Direction target formulation and loss weighting . For a given sampling position, we locate the intersections between its radial ball and the reference skeleton. Target directions can be calculated from these intersections and projected onto the predefined spherical graph. Nodes corresponding to the target directions are labeled as positive, and the remaining are labeled as negative. After projection, the target binary graph $G_{target}$ is acquired and can be used to compute the direction loss. Based on $G_{target}$ , geometry-aware loss weights $w_{geo}$ can be computed from haversine distance. The loss weight $w$ can be obtained by combining $w_{geo}$ and the minority class weight $w_{p}$ .

Fig. 5: Illustration of Wave-propagation Skeleton Tracking Algorithm . For simplicity, downward tracking is not demonstrated. From left to right, we show the wave-propagation tracking procedure in each iteration. Wave fronts are enclosed in black dotted lines. Radial-ball occupancy is used to remove invalid tracking directions (red dotted arrows) that lead the tracker back to explored regions. The tracked skeleton tree is updated in every iteration.

Fig. 6: Qualitative Evaluation on ASOCA Dataset . The first case demonstrates a thin vessel segment in the coronary arteries. The second case demonstrates a tortuous vessel segment in the coronary arteries. TopoVST successfully extracts skeletons in these vessel segments. ov: Overlap.

Fig. 7: Recall of the Reference Skeleton . Here, we provide the recall of the reference skeleton. For effective comparison, we split the reference skeleton into five groups based on radius distributions and derive the statistics. (a) show the recall on ASOCA, and (b) shows the recall on AortaSeg24. It can be observed that TopoVST achieves the highest recall in most of the groups.

Fig. 8: Qualitative Evaluation on AortaSeg24 Dataset . The first case demonstrates spatially adjacent vessel segments in the aorta. The second case demonstrates calcified vessel segments in the aorta. TopoVST extracts accurate skeletons in these vessel segments without redundancy. ov: Overlap.

Fig. 9: Elongation of Tracked Vessel Skeleton . Here we provide the Curved Planar Reformat(CPR) plot on two different datasets. Vessel regions labeled in GT and extracted by TopoVST are highlighted with red and blue rectangular boxes, respectively. (a) provides a view on ASOCA dataset and (b) provides a view on AortaSeg24 dataset. On these two plots it can be observed that skeleton extracted by our method extends beyond the coverage of GT mask, but still remains within the same part of vessels.

Medical Image Analysis

Medical image analysis uses computational methods to interpret clinical images, measure anatomy and disease, and support diagnosis and treatment.

See all 292 papers

May 1, 2026

Vesselpose: Vessel Graph Reconstruction from Learned Voxel-wise Direction Vectors in 3D Vascular Images

Blood vessel segmentation and -tracing are essential tasks in many medical imaging applications. Although numerous methods exist, the prevailing segment-then-fix paradigm is fundamentally limited regarding its suitability for modeling the task of complete and topologically accurate vascular network reconstruction. Here, we propose an approach to extract topologically more accurate vascular graphs from 3D image data, building upon highly successful ideas from the related biomedical tasks of cell segmentation and -tracking. Our approach first predicts voxel-wise vessel direction vectors joint with standard vessel segmentation masks. Second, to extract the vascular graph from these predictions, we introduce a direction-vector-guided extension of the TEASAR algorithm. Our approach achieves state-of-the-art performance on three benchmark datasets, spanning both synthetic and real imagery. We further demonstrate the applicability of our approach to challenging 3D micro-CT scans of rat heart vasculature. Finally, we propose meaningful and interpretable measures of topological error, namely false splits and false merges for graphs. Overall, our approach substantially improves the topological accuracy of reconstructed vascular graphs, being able to separate closely apposed vessel segments and handle multiple vascular trees within a single volume.

Rajalakshmi Palaniappan, Christoph Karg, Nemesio Navarro-Arambula +4

Max-Delbrueck-Center for Molecular Medicine in the Helmholtz Association (MDC) · Humboldt University of Berlin · University of Potsdam +4

Image Segmentation Medical Image Analysis 3D Medical Imaging Medical Image Segmentation 3D Medical Image Segmentation

Ask PDF

Mar 19, 2026

VesselTok: Tokenizing Vessel-like 3D Biomedical Graph Representations for Reconstruction and Generation

Spatial graphs provide a lightweight and elegant representation of curvilinear anatomical structures such as blood vessels, lung airways, and neuronal networks. Accurately modeling these graphs is crucial in clinical and (bio-)medical research. However, the high spatial resolution of large networks drastically increases their complexity, resulting in significant computational challenges. In this work, we aim to tackle these challenges by proposing VesselTok, a framework that approaches spatially dense graphs from a parametric shape perspective to learn latent representations (tokens). VesselTok leverages centerline points with a pseudo radius to effectively encode tubular geometry. Specifically, we learn a novel latent representation conditioned on centerline points to encode neural implicit representations of vessel-like, tubular structures. We demonstrate VesselTok's performance across diverse anatomies, including lung airways, lung vessels, and brain vessels, highlighting its ability to robustly encode complex topologies. To prove the effectiveness of VesselTok's learnt latent representations, we show that they (i) generalize to unseen anatomies, (ii) support generative modeling of plausible anatomical graphs, and (iii) transfer effectively to downstream inverse problems, such as link prediction.

Chinmay Prabhakar, Bastian Wittmann, Tamaz Amiranashvili +6

University of Zurich, Switzerland · ETH AI Center, Zurich, Switzerland · Technical University of Munich, Germany +1

Graph Generation Graph Representation Learning 3D Representation Learning

Ask PDF

Jun 23, 2026

MorVess: Morphology-Aware Pulmonary Vessel Segmentation Network

Accurate pulmonary vessel segmentation remains challenging due to the sparse, tortuous, and multi-scale nature of vascular structures, where small branches are easily lost and topology integrity is difficult to preserve under voxel-wise supervision. Existing deep segmentation models primarily optimize binary masks, lacking explicit geometric constraints, thus struggling to recover continuous tubular morphology and fine vascular connectivity. In this study, we introduce MorVess, a morphology-aware segmentation framework that integrates differentiable geometric priors with large-scale foundation model adaptation to achieve fine-grained vascular parsing. MorVess jointly predicts vessel masks, distance maps, and thickness maps, providing explicit supervision for vascular boundaries, centerline consistency, and smooth diameter transitions. A lightweight 2.5D adapter bridges 3D spatial context and 2D SAM representations, while a global-local fusion block aggregates multi-level semantics and geometric cues for high-fidelity topology reconstruction. Across two challenging pulmonary CT benchmarks, MorVess delivers superior Dice, clDice, and HD95 scores, substantially improving small-vessel recovery and global connectivity. These results demonstrate that embedding geometric intelligence into pretrained vision models offers a principled and scalable pathway toward precise vessel analysis and clinically reliable structural quantification. Our source code is available at https://github.com/MaoFuyou/MorVess.

Fuyou Mao, Yifei Chen, Beining Wu +9

Central South University, 410083 Changsha, China · Tsinghua University, 100084 Beijing, China · Hangzhou Dianzi University, 310018 Hangzhou, China +1

Vision Foundation Model Adaptation Topology-Preserving Image Segmentation Medical Image Segmentation 3D Medical Image Segmentation

Ask PDF

Abstract

Medical Image Analysis

Explore similar work

Vesselpose: Vessel Graph Reconstruction from Learned Voxel-wise Direction Vectors in 3D Vascular Images

VesselTok: Tokenizing Vessel-like 3D Biomedical Graph Representations for Reconstruction and Generation

MorVess: Morphology-Aware Pulmonary Vessel Segmentation Network