Subcortical Masks Generation in CT Images via Ensemble-Based Cross-Domain Label Transfer

Accurate segmentation of subcortical regions is critical for neurosurgical planning and functional research. Most automated methods rely on template space coregistration, which may compromise patient-specific accuracy, particularly in small structures. We identify a need to evaluate whether native space approaches offer a measurable advantage, which we evaluate in the context of movement disorders. We developed two UNet-based segmentation pipelines of the Subthalamic Nucleus (STN) - a common surgical target in Parkinson's Disease - and the neighbouring Red Nucleus (RN) and Substantia Nigra (SN). We collected 7T and 3T MRI data from five public datasets. The pipelines were evaluated in the native-space against manual labels. We further investigated the effect of the template resolution. Motivated by the hypothesis that models may better learn target boundaries in higher field, we tested the transferability of 7T-trained models to 3T clinical images, and whether synthetic 3T training data - generated via a disentangled representation learning method - could help bridging this domain gap. On held-out 7T data, the native pipeline consistently outperformed the template one. For the STN, native-space Dice reached 0.775 +- 0.055 versus 0.713 +- 0.051 (1 mm template), with HD95 of 0.79 +- 0.24 mm versus 1.17 +- 1.10 mm, respectively. Similar advantages were observed for the RN and SN. Increasing template resolution did not improve accuracy. When applied to 3T images, all models showed a considerable performance drop. Adding synthetic 3T data yielded only modest improvements, though without degrading 7T performance. Native-space segmentation is preferable for applications requiring patient specific anatomical fidelity, such as the surgical planning in PD. Bridging the 7T-to-3T domain gap remains an open challenge, motivating future work on domain adaptation tailored to subcortical structures.

Precise segmentation of brain structures in magnetic resonance imaging (MRI) is essential for reliable neuroimaging analysis, yet voxel-wise deep models often yield anatomically inconsistent results that diverge from expert-defined boundaries. In this research, we propose a landmark-guided 3D brain segmentation approach that explicitly mimics the manual segmentation protocol of the Harvard--Oxford Atlas. A Global-to-Local network automatically detects 16 landmarks representing key subcortical reference points. Then, a semantic segmentation model produces a coarse segmentation of 12 anatomical labels, each grouping multiple subcortical regions. Finally, a landmark-driven post-processing step separates these 12 labels into 26 distinct structures by enforcing local anatomical constraints. Experimental results demonstrate consistent improvements in boundary accuracy. Overall, integrating learned landmarks aligns segmentations more closely with manual protocols.

Deep learning-based medical image segmentation is increasingly used to support clinical diagnosis and develop new treatment strategies. However, model performance remains limited by the scarcity of high-quality annotated data and insufficient generalization across imaging protocols. This limitation is particularly evident in MRI and CT, where models are typically trained on a single acquisition sequence and exhibit reduced robustness when applied to unseen sequences or contrasts. Although data augmentation is widely used to improve general robustness on medical images, its impact on cross-modality generalization has not been quantitatively explored. In this work, we study a targeted set of data augmentation techniques designed to improve cross-modality transfer. We train three spine segmentation models, each on a single-modality/sequence dataset, and evaluate them across seven out-of-distribution datasets (spanning CT and MRI), reflecting a realistic single-sequence training and multi-sequence/contrast/modality deployment scenario. Our results demonstrate substantial performance gains on unseen domains (average Dice gain of 155 %) while preserving in-domain accuracy (average Dice decrease of 0.008 %), including effective transfer between CT and MRI. To mitigate the computational cost typically associated with strong data augmentation, we implement GPU-optimized augmentations that maintain, and even improve, training efficiency by approximately 10 %. We release our approach as an open-source toolbox, enabling seamless integration into commonly used frameworks such as nnUNet and MONAI. These augmentations significantly enhance robustness to heterogeneous clinical imaging scenarios without compromising training speed.