Organizations: Center of Digital Dentistry, Peking University School and Hospital of Stomatology. · State Key Laboratory of Radio Frequency Heterogeneous Integration and Guangdong Key Laboratory of Intelligent Information Processing, Shenzhen University. · School of Nursing, Hong Kong Polytechnic University.
Medical image segmentation (MIS) remains challenging due to composite degradations and multi-scale geometric variations, which jointly impair lesion-background separability, structural consistency, and optimization stability. Existing single-stream frameworks entangle heterogeneous cues within a single representation pathway, while hybrid-stream approaches often rely on generic or static fusion, limiting effective coordination across domains and failing to explicitly address optimization instability. To overcome these limitations, we propose a new optimization-aware dual-domain framework for MIS (O2D-MedNet). First, a degradation-aware dualdomain interaction (DDI) module integrates Fourier - and Wavelet-domain features to suppress degradation-sensitive responses while preserving structural and fine-detail information. Second, a cross-backbone contour-guided fusion (CGF) module enables selective interaction between CNN-based local detail modeling and visual state-space-based global structure modeling, improving boundary accuracy and representation consistency. Third, a gradient-context optimization (GCO) strategy stabilizes training by adaptively adjusting learning dynamics based on loss trends and gradient statistics, mitigating instability caused by class imbalance and heterogeneous sample difficulty. Extensive experiments on six benchmarks demonstrate consistent improvements over state-of-the-art MIS methods across multiple imaging modalities. Further analyses confirm enhanced sensitivity, structural consistency, and optimization stability, validating the effectiveness of the proposed O2D-MedNet for robust MIS under heterogeneous conditions.
Figures & tables
Fig. 1: Comparison of representative medical image segmentation (MIS) paradigms. (a) Single-stream frameworks process either original or domain-based inputs through a single pathway, limiting their ability to disentangle heterogeneous cues [ 6 , 7 , 8 ] . (b) Hybrid-stream frameworks introduce multiple backbone branches and fuse their features to exploit complementary representations, but the interaction is typically generic or static [ 9 , 10 ] . (c) In contrast, O2D-MedNet integrates dual-domain refinement, explicit local–global decoupling, contour-guided selective fusion, and optimization-aware learning in a unified framework.
Method
Category
Representation
Local
Global
Domain
Cross-stream
Degradation
Optimization
Detail
Context
Knowledge
Interaction
Modeling
Awareness
Reference Baselines
DeepLabv3+ [ 16 ]
Single
Atrous CNN + ASPP
Explicit
Explicit
No
No
No
No
U 2 -Net [ 17 ]
Single
Nested U-shaped CNN
Explicit
Explicit
No
No
No
No
MedSAM [ 18 ]
Hybrid
ViT + Box Prompt
Implicit
Explicit
No
Explicit
No
No
Single-stream Frameworks
TABLE I: Taxonomy and comparison of representative medical image segmentation (MIS) frameworks. Existing methods are categorized according to their dominant representation and stream architecture, with emphasis on local-global modeling, domain knowledge, cross-stream interaction, degradation modeling, and optimization awareness.
Fig. 2: Overview of the proposed dual-domain cross-backbone interaction framework for MIS ( O2D-MedNet ). A dual-domain refinement (DDI) module integrates global spectral and local multi-resolution cues to suppress degradations and enhance feature separability. Parallel CNN and VSSM branches then capture local details and global structures, respectively. A contour-guided fusion (CGF) module enables selective cross-backbone interaction in skip connections to improve multi-scale structural consistency and reduce redundant propagation. Finally, a gradient-context optimization (GCO) strategy adapts training based on loss evolution and gradient statistics to improve optimization stability and generalization.
Fig. 3: Illustration of the proposed DDI module. Input features are processed in parallel by Fourier and Wavelet branches to capture global structural and multi-resolution detail cues, respectively. Similarity-aware gating adaptively fuses the responses, followed by cross-branch interaction to enhance spatial complementarity.
Fig. 4: Illustration of the CGF module. CNN and VSSM features are transformed into contour-enhanced responses using Gaussian-based high-pass filtering. A contour-guided gating map enables selective cross-backbone fusion, balancing local details and global structures. The fused features are reinjected into both branches and refined by lightweight local attention to enhance multi-scale structural consistency and suppress redundant responses.
Fig. 5: Foreground-ratio distributions across the six datasets. The evident cross-dataset shifts indicate substantial variation in target-scale statistics.
Group
Method
Optical RGB Dataset
Radiological Dataset
Ultrasound Dataset
Oral
Kvasir-SEG
COVID-19
MLUA
CT2US
BUSI
mIoU ↑
Dice ↑
mIoU ↑
Dice ↑
mIoU ↑
Dice ↑
mIoU ↑
Dice ↑
mIoU ↑
Dice ↑
mIoU ↑
Dice ↑
Reference Baselines
U 2 -Net [ 17 ]
82.3 ± 3.1
90.3 ± 1.7
78.5 ± 3.8
88.0 ± 3.2
79.4 ± 3.8
88.5 ± 3.3
59.5 ± 5.8
68.5 ± 5.2
95.3 ± 4.0
97.6 ± 2.7
61.9 ± 4.1
76.4 ± 3.6
DeepLabV3+ [ 16 ]
81.6 ± 2.3
89.8 ± 1.4
50.1 ± 6.7
66.8 ± 6.1
78.3 ± 4.6
87.8 ± 4.3
59.1 ± 4.8
74.3 ± 4.6
95.1 ± 3.9
97.5 ± 1.7
61.1 ± 5.6
75.8 ± 5.6
SFM [ 57 ]
70.0 ± 3.0
82.4 ± 2.4
68.8 ± 5.1
81.5 ± 4.7
75.4 ± 5.3
85.9 ± 3.2
45.6 ± 6.2
62.6 ± 5.6
94.4 ± 2.1
97.1 ± 1.4
58.7 ± 3.9
74.0 ± 3.6
TherNet [ 58 ]
82.5 ± 2.9
90.4 ± 1.9
74.4 ± 3.8
85.3 ± 2.9
78.3 ± 2.9
87.8 ± 2.5
46.9 ± 6.7
63.8 ± 6.7
95.0 ± 4.1
97.4 ± 2.2
50.9 ± 6.8
67.4 ± 6.4
TABLE II: Quantitative comparison in terms of mIoU and Dice on the Oral , Kvasir-SEG , COVID-19 , MLUA , CT2US , and BUSI datasets. Comparison methods are grouped into Reference Baselines , Single-stream Frameworks , and Hybrid-stream Frameworks . The best and second-best results in each column are highlighted in red and blue , respectively.
Fig. 6: Qualitative comparison across different modalities of medical imaging data. For representative coverage, the competitive methods consist of Reference Baselines , Single-stream Frameworks , and Hybrid-stream Frameworks . White indicates correct overlap, red indicates false positives, and green indicates false negatives.
TABLE III: Ablation study on the Oral and COVID-19 datasets. Higher values indicate better performance for mIoU , Dice , and Sensitivity (‘Sens.’), while lower values indicate better performance for Betti Error (BE).
Fig. 7: Qualitative ablation results on representative samples from Oral and COVID-19 datasets. The predictions show progressively improved completeness and structural consistency.
Fig. 8: Effectiveness of DDI. Comparison of local ROIs before and after DDI, along with Sobel gradient distributions and scanline intensity profiles. DDI suppresses spurious high-frequency responses while preserving true boundary structures, thereby improving lesion-background separability.
Fig. 9: Effectiveness of CGF. Comparison with DFM , CRIMs , CRFM , and CGAF on Oral and COVID-19 . CGF achieves the best performance in both overlap accuracy and topological consistency.
Fig. 10: Effectiveness of GCO. Prediction evolution across training epochs on representative samples from Oral and COVID-19 datasets.
Fig. 11: Activation responses of the proposed local–global decoupling and scale-wise interaction. Compared with the CNN and VSSM branches, the fused branch produces more complete and lesion-aligned activations during decoding, indicating effective integration of local detail and global structure.
Method
Params (M) ↓
GFLOPs ↓
Time (msec.) ↓
U 2 -Net
1.131
9.751
17.047
DeepLabV3+
40.347
13.268
7.433
SFM
25.874
7.871
19.055
TherNet
48.072
27.835
24.513
MWCNN
24.929
51.907
4.619
MedSAM
90.689
35.565
18.478
TABLE IV: Computational complexity and inference efficiency under a unified input resolution and hardware setting. Lower values indicate better performance. Best results are highlighted in bold .
Fig. 12: Cross-backbone generalization of GCO on the Oral and COVID-19 datasets.
Medical image segmentation delineates organs, lesions, and other structures in scans to support measurement, diagnosis, treatment planning, and research.
Accurate medical image segmentation is fundamental to precision medicine, yet robust delineation remains challenging under heterogeneous appearances, ambiguous boundaries, and large anatomical variability. Similar intensity and texture patterns between targets and surrounding tissues often lead to blurred activations and unreliable separation. We attribute these failures to representation collapse during encoding and insufficient fine grained multi scale decoding. To address these issues, we propose Med DisSeg, a dispersion driven medical image segmentation framework that jointly improves representation learning and anatomical delineation. Med DisSeg combines a lightweight Dispersive Loss with adaptive attention for fine grained structure segmentation. The Dispersive Loss enlarges inter sample margins by treating in batch hidden representations as negative pairs, producing well dispersed and boundary aware embeddings with negligible overhead. Based on these enhanced representations, the encoder strengthens structure sensitive responses, while the decoder performs adaptive multi scale calibration to preserve complementary local texture and global shape information. Extensive experiments on five datasets spanning three imaging modalities demonstrate consistent state of the art performance. Moreover, Med DisSeg achieves competitive results on multi organ CT segmentation, supporting its robustness and cross task applicability.
Zhiquan Chen, Haitao Wang, Guowei Zou +1
School of Computer Science and Engineering, Sun Yat-sen University, Guangzhou, China · Guangdong Key Laboratory of Big Data Analysis and Processing, Guangzhou, China
Generalized segmentation of medical images prevents performance degradation when different imaging devices and clinical protocols are used across multiple domains. The Whitening Transform-based Probabilistic Shape Regularization Extractor (WT-PSE), published in IEEE Transactions on Medical Imaging in 2024, addresses this challenge by employing feature decorrelation and Wasserstein distance-based knowledge distillation to achieve robust cross-domain segmentation. This study systematically examines improvements to the WT-PSE learning framework. Four limitations in the original implementation are identified: limited training augmentations that fail to simulate real scanner variations, reliance on per-pixel binary cross-entropy loss that is sensitive to edge noise, the absence of a scheduled loss weighting strategy that may destabilize early training, and the lack of ablation switches for controlled scientific comparison. To address these issues, we propose four enhancements: (1) domain-adaptive augmentation including random erasing, gamma correction, and salt-and-pepper noise; (2) a hybrid BCE and Dice loss function for improved edge-aware segmentation under noisy conditions; (3) a curriculum-based Dice weight scheduling strategy; and (4) command-line control flags for systematic ablation studies. Experiments on the fundus optic disc segmentation benchmark demonstrate that the improved pipeline achieves a final epoch optic-disc Dice score of 0.956 and an ASD score of 13.31, outperforming the baseline epoch-5 Dice score of 0.939. These results indicate that training-level improvements can provide consistent performance gains without modifying the underlying WT-PSE architecture.
Aqsa Naseer, Maryam Bibi, Syeda Samiya Urooj +1
School of Electrical Engineering and Computer Science (SEECS), National University of Sciences and Technology (NUST), Islamabad, Pakistan
Multi-modal medical image segmentation leverages complementary diagnostic information, yet fusion can underperform single-modality baselines when spatially aligned inputs differ in quality. Here, "corruption" primarily denotes resolution-induced degradation rather than misalignment or complete modality absence, while synthetic noise is evaluated only as an auxiliary setting. We identify a critical optimization-inference inconsistency: degraded modalities can receive weak training updates yet substantially affect predictions, indicating active interference with fusion. We attribute this failure to resampling-induced feature corruption and optimization bias, where noisy features propagate through skip connections and encourage unreliable modality selection. We therefore propose CoReFuse-Med, a Corruption-aware Rebalanced Fusion framework that suppresses corruption during feature transmission and rebalances modality contributions during high-level fusion. Experiments on EPVS, BraTS, and WMH, including multiple Z-axis slice-retention ratios and an auxiliary noise test, demonstrate improved accuracy and robustness under modality-quality discrepancies. Our code is available at https://github.com/lrever/CoReFuse.
Yuchen Pei, Xiaoyu Hu, Yixiong Zou +5
Central China Normal University Wuhan, China · Huazhong University of Science and Technology Wuhan, China · Guangzhou University of Chinese Medicine Guangzhou, China +2