Polyp-VSSD: A Pre-trained Transformer with Local-Global Joint VSSD Decoding for Polyp Segmentation
Organizations: CAS Key Laboratory of Molecular Imaging and Beijing Key Laboratory of Molecular Imaging, Institute of Automation, Chinese Academy of Sciences, Beijing 100190, China · School of Artificial Intelligence, University of Chinese Academy of Sciences, Beijing 100049, China · School of Computer Science and Engineering, Nanjing University of Science and Technology, Nanjing, Jiangsu 210094, China · School of Engineering Medicine, Beihang University, Beijing 100191, China ·
Abstract
Early detection of colorectal polyps is essential for preventing colorectal cancer, making accurate polyp segmentation a key component in computer-aided diagnosis systems. However, existing endoscopic segmentation methods often exhibit limited representational capacity and insufficient integration of global and local contextual information. To address these limitations, we propose Polyp-VSSD, a novel local-global joint decoding framework built upon a pre-trained Transformer backbone for high-precision polyp segmentation. Polyp-VSSD leverages the strong feature expressiveness of large-scale visual pre-training and unifies global semantic modeling with local fine-grained reconstruction to enhance segmentation fidelity. Extensive experiments on multiple public endoscopic datasets demonstrate that our approach significantly outperforms state-of-the-art methods in both Dice and IoU. On the EndoScene dataset, Polyp-VSSD achieves mIoU and mDice scores of 0.903 and 0.946, respectively, highlighting its robustness and strong generalization capability. This work presents an effective and scalable solution for intelligent endoscopic image analysis.
Figures & tables
| Methods | Venue | CVC-ClinicDB | Kvasir-Seg | CVC-ColonDB | ETIS | EndoScene | |||||
|---|---|---|---|---|---|---|---|---|---|---|---|
| mIoU | mDice | mIoU | mDice | mIoU | mDice | mIoU | mDice | mIoU | mDice | ||
| PraNet | MICCAI’20 | ||||||||||
| SSFormer | MICCAI’22 | ||||||||||
| CFA-Net | PR’23 | ||||||||||
| CoInNet | TMI’23 | ||||||||||
| ASPS | MICCAI’24 | ||||||||||
| Modules | CVC-ClinicDB | Kvasir-Seg | CVC-ColonDB | ETIS | EndoScene | ||||||
|---|---|---|---|---|---|---|---|---|---|---|---|
| VSSD | LPB | mIoU | mDice | mIoU | mDice | mIoU | mDice | mIoU | mDice | mIoU | mDice |
| – | – | ||||||||||
| – | |||||||||||
| – | |||||||||||
| 0.923 | 0.959 | 0.881 | 0.935 | 0.764 | 0.852 | 0.830 | 0.899 | 0.903 | 0.946 | ||
Polyp Segmentation
Polyp segmentation uses computer vision to delineate colorectal polyps in colonoscopy images and video for detection and clinical assessment.
See all 23 papers