cs.CVNov 3, 2026

Polyp Matching Using Deep Learning

Authors: Kristian Dalsbø Hindberg, Puneet Sharma, Benedicte Schelde-Olesen, Ulrik Deding, Jakob Frederik Frøkjær Justsen, Jan-Matthias Braun, Esmaeil S. Nadimi

Organizations: Department of Physics and Technology, Machine Learning Group, UiT – The Arctic University of Norway, Tromsø, Norway · Department of Automation and Process Engineering, Machine Learning Group, UiT – The Arctic University of Norway, Tromsø, Norway · Department of Surgery, Odense University Hospital, Odense, Denmark · Department of Clinical Research, University of Southern Denmark, Odense, Denmark · 

Abstract

A key challenge in colon capsule endoscopy (CCE) analysis is accurately identifying whether multiple images depict the same polyp, which is critical to avoid over-counting and unnecessary clinical interventions. Additionally, this prevents prolonged follow-up colonoscopies where endoscopists search for duplicate polyps without precise localization. This study presents a novel contrastive learning-based approach to polyp matching using a Siamese neural network architecture. The model was trained on a dataset from the Danish CareForColon2015 trial. The dataset comprises 5,103 image pairs of confirmed same polyp and 5,103 pairs of different polyps, annotated by experienced clinicians. The proposed model employs ResNet variants (ResNet18, ResNet34, ResNet50), DenseNet121 and EfficientNet B0/B3 as backbones and utilizes contrastive learning with cosine vector distance metric for classification. Experimental results demonstrate high classification accuracies of up to 92% and AUC values close to 0.98. These results suggest that automated polyp matching has the potential to reduce polyp over-counting, improve patient risk stratification, and reduce unnecessary follow-up colonoscopies.

Figures & tables

Appendix figures & tables11 assets

Supplementary material from the paper’s appendix.

Appendix

Explore similar work

CardsList
  1. PolypVision: A Three-Stage Hierarchical Deep Learning Framework for Classification and Segmentation of Colorectal Polyps

    Aug 11, 2026Hamidreza Bolhasani, Hamidreza Rastad, Amir Mohammad Akbari +4Medical Image ClassificationPolyp Segmentation

  2. BGD-SF PolySegNet: boundary-guided dynamic selective fusion network for robust polyp segmentation in colonoscopy images

    Nov 2, 2026Nishi Kanta Paul, Shamia Maherin, Morsheda Akter +2Polyp SegmentationMedical Image Segmentation

  3. DepthPolyp: Pseudo-Depth Guided Lightweight Segmentation for Real-Time Colonoscopy

    May 15, 2026Zhuoyu Wu, Wenhui Ou, Lexi Zhang +5EndoscopyImage Segmentation