Benchmarking and Improvement of Artifact Segmentation Methods in H&E-Stained Whole Slide Imaging
Organizations: Department of Data Science and Engineering, Silesian University of Technology, Akademicka 16, Gliwice, 44-100, Poland · Friedrich-Baur-Institute, Department of Neurology, LMU Medizin, Munich, 80336, Germany · Yale Cancer Center, Yale University, New Haven, 06511, CT, USA
Abstract
Technical artifacts introduced during tissue preparation or slide scanning remain a major obstacle to developing robust computational pathology algorithms for hematoxylin and eosin (HE)-stained whole-slide images (WSIs). Despite the growing number of quality-control tools, their real-world utility remains hard to assess because of the limited number of publicly available implementations and the lack of systematic, multi-dataset comparisons. This paper presents a benchmark of artifact segmentation methods for HE-stained WSIs. After a literature review, six publicly available algorithms were selected and compared in terms of their ability to segment artifact-free tissue and selected artifact classes. Two publicly available datasets and a newly introduced dataset released to support further research were used for evaluation. Tissue samples from multiple medical centers and different organs are included, enabling evaluation across heterogeneous data sources. Segmentation performance was assessed using Dice Index, pixel-level recall, and false discovery rate for artifact-free tissue segmentation. For algorithms supporting multiclass artifact segmentation, class-wise Dice Index and inter-class misclassification were evaluated. In addition to segmentation quality, processing time was assessed. Statistical analysis revealed significant differences in segmentation performance between methods. HistoKit, which incorporates a modified version of the GrandQC, was identified as the best-performing algorithm, while HistoQC was the worst. In terms of artifact types, dark spots and out of focus regions were harder to segment than others. Finally, a simple post-processing step was introduced for HistoKit, which further improved segmentation performance. The benchmark establishes a reference for evaluating and developing artifact segmentation methods for HE-stained WSIs.
Figures & tables
| Dataset A | Dataset B | Dataset C | |
| Number of Annotated Regions | 13 | 567 | 23 |
| Source | TCGA, CAMELYON16 | Medical Center in Austria | Compass NMD, TCGA |
| Formats | SVS / TIF | PNG | SVS |
| Organs | Breast, Head and Neck, Nervous system, Prostate, Small Intestine | Breast, Colon, Kidney, Prostate | Brain, Head and Neck, Heart, Kidney, Muscle, Uterus |
| Preservation Method | FFPE, Unknown | FFPE | FFPE, Fresh Frozen Tissue, Unknown |
| Annotated Classes | Artifact-Free Tissue, Background and Artifacts | Air Bubbles and Edges, Artifact-free Tissue, Dark spots and Foreign Objects, Out-of-Focus Regions, Tissue Folds | Air Bubbles and Edges, Artifact-Free Tissue, Background, Dark Spots and Foreign Objects, Out-of-Focus Regions, Pen, Tissue Folds |
| Method | Segmentation Stage | Mean (CI) [min] | |
| GrandQC | Tissue vs Background | 0.01 (0.00, 0.01) | |
| Artifact | 0.77 (0.75, 0.79) | ||
| All | 0.78 (0.76, 0.80) | ||
| HistoKit | Tissue vs Background | 4.16 (4.15, 4.16) | |
| Artifact | Overlap 0% | 0.41 (0.39, 0.43) | |
| Overlap 25% | 0.51 (0.49, 0.53) | ||
Histopathology Image Segmentation
Histopathology image segmentation identifies tissue regions, cells, and their boundaries in microscopic pathology images.
See all 53 papers