Cluster-First Labelling: An Automated Pipeline for Segmentation and Morphological Clustering in Histology Whole Slide Images
Organizations: Department of Engineering Science, University of Oxford, United Kingdom · Department of Physiology, Anatomy and Genetics, University of Oxford, United Kingdom · Medical Sciences Division, University of Oxford, United Kingdom
Abstract
Labelling tissue components in histology whole slide images (WSIs) is prohibitively labour-intensive: a single slide may contain tens of thousands of structures--cells, nuclei, and other morphologically distinct objects--each requiring manual boundary delineation and classification. We present a cloudnative, end-to-end pipeline that automates this process through a cluster-first paradigm. Our system tiles WSIs, filters out tiles deemed unlikely to contain valuable information, segments tissue components with Cellpose-SAM (including cells, nuclei, and other morphologically similar structures), extracts neural embeddings via a pretrained ResNet-50, reduces dimensionality with UMAP, and groups morphologically similar objects using DBSCAN clustering. Under this paradigm, a human annotator labels representative clusters rather than individual objects, reducing annotation effort by orders of magnitude. We evaluate the pipeline on 3,696 tissue components across 13 diverse tissue types from three species (human, rat, rabbit), measuring how well unsupervised clusters align with independent human labels via per-tile Hungarian-algorithm matching. Our system achieves a weighted cluster-label alignment accuracy of 96.8%, with 7 of 13 tissue types reaching perfect agreement. The pipeline, a companion labelling web application, and all evaluation code are released as open-source software.
Figures & tables
| Batch | Cells | Tiles | Human | Model | Acc. (%) |
|---|---|---|---|---|---|
| clusters | clusters | ||||
| Batch 1 | 1,229 | 5 | 2 | 1 | 94.9 |
| Batch 2 | 1,117 | 15 | 3 | 2 | 97.7 |
| Batch 3 | 1,350 | 9 | 2 | 1 | 97.8 |
| Total | 3,696 | 29 | — | — | 96.8 |
| Tissue type | Species | Cells | Tiles | Acc. (%) |
|---|---|---|---|---|
| Appendix | Human | 662 | 1 | 91.4 |
| Ovary | Human | 587 | 2 | 99.7 |
| Compact bone | Human | 106 | 11 | 84.0 |
| Skeletal muscle | Human | 219 | 3 | 84.0 |
| Pancreas | Human | 28 | 1 | 100.0 |
| Kidney | Rat | 328 | 2 | 97.9 |
Whole-Slide Image Analysis
Whole-slide image analysis uses AI to interpret gigapixel pathology slides for diagnosis, prognosis, tissue mapping, and report generation.
See all 214 papers