RamanSeg: Interpretability-driven Deep Learning on Raman Spectra for Cancer Diagnosis
Organizations: Department of Computer Science and Technology, University of Cambridge, Cambridge, UK · Department of Physics, University of Cambridge, Cambridge, UK · Department of Otorhinolaryngology, Jena University Hospital, Jena, Germany · Section Pathology of the Institute of Forensic Medicine, Jena University Hospital, Jena, Germany ·
Abstract
Histopathology, the current gold standard for cancer diagnosis, involves the manual examination of tissue samples after chemical staining, a time-consuming process requiring expert analysis. Raman spectroscopy is an alternative, stain-free method of extracting information from samples. Using nnU-Net, we trained a segmentation model on a novel dataset of spatial Raman spectra aligned with tumour annotations, achieving a mean foreground Dice score of 80.9%, surpassing previous work. Furthermore, we propose a novel, interpretable, prototype-based architecture called RamanSeg. RamanSeg classifies pixels based on discovered regions of the training set, generating a segmentation mask. Two variants of RamanSeg allow a trade-off between interpretability and performance: one with prototype projection and another projection-free version. The projection-free RamanSeg outperformed a U-Net baseline with a mean foreground Dice score of 67.3%, offering a meaningful improvement over a black-box training approach.
Figures & tables
| Feature Map Size | Mean Dice |
|---|---|
| (Baseline) | 1.0000 |
| 0.9804 | |
| 0.9581 | |
| 0.9113 | |
| 0.8356 |
| Model | Dice ( std) | Sensitivity ( std) | Specificity ( std) |
|---|---|---|---|
| U-Net | 66.7 15.4 | 81.5 23.6 | 90.9 5.5 |
| UNet Transformer | 69.8 10.9 | 79.9 18.1 | 92.5 3.9 |
| nnU-Net | 80.9 10.4 | 83.5 14.5 | 95.9 2.8 |
| RamanSeg | 60.5 11.7 | 95.9 3.4 | 79.1 4.9 |
| Projection-free RamanSeg | 67.3 8.2 | 70.3 17.5 | 93.3 5.5 |
Image Segmentation
Image segmentation assigns pixels or voxels to objects and regions, supporting measurement, scene understanding, and decisions across image domains.
See all 399 papers