When Cell Crops Share a Parent: Measuring and Isolating Acquisition Leakage in Cervical Cytology Benchmarks
Organizations: Independent Researcher, formerly affiliated with the Indian Institute of Science, Bengaluru, India · Department of Computer Science and Engineering, Jadavpur University, Kolkata, India · Qusbi Infotech Private Limited, Kolkata, India · Oregon Institute of Technology, USA
Abstract
Public cervical cytology benchmarks release many cell crops cut from far fewer microscope fields or slides and are often split at the crop level, so test cells share acquisition parents with training cells. In a preregistered study, crop-level splitting raised SIPaKMeD accuracy by 0.97 percentage points across twelve architectures and twenty seeds (95% CI 0.59-1.39), and CRIC accuracy by 12.08 points (11.16-12.99). On SIPaKMeD, a factorial that fixes training crop and parent counts attributes the gain to sibling exposure (1.73 points, 0.95-2.51), not to the extra parent diversity of crop-level splits (0.00). Parent identity is decodable at about 100 times chance, yet erasing 82% of its above-floor linear recoverability left the gap unchanged, and Grad-CAM did not distinguish leaking from clean models; matching test cells' color statistics to an unseen same-class field removed most of the advantage. Decodability and saliency cannot substitute for a parent-disjoint split.
Figures & tables
| Dataset | Parent | Crops | Parents | Sib. % | Pix. % | Models |
|---|---|---|---|---|---|---|
| SIPaKMeD [ 17 ] | field | 4,049 | 966 | 92.6 | 52.6 | ✓ |
| Cx22 [ 15 ] | image | 1,320 | 514 | 85.2 | 34.0 | – |
| CRIC [ 20 ] | slide | 11,534 | 400 | 99.97 | 71.5 | ✓ |
| Herlev [ 10 ] | cell | 917 | 917 | 0.0 | 0.0 | – |
| Hypothesis | Est. | 95% CI | |||
| H1 | SIPaKMeD crop vs. field | 0.97 | 0.59, 1.39 | 0.001 | ✓ |
| H2 | CRIC crop vs. slide | 12.08 | 11.16, 12.99 | 0.001 | ✓ |
| H3 | Leakage, matched size | 1.73 | 0.95, 2.51 | 0.02 | ✓ |
| H4 | Own-background route | 0.42 | −0.35, 1.18 | 0.23 | ✗ |
| H5 | Gap tracks (GRL) | 0.06 | −0.01, 0.12 | 0.16 | ✗ |
| F1 | CRIC slide-majority pull | −4.29 | −8.60, −1.37 | 0.001 | ✗ † |
Data Leakage
Data leakage is unintended information flow into model training, evaluation, or outputs that inflates results or exposes sensitive data.
See all 136 papers