Detecting Media Clones in Cultural Repositories Using a Positive Unlabeled Learning Approach
Organizations: Archimedes, ATHENA RC, Greece
Abstract
We formulate curator-in-the-loop duplicate discovery in the AtticPOT repository as a Positive-Unlabeled (PU) learning problem. Given a single anchor per artefact, we train a lightweight per-query Clone Encoder on augmented views of the anchor and score the unlabeled repository with an interpretable threshold on the latent l_2 norm. The system proposes candidates for curator verification, uncovering cross-record duplicates that were not verified a priori. On CIFAR-10 we obtain F1=96.37 (AUROC=97.97); on AtticPOT we reach F1=90.79 (AUROC=98.99), improving F1 by +7.70 points over the best baseline (SVDD) under the same lightweight backbone. Qualitative "find-similar" panels show stable neighbourhoods across viewpoint and condition. The method avoids explicit negatives, offers a transparent operating point, and fits de-duplication, record linkage, and curator-in-the-loop workflows.
Figures & tables
| Variant | WD | F1 op | AUROC | AUPRC | F1 best | |||
|---|---|---|---|---|---|---|---|---|
| L2 + learned | 128 | 0.1 | learned | 0 | 0.955 | 0.998 | 0.995 | 0.991 |
| L2 + fixed | 64 | 0.0 | 0.500 | 0 | 0.974 | 0.998 | 0.996 | 0.993 |
| L2 + fixed + WD | 128 | 0.1 | 0.500 | 1e-04 | 0.971 | 0.999 | 0.998 | 0.994 |
| L2 + learned + | 64 | 0.1 | learned | 0 | 0.954 | 0.994 | 0.986 | 0.987 |
| Cosine to centroid (best-F1) | 128 | 0.1 | 0.5 | 1e-4 | – | 0.987 | 0.985 | 0.962 |