One-Shot Adaptive Segmentation For Scientific Images
Organizations: Elmore Family School of Electrical and Computer Engineering Purdue University West Lafayette, Indiana, USA 47907
Abstract
Scientific image segmentation methods rely on extensive annotation and task-specific training, limiting adaptation across imaging modalities and experimental conditions. We present a training-free, one-shot framework that specializes vision foundation models using a single annotated reference image. The framework combines DINOv3 representations with background-adaptive feature orthogonalization to suppress artifact-related feature directions, after which cosine similarity localizes candidate regions for SAM segmentation. We evaluate the framework on red-blood-cell microscopy, structured-illumination pool boiling, and chest radiography. Relative to the strongest baseline, the proposed method improves mean IoU by 5.91% and 78.62% on the microscopy and pool-boiling datasets, respectively, while achieving comparable performance on chest radiographs. These results demonstrate that one-shot reference conditioning can adapt general-purpose vision models to specialized scientific segmentation tasks.
Figures & tables
| Dataset | Imaging Modality | Method | Mean Target IoU | Mean Target Dice (F1) |
|---|---|---|---|---|
| PathOlOgics (RBCs) | Microscopy | SAM2 | 0.8670 | 0.9201 |
| PathOlOgics (RBCs) | Microscopy | GF-SAM | 0.8720 | 0.9297 |
| PathOlOgics (RBCs) | Microscopy | INSID3 | 0.7670 | 0.8644 |
| PathOlOgics (RBCs) | Microscopy | Ours | 0.9235 | 0.9591 |
| Pool Boiling | SI Reconstructed | SAM2 | 0.0600 | 0.1127 |
| Pool Boiling | SI Reconstructed | GF-SAM | 0.1646 | 0.2761 |