cs.AISep 17, 2026

LoRA Enhanced Contrastive Learning with SAS Vision Transformers

Authors: Dan Zimmerman, Frank E. Bobe, Amelia L. McCormack, Matthew Cook, Gregory D. Vetaw

Organizations: Center for Connected Autonomy & AI Florida Atlantic University Boca Raton, USA · Naval Surface Warfare Center Panama City Division Panama City, USA · Department of Computer Science Florida State University Tallahassee, USA

Abstract

Automatic target recognition (ATR) with synthetic aperture sonar (SAS) supports advanced naval capabilities, but deep learning is constrained by scarce target imagery, background clutter, and human-in-the-loop assessment. We adapt DINOv3 Vision Transformer (ViT) models to underwater SAS ATR using a three-stage parameter-efficient framework. Stage 1 uses Low-Rank Adaptation (LoRA) while freezing the ViT backbone, bridging the gap between natural-image pretraining and underwater acoustic propagation. Stage 2 uses hard-negative mining to strengthen the decision boundary against acoustic mimics, including rocks and sediment formations resembling man-made targets. Stage 3 uses Supervised Contrastive Learning (SupCon) to separate target and clutter representations. We evaluate at-sea SAS data using a mission-level geographic split, compare all arms at 85 percent test recall, and repeat each comparison over three random seeds. LoRA accounts for the primary effect, increasing area under the precision-recall curve (AUPRC) from 0.300 to 0.679 +/- 0.027 using the same frozen backbone. Rank 4 achieves this result while training only 0.26 percent of weights. Neither refinement stage exceeds its matched control: hard-negative mining changes AUPRC by -0.0045 +/- 0.0119 versus an equal-size random curriculum, and SupCon changes AUPRC by +0.0002 +/- 0.0096 versus the preceding stage. These null results indicate that mining occurred on data the encoder had already fit and that supervised stages had already imposed most target-clutter geometry. One efficient adaptation stage is sufficient; stacked refinement is not.

Figures & tables

Explore similar work

CardsList
  1. A Comparison of Data Augmentation Methods for Training Deep Neural Networks on Synthetic Aperture Sonar

    Jul 26, 2026C. J. Moore, Gregory D. Vetaw, Jordan MalofSynthetic Data AugmentationData Augmentation

  2. SAMBA: A Scatter-Guided Masked Bidirectional Mamba Foundation Model for SAR Target Recognition

    Jun 30, 2026Ke Wang, Xiaoyi Pan, Zhaoyu Gu +4MambaSelf-Supervised Pre-Training