Scale-Aware Vision-Language Adaptation for Extreme Far-Distance Video Person Re-identification
Organizations: Arizona State University
Abstract
Extreme far-distance video person re-identification (ReID) is particularly challenging due to scale compression, resolution degradation, motion blur, and aerial-ground viewpoint mismatch. As camera altitude and subject distance increase, models trained on close-range imagery degrade significantly. In this work, we investigate how large-scale vision-language models can be adapted to operate reliably under these conditions. Starting from a CLIP-based baseline, we upgrade the visual backbone from ViT-B/16 to ViT-L/14 and introduce backbone-aware selective fine-tuning to stabilize adaptation of the larger transformer. To address noisy and low-resolution tracklets, we incorporate a lightweight temporal attention pooling mechanism that suppresses degraded frames and emphasizes informative observations. We retain adapter-based and prompt-conditioned cross-view learning to mitigate aerial-ground domain shifts, and further refine retrieval using improved optimization and k-reciprocal re-ranking. Experiments on the DetReIDX stress-test benchmark show that our approach achieves mAP scores of 46.69 (A2G), 41.23 (G2A), and 22.98 (A2A), corresponding to an overall mAP of 35.73. These results show that large-scale vision-language backbones, when combined with stability-focused adaptation, significantly enhance robustness in extreme far-distance video person ReID.
Figures & tables
| Dataset | Camera | Format | PIDs | BBoxes | Height (m) | Distance (m) |
|---|---|---|---|---|---|---|
| AG-ReID.v2 | UAV+CCTV | Still | 1615 | 100.6K | 15-45 | – |
| G2APS-ReID | UAV+CCTV | Still | 2788 | 200.8K | 20-60 | – |
| DetReIDX | DSLR+UAV | Video+Still | 334 | 13M | 5-120 | 10-120 |
| Parameter | Stage 1 | Stage 2 |
|---|---|---|
| Optimizer | Adam | Adam |
| Base Learning Rate | ||
| Max Epochs | 120 | 120 |
| Weight Decay | ||
| Weight Decay (Bias) | ||
| Images Per Batch | 16 | 16 |
| Parameter | Setting |
|---|---|
| Batch Size | 16 |
| Sequence Length | 16 |
| Feature Normalization | normalization |
| Distance Metric | Cosine similarity |
| Re-ranking | Disabled |
| Parameter | Baseline (ViT-B/16) | Ours (ViT-L/14) |
|---|---|---|
| Backbone | ViT-B/16 | ViT-L/14 |
| Stride Size | 16 | 14 |
| PBP Prompt Length | 1 | 4 |
| QATW Module | Disabled | Enabled |
| Instance Norm | Disabled | Enabled |
| Stage 1 Training | ||
| Method | A A | A G | G A | |||||||||
|---|---|---|---|---|---|---|---|---|---|---|---|---|
| R1 | R5 | R10 | mAP | R1 | R5 | R10 | mAP | R1 | R5 | R10 | mAP | |
| VSLA [ 21 ] | 15.96 | 26.10 | 32.77 | 13.83 | 28.96 | 54.71 | 69.13 | 41.63 | 58.43 | 65.17 | 69.66 | 26.26 |
| SINet [ 22 ] | 14.06 | 24.51 | 30.94 | 12.85 | 25.62 | 52.47 | 66.57 | 38.46 | 23.50 | 49.44 | 59.55 | 16.98 |
| PSTA [ 23 ] | 13.00 | 23.80 | 30.30 | 10.50 | 22.30 | 46.90 | 59.70 | 34.40 | 40.40 | 56.20 | 59.60 | 17.00 |
| BiCNet-TKS [ 24 ] | 13.30 | 26.78 | 36.57 | 9.71 | 21.71 | 44.85 | 59.30 | 33.28 | 41.57 | 58.43 | 65.17 | 22.12 |
| DUT_IIAU_LAB [ 25 ] | 25.39 | 39.58 | 48.44 | 20.13 | 37.77 | 65.26 | 75.31 | 43.93 | 69.66 | 80.90 | 87.64 | 35.44 |
| Variant | Backbone | mAP (%) | |
|---|---|---|---|
| CLIP ViT-B/16 | ViT-B/16 | 28.11 | +0.00 |
| + Optimization | 28.18 | +0.07 | |
| + k-reciprocal re-ranking | 29.40 | +1.29 | |
| + Re-ranking tuned | 29.47 | +1.36 | |
| + Temporal attention pooling | 29.71 | +1.60 | |
| + Re-ranking tuned (final) | 29.84 | +1.73 |
Person Re-Identification
Person re-identification matches the same individual across camera views, times, clothing, and sensing modalities despite changes in appearance.
See all 92 papers