ProAlign: Progressive Positional and Prototype-Guided Alignment for Aerial-Ground Person Re-Identification
Organizations: School of Cyber Science and Engineering, Wuhan University · National University of Singapore
Abstract
Aerial-Ground Person Re-Identification (AG-ReID) aims to match pedestrian images captured by unmanned aerial vehicles (UAVs) and ground-based surveillance cameras. The task remains highly challenging due to severe viewpoint discrepancies, frequent occlusions, and substantial domain gaps between aerial and ground imagery. Beyond these observable factors, existing methods often overlook two fundamental structural issues: cumulative positional drift during hierarchical feature extraction and semantic inconsistency across cross-view feature distributions. To address these challenges, we propose ProAlign, a Progressive Positional and Prototype-Guided Alignment Network for AG-ReID. ProAlign comprises two key components: a Layer-wise Progressive Positional Embedding (LPPE) module and a View-Aware Prototype Contrastive Learning (PCL) module. LPPE performs adaptive positional calibration throughout transformer layers by employing conditional positional encoding in shallow layers to mitigate local spatial distortions, while introducing learnable static positional embeddings in deeper layers to reinforce global semantic priors. Meanwhile, PCL maintains view-specific aerial and ground prototypes for each identity and enforces cross-view semantic consistency via a dual-prototype contrastive objective. Extensive experiments on CARGO and two real-world AG-ReID benchmarks demonstrate the effectiveness of ProAlign, achieving state-of-the-art overall retrieval performance on CARGO with improvements of 1.60% in Rank-1 accuracy and 5.01% in mAP over the strongest competing methods.
Figures & tables
| Method | Protocol 1: ALL | Protocol 2: G G | Protocol 3: A A | Protocol 4: A G | ||||||||
|---|---|---|---|---|---|---|---|---|---|---|---|---|
| Rank1 | mAP | mINP | Rank1 | mAP | mINP | Rank1 | mAP | mINP | Rank1 | mAP | mINP | |
| SBS He et al. (2023) | 50.32 | 43.09 | 29.76 | 72.31 | 62.99 | 48.24 | 67.50 | 49.73 | 29.32 | 31.25 | 29.00 | 18.71 |
| PCB Sun et al. (2019) | 51.00 | 44.50 | 32.20 | 74.10 | 67.60 | 55.10 | 55.00 | 44.60 | 27.00 | 34.40 | 30.40 | 20.10 |
| BoT Luo et al. (2019) | 54.81 | 46.49 | 32.40 | 77.68 | 66.47 | 51.34 | 65.00 | 49.79 | 29.82 | 36.25 | 32.56 | 21.46 |
| MGN Wang et al. (2018) | 54.81 | 49.08 | 36.52 | 83.93 | 71.05 | 55.20 | 65.00 | 52.96 | 36.78 | 31.87 | 33.47 | 24.64 |
| VV Kuma et al. (2019) ; Kumar et al. (2020) | 45.83 | 38.84 | 39.57 | 72.31 | 62.99 | 48.24 | 67.50 | 49.73 | 29.32 | 31.25 | 29.00 | 18.71 |
| Setting | Protocol 1: ALL | Protocol 2: G G | Protocol 3: A A | Protocol 4: A G | ||||||||
|---|---|---|---|---|---|---|---|---|---|---|---|---|
| Rank1 | mAP | mINP | Rank1 | mAP | mINP | Rank1 | mAP | mINP | Rank1 | mAP | mINP | |
| Baseline | 64.10 | 55.20 | 41.13 | 82.14 | 71.59 | 58.39 | 82.50 | 66.83 | 50.22 | 48.12 | 42.75 | 29.95 |
| Baseline + LPPE | 60.58 | 54.92 | 43.13 | 79.46 | 74.10 | 65.12 | 75.00 | 63.62 | 47.28 | 53.19 | 52.63 | 44.73 |
| Baseline + PCL | 65.38 | 58.55 | 46.49 | 79.46 | 73.99 | 64.52 | 82.50 | 67.66 | 51.20 | 58.51 | 57.65 | 49.68 |
| Baseline + LPPE + PCL | 68.27 | 62.47 | 51.39 | 84.82 | 80.22 | 72.51 | 85.00 | 70.05 | 54.66 | 60.64 | 58.44 | 49.86 |
| Setting | Protocol 1: ALL | Protocol 2: G G | Protocol 3: A A | Protocol 4: A G | ||||||||
|---|---|---|---|---|---|---|---|---|---|---|---|---|
| Rank1 | mAP | mINP | Rank1 | mAP | mINP | Rank1 | mAP | mINP | Rank1 | mAP | mINP | |
| Depths of CPE | ||||||||||||
| First 3 layers | 68.59 | 60.97 | 48.7 | 85.71 | 77.74 | 67.86 | 80.00 | 68.32 | 53.99 | 60.64 | 60.31 | 52.22 |
| First 6 layers | 68.27 | 62.47 | 51.39 | 84.82 | 80.22 | 72.51 | 85.00 | 70.05 | 54.66 | 60.64 | 58.44 | 49.86 |
| First 9 layers | 66.35 | 60.40 | 48.43 | 81.25 | 76.22 | 67.17 | 82.50 | 68.73 | 53.71 | 62.77 | 61.66 | 53.87 |
| All layers | 67.63 | 58.87 | 45.41 | 83.93 | 74.92 | 64.11 | 80.00 | 67.58 | 52.16 | 61.70 | 59.60 | 50.12 |
| Setting | Protocol 1: ALL | Protocol 2: G G | Protocol 3: A A | Protocol 4: A G | ||||||||
|---|---|---|---|---|---|---|---|---|---|---|---|---|
| Rank1 | mAP | mINP | Rank1 | mAP | mINP | Rank1 | mAP | mINP | Rank1 | mAP | mINP | |
| 66.67 | 57.24 | 42.85 | 82.14 | 73.79 | 62.44 | 80.00 | 64.44 | 46.03 | 63.83 | 57.99 | 46.82 | |
| 67.31 | 58.54 | 45.12 | 82.14 | 75.25 | 65.02 | 85.00 | 68.98 | 51.75 | 62.77 | 60.54 | 51.29 | |
| 68.27 | 62.47 | 51.39 | 84.82 | 80.22 | 72.51 | 85.00 | 70.05 | 54.66 | 60.64 | 58.44 | 49.86 | |
| 66.67 | 58.54 | 44.67 | 82.14 | 73.25 | 61.65 | 82.50 | 68.39 | 53.43 | 59.57 | 58.76 | 49.85 | |
| Setting | Protocol 1: ALL | Protocol 2: G G | Protocol 3: A A | Protocol 4: A G | ||||||||
|---|---|---|---|---|---|---|---|---|---|---|---|---|
| Rank1 | mAP | mINP | Rank1 | mAP | mINP | Rank1 | mAP | mINP | Rank1 | mAP | mINP | |
| Different variants of prototype | ||||||||||||
| Inner-Batch | 62.82 | 56.12 | 43.55 | 77.68 | 72.57 | 62.64 | 77.50 | 64.44 | 48.94 | 60.64 | 58.50 | 49.49 |
| Global Memory | 61.86 | 55.40 | 42.71 | 77.68 | 71.83 | 61.10 | 77.50 | 64.53 | 48.89 | 56.38 | 55.80 | 47.80 |
| Classifier Weights | 62.82 | 56.30 | 43.98 | 81.25 | 75.06 | 65.08 | 75.00 | 63.90 | 47.79 | 53.19 | 53.52 | 45.54 |
| View-Aware PCL | 68.27 | 62.47 | 51.39 | 84.82 | 80.22 | 72.51 | 85.00 | 70.05 | 54.66 | 60.64 | 58.44 | 49.86 |
| Setting | Params (M) | GFLOPs | Latency (ms) | Params | Latency |
|---|---|---|---|---|---|
| VDT | 85.97 | 60.75 | 11.19 | – | – |
| GSAlign | 111.67 | 76.92 | 11.44 | +29.9% | +2.23% |
| ProAlign | 86.98 | 74.69 | 11.25 | +1.17% | +0.54% |
| Layer | 3 | 4 | 5 | 6 | 7 | 8 | 9 | 10 | 11 |
|---|---|---|---|---|---|---|---|---|---|
| VDT | 1.000 | 1.000 | 1.000 | 1.000 | 1.000 | 1.000 | 1.000 | 1.000 | 1.000 |
| LPPE-0.25 | 0.982 | 0.982 | 0.977 | 0.951 | 0.881 | 0.851 | 0.864 | 0.857 | 0.986 |
| LPPE-0.5 | 0.983 | 0.982 | 0.960 | 0.868 | 0.809 | 0.839 | 0.837 | 0.865 | 0.931 |
| LPPE-0.75 | 0.982 | 0.985 | 0.958 | 0.861 | 0.817 | 0.842 | 0.860 | 0.881 | 0.941 |
| LPPE-1.0 | 0.982 | 0.982 | 0.973 | 0.951 | 0.871 | 0.850 | 0.862 | 0.845 | 0.974 |
Appendix figures & tables4 assets
Supplementary material from the paper’s appendix.
Appendix
| Setting | Protocol 1: A G | Protocol 2: G A | ||||
|---|---|---|---|---|---|---|
| Rank1 | mAP | mINP | Rank1 | mAP | mINP | |
| SBS [ 38 ] | 73.54 | 59.77 | - | 73.70 | 62.27 | - |
| BoT [ 34 ] | 70.01 | 55.47 | - | 71.20 | 58.83 | - |
| OSNet [ 41 ] | 72.59 | 58.32 | - | 74.22 | 60.99 | - |
| VV [ 39 , 40 ] | 77.22 | 67.23 | 41.43 | 79.73 | 69.83 | 42.37 |
| Explain [ 4 ] | 81.47 | 72.61 | - | 82.85 | 73.39 | - |
| Setting | Protocol 1: A G | Protocol 2: G A | Protocol 3: A W | Protocol 4: W A | ||||
|---|---|---|---|---|---|---|---|---|
| Rank1 | mAP | Rank1 | mAP | Rank1 | mAP | Rank1 | mAP | |
| BoT [ 34 ] | 85.40 | 77.03 | 84.65 | 75.90 | 89.77 | 80.48 | 84.65 | 76.90 |
| Explain [ 4 ] | 87.70 | 79.00 | 87.35 | 78.24 | 93.67 | 83.14 | 87.73 | 79.08 |
| VDT [ 6 ] | 86.46 | 79.13 | 86.14 | 78.12 | 90.00 | 82.21 | 85.26 | 78.52 |
| AG-ReIDv2 [ 10 ] | 88.77 | 80.72 | 87.86 | 78.51 | 93.62 | 84.85 | 88.61 | 80.11 |
| SeCap [ 30 ] | 88.12 | 80.84 | 88.24 | 79.99 | 91.44 | 84.01 | 87.56 | 80.15 |
| Setting | Protocol 1: ALL | Protocol 2: G G | Protocol 3: A A | Protocol 4: A G | ||||||||
|---|---|---|---|---|---|---|---|---|---|---|---|---|
| Rank1 | mAP | mINP | Rank1 | mAP | mINP | Rank1 | mAP | mINP | Rank1 | mAP | mINP | |
| 67.63 | 60.75 | 47.97 | 81.25 | 75.57 | 66.16 | 80.00 | 67.50 | 51.37 | 67.02 | 62.61 | 52.69 | |
| 68.27 | 62.47 | 51.39 | 84.82 | 80.22 | 72.51 | 85.00 | 70.05 | 54.66 | 60.64 | 58.44 | 49.86 | |
| 67.31 | 59.24 | 45.95 | 83.93 | 75.79 | 65.32 | 82.50 | 67.00 | 49.45 | 64.89 | 61.42 | 51.48 | |
Person Re-Identification
Person re-identification matches the same individual across camera views, times, clothing, and sensing modalities despite changes in appearance.
See all 97 papers