CMCC-ReID: Cross-Modality Clothing-Change Person Re-Identification
Organizations: School of Artificial Intelligence, Beihang University, Beijing, China · School of Informatics, Xiamen University, Xiamen, Fujian, China
Abstract
Person Re-Identification (ReID) faces severe challenges from modality discrepancy and clothing variation in long-term surveillance scenario. While existing studies have made significant progress in either Visible-Infrared ReID (VI-ReID) or Clothing-Change ReID (CC-ReID), real-world surveillance system often face both challenges simultaneously. To address this overlooked yet realistic problem, we define a new task, termed Cross-Modality Clothing-Change Re-Identification (CMCC-ReID), which targets pedestrian matching across variations in both modality and clothing. To advance research in this direction, we construct a new benchmark SYSU-CMCC, where each identity is captured in both visible and infrared domains with distinct outfits, reflecting the dual heterogeneity of long-term surveillance. To tackle CMCC-ReID, we propose a Progressive Identity Alignment Network (PIA) that progressively mitigates the issues of clothing variation and modality discrepancy. Specifically, a Dual-Branch Disentangling Learning (DBDL) module separates identity-related cues from clothing-related factors to achieve clothing-agnostic representation, and a Bi-Directional Prototype Learning (BPL) module performs intra-modality and inter-modality contrast in the embedding space to bridge the modality gap while further suppressing clothing interference. Extensive experiments on the SYSU-CMCC dataset demonstrate that PIA establishes a strong baseline for this new task and significantly outperforms existing methods.
Figures & tables
| Dataset | Clothing-change | Cross-modality | IDs | Images | Cameras |
|---|---|---|---|---|---|
| PRCC [ 55 ] | ✔ | ✗ | 221 | 33,698 | 3 |
| LTCC [ 37 ] | ✔ | ✗ | 152 | 17,138 | 12 |
| RegDB [ 35 ] | ✗ | ✔ | 412 | 8240 | 2 |
| SYSU-MM01 [ 47 ] | ✗ | ✔ | 491 | 38,271 | 6 |
| SYSU-CMCC | ✔ | ✔ | 214 | 18,375 | 3 |
| Type | Method | SYSU-CMCC | |||||||
|---|---|---|---|---|---|---|---|---|---|
| Visible to Infrared | Infrared to Visible | ||||||||
| R-1 | R-10 | R-20 | mAP | R-1 | R-10 | R-20 | mAP | ||
| VI-ReID | DDAG [ 58 ] | 18.3 | 52.1 | 54.7 | 19.6 | 16.8 | 49.7 | 54.6 | 17.2 |
| CAJ [ 57 ] | 21.5 | 53.4 | 56.9 | 20.7 | 19.8 | 50.6 | 56.2 | 19.6 | |
| MPANet [ 49 ] | 19.8 | 51.2 | 55.5 | 19.9 | 18.4 | 51.1 | 57.8 | 19.0 | |
| PMT [ 32 ] | 18.6 | 50.8 | 57.4 | 19.2 | 17.9 | 52.5 | 58.7 | 18.9 | |
| Index | Baseline | DBDL | Progressive | BPL | V2I | I2V | ||||
|---|---|---|---|---|---|---|---|---|---|---|
| R-1 | mAP | R-1 | mAP | |||||||
| 1 | ✔ | ✗ | ✗ | ✗ | ✗ | ✗ | 40.1 | 33.2 | 35.6 | 37.1 |
| 2 | ✔ | ✔ | ✗ | ✗ | ✗ | ✗ | 43.2 | 35.7 | 38.6 | 38.7 |
| 3 | ✔ | ✔ | ✔ | ✗ | ✗ | ✗ | 45.6 | 37.6 | 40.5 | 39.1 |
| 4 | ✔ | ✔ | ✔ | ✔ | ✔ | ✗ | 46.9 | 39.5 | 42.7 | 41.6 |
| 5 | ✔ | ✔ | ✔ | ✔ | ✔ | ✔ | 57.0 | 46.5 | 50.4 | 50.3 |