cs.CVJul 16, 2026

Blurring Modal Boundaries: A Unified Survey from Single- to Multi-Modal Person Re-ldentification

Authors: Xiao WangBing WangBin YangCuiqun ChenXin XuMang Ye

Organizations: School of Computer Science and Technology, Wuhan University of Science and Technology, Wuhan, Hubei, 430065, China. · Hubei Province Key Laboratory of Intelligent Information Processing and Real-time Industrial System, Wuhan University of Science and Technology, Wuhan, Hubei, 430065, China. · School of Computer, Wuhan University, Wuhan, Hubei, 430072, China. · School of Computer, Anhui University, Hefei, Anhui, 232002, China.

Abstract

Person re-identification (ReID) serves as a critical component in intelligent surveillance systems, aiming to match identities across disjoint camera networks. While traditional methods primarily rely on single-modal RGB imagery, they are often constrained by environmental challenges such as low illumination and occlusion. To overcome these limitations, the field is rapidly evolving toward cross-modal and multi-modal paradigms. This survey presents a comprehensive overview of this transition, systematically reviewing key cross-modal tasks including visible-infrared (VI-ReID), text-image (TI-ReID), sketch-based (Sketch-ReID), and the emerging Non-Line-of-Sight (NLOS) ReID, which extends perception beyond direct visibility. Furthermore, we examine tri-spectral and multi-modal fusion ReID, discussing how complementary information from diverse sensors enhances robustness. Beyond summarizing datasets, challenges, and methodologies, we propose a Transformer-based baseline framework for visible-infrared ReID, designed to effectively capture modality-invariant features. Finally, based on the current landscape, we outline several promising directions for future research.

Explore similar work

CardsList