Litcius/Paper detail

Visible-infrared person re-identification via specific and shared representations learning

Aihua Zheng, Juncong Liu, Zi Wang, Lili Huang, Chenglong Li, Bing Yin

2023Visual Intelligence14 citationsDOIOpen Access PDF

Abstract

Abstract The primary goal of visible-infrared person re-identification (VI-ReID) is to match pedestrian photos obtained during the day and night. The majority of existing methods simply generate auxiliary modalities to reduce the modality discrepancy for cross-modality matching. They capture modality-invariant representations but ignore the extraction of modality-specific representations that can aid in distinguishing among various identities of the same modality. To alleviate these issues, this work provides a novel specific and shared representations learning (SSRL) model for VI-ReID to learn modality-specific and modality-shared representations. We design a shared branch in SSRL to bridge the image-level gap and learn modality-shared representations, while a specific branch retains the discriminative information of visible images to learn modality-specific representations. In addition, we propose intra-class aggregation and inter-class separation learning strategies to optimize the distribution of feature embeddings at a fine-grained level. Extensive experimental results on two challenging benchmark datasets, SYSU-MM01 and RegDB, demonstrate the superior performance of SSRL over state-of-the-art methods.

Topics & Concepts

Modality (human–computer interaction)Computer scienceModalitiesDiscriminative modelArtificial intelligenceIdentification (biology)Benchmark (surveying)Class (philosophy)Feature learningMatching (statistics)Pattern recognition (psychology)MathematicsBotanySociologySocial scienceGeographyStatisticsGeodesyBiologyVideo Surveillance and Tracking MethodsAdvanced Neural Network ApplicationsImage Enhancement Techniques