Litcius/Paper detail

Learning Resolution-Adaptive Representations for Cross-Resolution Person Re-Identification

Lin Wu, Lingqiao Liu, Yang Wang, Zheng Zhang, Farid Boussaïd, Mohammed Bennamoun, Xianghua Xie

2023IEEE Transactions on Image Processing36 citationsDOI

Abstract

Cross-resolution person re-identification (CRReID) is a challenging and practical problem that involves matching low-resolution (LR) query identity images against high-resolution (HR) gallery images. Query images often suffer from resolution degradation due to the different capturing conditions from real-world cameras. State-of-the-art solutions for CRReID either learn a resolution-invariant representation or adopt a super-resolution (SR) module to recover the missing information from the LR query. In this paper, we propose an alternative SR-free paradigm to directly compare HR and LR images via a dynamic metric that is adaptive to the resolution of a query image. We realize this idea by learning resolution-adaptive representations for cross-resolution comparison. We propose two resolution-adaptive mechanisms to achieve this. The first mechanism encodes the resolution specifics into different subvectors in the penultimate layer of the deep neural network, creating a varying-length representation. To better extract resolution-dependent information, we further propose to learn resolution-adaptive masks for intermediate residual feature blocks. A novel progressive learning strategy is proposed to train those masks properly. These two mechanisms are combined to boost the performance of CRReID. Experimental results show that the proposed method outperforms existing approaches and achieves state-of-the-art performance on multiple CRReID benchmarks.

Topics & Concepts

Computer scienceArtificial intelligenceResolution (logic)Pattern recognition (psychology)Image resolutionResidualRepresentation (politics)Metric (unit)Matching (statistics)Computer visionFeature extractionAlgorithmMathematicsPoliticsEconomicsOperations managementLawStatisticsPolitical scienceVideo Surveillance and Tracking MethodsAdvanced Vision and ImagingAdvanced Image Processing Techniques
Learning Resolution-Adaptive Representations for Cross-Resolution Person Re-Identification | Litcius