Litcius/Paper detail

Privacy-Protected Person Re-Identification via Virtual Samples

Yutian Lin, Xiaoyang Guo, Zheng Wang, Bo Du

2023IEEE Transactions on Information Forensics and Security15 citationsDOI

Abstract

Most person re-identification (re-ID) approaches are based on representation learning of pedestrian images, which assume that the person’s appearance captured by cameras in the target is fully available. However, the exposure of appearance could cause serious privacy leakages. To address this issue, we focus on a new privacy-protected person re-ID task where the person’s appearance is unavailable for training. We first overcome the dilemma of lacking real person images by utilizing the virtual pedestrian samples ( <italic xmlns:mml="http://www.w3.org/1998/Math/MathML" xmlns:xlink="http://www.w3.org/1999/xlink">e.g</i> ., PersonX). Then, we introduce a composition of data augmentations to simulate real conditions, where the learned model is transferred to the real target in a black way. Specifically, the background behind, surrounding illumination, pose, scale, and attributes of pedestrians from the target scene, irrelevant to privacy, are utilized to generate virtual images. With above privacy-irrelevant information, we propose a Translation-Rendering-Sampling (TRS) framework to generate images toward the distribution of the real-world dataset (including background, pose, attribute, <italic xmlns:mml="http://www.w3.org/1998/Math/MathML" xmlns:xlink="http://www.w3.org/1999/xlink">etc</i> ). Extensive experiments are conducted on several realistic re-ID datasets excluding the person’s appearance. The experiments show that our method outperforms the baseline significantly as well as some transfer learning methods.

Topics & Concepts

Computer scienceRendering (computer graphics)Artificial intelligencePedestrianTask (project management)Focus (optics)Computer visionIdentification (biology)ManagementTransport engineeringBiologyEconomicsEngineeringPhysicsOpticsBotanyVideo Surveillance and Tracking MethodsHuman Pose and Action RecognitionGait Recognition and Analysis