Litcius/Paper detail

Correlation Graph Convolutional Network for Pedestrian Attribute Recognition

Haonan Fan, Hai‐Miao Hu, Shuailing Liu, Weiqing Lu, Shiliang Pu

2020IEEE Transactions on Multimedia36 citationsDOI

Abstract

The pedestrian attribute recognition aims at generating the structured description of pedestrian, which plays an important role in surveillance. However, it is difficult to achieve accurate recognition results due to diverse illumination, partial body occlusion and limited resolutions. Therefore, this paper proposes a comprehensive relationship framework for comprehensively describing and utilizing relations among attributes, describing different type of relations in the same dimension, and implementing complex transfers of relations in a GCN manner. This framework is named Correlation Graph Convolutional Network (CGCN). Based on the proposed framework, the feature vectors are built to associate attributes with image features and generate different relation matrices through self-attention among different feature vectors, describing different attribute relations. Then, we conduct multi-layer transfer of attribute relations by means of graph convolution, realizing complex utilization of attribute relations. In addition, the relations among attributes are fully exploited and two types of relations, namely the explicit and implicit relations, are proposed to be integrate into the proposed comprehensive relationship framework. The experimental results on RAP and PETA demonstrate that the recognition performance of the proposed CGCN can obviously outperform the state-of-the-arts, and moreover, the CGCN can achieve a better synergy with different relations.

Topics & Concepts

Computer scienceSpatial relationGraphRelation (database)Convolution (computer science)Artificial intelligenceFeature (linguistics)Pattern recognition (psychology)Data miningTheoretical computer scienceArtificial neural networkLinguisticsPhilosophyVideo Surveillance and Tracking MethodsAdvanced Neural Network ApplicationsMultimodal Machine Learning Applications
Correlation Graph Convolutional Network for Pedestrian Attribute Recognition | Litcius