Litcius/Paper detail

Learning Multiscale Correlations for Human Motion Prediction

Honghong Zhou, Caili Guo, Hao Zhang, Yanjun Wang

202119 citationsDOI

Abstract

In spite of the great progress in human motion prediction, it is still a challenging task to predict those aperiodic and complicated motions. We believe that capturing the correlations among human body components is the key to understand the human motion. In this paper, we propose a novel multiscale graph convolution network (MGCN) to address this problem. Firstly, we design an adaptive multiscale interactional encoding module (MIEM) which is composed of two sub modules: scale transformation module (STM) and scale interaction module (SIM) to learn the human body correlations. Secondly, we apply a coarse-to-fine decoding strategy to decode the motions sequentially. We evaluate our approach on two standard benchmark datasets for human motion prediction: Human3.6M and CMU motion capture dataset. The experiments show that the proposed approach achieves the state-of-the-art performance for both short-term and long-term prediction especially in those complicated action category. We make codes publicly available at https://github.com/zhouhongh/MGCN.

Topics & Concepts

Computer scienceBenchmark (surveying)Encoding (memory)Motion (physics)Convolution (computer science)Aperiodic graphArtificial intelligenceDecoding methodsTask (project management)GraphKey (lock)Term (time)Motion captureScale (ratio)Transformation (genetics)Machine learningTheoretical computer scienceAlgorithmArtificial neural networkMathematicsEconomicsComputer securityManagementPhysicsChemistryCombinatoricsBiochemistryGeographyGeodesyGeneQuantum mechanicsHuman Pose and Action RecognitionHuman Motion and AnimationVideo Analysis and Summarization