Litcius/Paper detail

SkinningNet: Two-Stream Graph Convolutional Neural Network for Skinning Prediction of Synthetic Characters

Albert Mosella-Montoro, Javier Ruiz‐Hidalgo

20222022 IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR)18 citationsDOIOpen Access PDF

Abstract

This work presents SkinningNet, an end-to-end Two-Stream Graph Neural Network architecture that computes skinning weights from an input mesh and its associated skeleton, without making any assumptions on shape class and structure of the provided mesh. Whereas previous meth-ods pre-compute handcrafted features that relate the mesh and the skeleton or assume a fixed topology of the skeleton, the proposed method extracts this information in an end-to-end learnable fashion by jointly learning the best relationship between mesh vertices and skeleton joints. The proposed method exploits the benefits of the novel Multi-Aggregator Graph Convolution that combines the results of different aggregators during the summarizing step of the Message-Passing scheme, helping the operation to general-ize for unseen topologies. Experimental results demonstrate the effectiveness of the contributions of our novel architecture, with SkinningNet outperforming current state-of-the-art alternatives.

Topics & Concepts

SkinningComputer scienceGraphConvolutional neural networkExploitNetwork topologySkeleton (computer programming)Theoretical computer scienceArtificial intelligenceAlgorithmTopology (electrical circuits)MathematicsComputer securityProgramming languageCombinatoricsEcologyBiologyOperating systemHandwritten Text Recognition Techniques3D Shape Modeling and AnalysisImage Processing and 3D Reconstruction