Litcius/Paper detail

Learning Hybrid Behavior Patterns for Multimedia Recommendation

Zongshen Mu, Yueting Zhuang, Jie Tan, Jun Xiao, Siliang Tang

2022Proceedings of the 30th ACM International Conference on Multimedia43 citationsDOI

Abstract

Multimedia recommendation aims to predict user preferences where users interact with multimodal items. Collaborative filtering based on graph convolutional networks manifests impressive performance gains in multimedia recommendation. This is attributed to the capability of learning good user and item embeddings by aggregating the collaborative signals from high-order neighbors. However, previous researches [37,38] fail to explicitly mine different behavior patterns (i.e., item categories, common user interests) by exploiting user-item and item-item graphs simultaneously, which plays an important role in modeling user preferences. And it is the lack of different behavior pattern constraints and multimodal feature reconciliations that results in performance degradation. Towards this end, We propose a Hybrid Clustering Graph Convolutional Network (HCGCN) for multimedia recommendation. We perform high-order graph convolutions inside user-item clusters and item-item clusters to capture various user behavior patterns. Meanwhile, we design corresponding clustering losses to enhance user-item preference feedback and multimodal representation learning constraint to adjust the modality importance, making more accurate recommendations. Experimental results on three real-world multimedia datasets not only demonstrate the significant improvement of our model over the state-of-the-art methods, but also validate the effectiveness of integrating hybrid user behavior patterns for multimedia recommendation.

Topics & Concepts

Computer scienceRecommender systemCluster analysisCollaborative filteringGraphFeature learningConvolutional neural networkConstraint (computer-aided design)Information retrievalMultimediaHuman–computer interactionMachine learningArtificial intelligenceTheoretical computer scienceMechanical engineeringEngineeringRecommender Systems and TechniquesAdvanced Graph Neural NetworksImage Retrieval and Classification Techniques
Learning Hybrid Behavior Patterns for Multimedia Recommendation | Litcius