Litcius/Paper detail

ContrastVAE

Yu Wang, Hengrui Zhang, Zhiwei Liu, Liangwei Yang, Philip S. Yu

2022Proceedings of the 31st ACM International Conference on Information & Knowledge Management52 citationsDOI

Abstract

Aiming at exploiting the rich information in user behaviour sequences, sequential recommendation has been widely adopted in real-world recommender systems. However, current methods suffer from the following issues: 1) sparsity of user-item interactions, 2) uncertainty of sequential records, 3) long-tail items. In this paper, we propose to incorporate contrastive learning into the framework of Variational AutoEncoders to address these challenges simultaneously. Firstly, we introduce ContrastELBO, a novel training objective that extends the conventional single-view ELBO to two-view case and theoretically builds a connection between VAE and contrastive learning from a two-view perspective. Then we propose Contrastive Variational AutoEncoder (ContrastVAE in short), a two-branched VAE model with contrastive regularization as an embodiment of ContrastELBO for sequential recommendation. We further introduce two simple yet effective augmentation strategies named model augmentation and variational augmentation to create a second view of a sequence and thus making contrastive learning possible. Experiments on four benchmark datasets demonstrate the effectiveness of ContrastVAE and the proposed augmentation methods. Codes are available at https://github.com/YuWang-1024/ContrastVAE

Topics & Concepts

Computer scienceAutoencoderBenchmark (surveying)Artificial intelligenceRegularization (linguistics)Recommender systemPerspective (graphical)Machine learningSequence (biology)Deep learningGeographyGeodesyGeneticsBiologyRecommender Systems and TechniquesAdvanced Graph Neural NetworksAdvanced Bandit Algorithms Research