Cross Pairwise Ranking for Unbiased Item Recommendation
Qi Wan, Xiangnan He, Xiang Wang, Jiancan Wu, Wei Guo, Ruiming Tang
Abstract
Most recommender systems optimize the model on observed interaction data, which is affected by the previous exposure mechanism and exhibits many biases like popularity bias. The loss functions, such as the mostly used pointwise Binary Cross-Entropy and pairwise Bayesian Personalized Ranking, are not designed to consider the biases in observed data. As a result, the model optimized on the loss would inherit the data biases, or even worse, amplify the biases. For example, a few popular items take up more and more exposure opportunities, severely hurting the recommendation quality on niche items — known as the notorious Mathew effect.
Topics & Concepts
Pairwise comparisonPointwiseRecommender systemComputer scienceRanking (information retrieval)Cross entropyBayesian probabilityBinary numberEntropy (arrow of time)PopularityData miningMachine learningArtificial intelligenceMathematicsPrinciple of maximum entropyPsychologyMathematical analysisQuantum mechanicsSocial psychologyArithmeticPhysicsRecommender Systems and TechniquesAdvanced Bandit Algorithms ResearchConsumer Market Behavior and Pricing