Unifying Online and Counterfactual Learning to Rank: A Novel Counterfactual Estimator that Effectively Utilizes Online Interventions
Harrie Oosterhuis, Maarten de Rijke
Abstract
Optimizing ranking systems based on user interactions is a well-studied problem. State-of-the-art methods for optimizing ranking systems based on user interactions are divided into online approaches - that learn by directly interacting with users - and counterfactual approaches - that learn from historical interactions. Existing online methods are hindered without online interventions and thus should not be applied counterfactually. Conversely, counterfactual methods cannot directly benefit from online interventions.
Topics & Concepts
Counterfactual thinkingComputer scienceEstimatorRank (graph theory)Psychological interventionOnline learningMachine learningArtificial intelligenceLearning to rankMultimediaPsychologyStatisticsMathematicsSocial psychologyCombinatoricsPsychiatryRanking (information retrieval)Mobile Crowdsensing and CrowdsourcingAdvanced Bandit Algorithms ResearchData Stream Mining Techniques