Bandits and Recommender Systems - Inria - Institut national de recherche en sciences et technologies du numérique Access content directly
Conference Papers Year : 2016

Bandits and Recommender Systems


This paper addresses the on-line recommendation problem facing new users and new items; we assume that no information is available neither about users, nor about the items. The only source of information is a set of ratings given by users to some items. By on-line, we mean that the set of users, and the set of items, and the set of ratings is evolving along time and that at any moment, the recommendation system has to select items to recommend based on the currently available information, that is basically the sequence of past events. We also mean that each user comes with her preferences which may evolve along short and longer scales of time; so we have to continuously update their preferences. When the set of ratings is the only available source of information , the traditional approach is matrix factorization. In a decision making under uncertainty setting, actions should be selected to balance exploration with exploitation; this is best modeled as a bandit problem. Matrix factors provide a latent representation of users and items. These representations may then be used as contextual information by the bandit algorithm to select items. This last point is exactly the originality of this paper: the combination of matrix factorization and bandit algorithms to solve the on-line recommendation problem. Our work is driven by considering the recommendation problem as a feedback controlled loop. This leads to interactions between the representation learning, and the recommendation policy.
Fichier principal
Vignette du fichier
Bandits_and_Recommender_Systems.pdf (1.5 Mo) Télécharger le fichier
Origin : Publisher files allowed on an open archive

Dates and versions

hal-01256033 , version 1 (14-01-2016)



Jérémie Mary, Romaric Gaudel, Philippe Preux. Bandits and Recommender Systems. First International Workshop on Machine Learning, Optimization, and Big Data (MOD'15), Jul 2015, Taormina, Italy. pp.325-336, ⟨10.1007/978-3-319-27926-8_29⟩. ⟨hal-01256033⟩
245 View
2995 Download



Gmail Facebook X LinkedIn More