A Reinforcement Learning Approach to Collaborative Filtering Considering Time-sequence of Ratings


The KIPS Transactions:PartB , Vol. 19, No. 1, pp. 31-36, Feb. 2012
10.3745/KIPSTB.2012.19.1.31,   PDF Download:

Abstract

In recent years, there has been increasing interest in recommender systems which provide users with personalized suggestions for products or services. In particular, researches of collaborative filtering analyzing relations between users and items has become more active because of the Netflix Prize competition. This paper presents the reinforcement learning approach for collaborative filtering. By applying reinforcement learning techniques to the movie rating, we discovered the connection between a time sequence of past ratings and current ratings. For this, we first formulated the collaborative filtering problem as a Markov Decision Process. And then we trained the learning model which reflects the connection between the time sequence of past ratings and current ratings using Q-learning. The experimental results indicate that there is a significant effect on current ratings by the time sequence of past ratings.


Statistics
Show / Hide Statistics

Statistics (Cumulative Counts from September 1st, 2017)
Multiple requests among the same browser session are counted as one view.
If you mouse over a chart, the values of data points will be shown.


Cite this article
[IEEE Style]
J. K. Lee, B. H. Oh, J. H. Yang, "A Reinforcement Learning Approach to Collaborative Filtering Considering Time-sequence of Ratings," The KIPS Transactions:PartB , vol. 19, no. 1, pp. 31-36, 2012. DOI: 10.3745/KIPSTB.2012.19.1.31.

[ACM Style]
Jung Kyu Lee, Byong Hwa Oh, and Ji Hoon Yang. 2012. A Reinforcement Learning Approach to Collaborative Filtering Considering Time-sequence of Ratings. The KIPS Transactions:PartB , 19, 1, (2012), 31-36. DOI: 10.3745/KIPSTB.2012.19.1.31.