关键词: Slope One算法, 聚类, Spark平台, 推荐算法

Abstract: Aiming at the problem that the original Slope One algorithm ignores the similarities between the projects when calculating the value of the recommendation prediction, and the  recommendation inefficiency is low in the big data age, the clustering weighted Slope One recommendation algorithm based on the Spark platform is proposed. Firstly, the nearest neighbor set is generated by Canopy-K-medoids clustering algorithm. Then, in the nearest neighbor set, the Slope One algorithm is used to estimate the similarity between the weighted items. Finally, parallelization is implemented on the Spark platform. The experiments in film data set show that optimization algorithm based on Spark platform compared with the traditional Slope One algorithm and weighted similarity of Slope project One algorithm, improves the precision of recommendation.

Key words: Slope One algorithm, clustering, Spark platform, recommendation algorithm