Deep Collaborative Filtering Algorithm Based on Multi-Dimensional Feature Crossover

doi:10.3778/j.issn.1002-8331.2105-0306

Abstract

Abstract: The recommendation algorithm based on deep learning initially takes the ID information of user and item as input. However, the ID cannot well show the characteristics of user and item. In the original data, the user’s rating data on the item can show the characteristics of user and item to a certain extent. In this paper, implicit feedback and ID information are used as features of users and items in the rating task, which can eliminate the noise caused by users’ subjectivity and alleviate the problem of cold start to a certain extent. Single layer neural network is used to reduce the dimension of original high-dimensional sparse features, and feature crossover is used to get the low-order interaction between users and items, and then neural network is used to capture the high-order interaction between users and items, The high-order and low-order interactions between features are effectively extracted. Experiments on four public data sets show that the algorithm proposed in this paper can effectively improve the recommendation accuracy.

Key words: deep learning, rating data, implicit feedback, feature crossover

摘要： 基于深度学习的推荐算法最初以用户和物品的ID信息作为输入，但是ID无法很好地表现用户与物品的特征。在原始数据中，用户对物品的评分数据在一定程度上能表现出用户和物品的特征，但是未考虑用户的评分偏好以及物品的热门程度。在评分任务中使用隐式反馈和ID信息作为用户与物品的特征，在消除用户主观性对特征造成的噪声的同时在一定程度上缓解冷启动问题，利用单层神经网络对原始高维稀疏特征降维，使用特征交叉得到用户与物品的低阶交互，再利用神经网络捕获用户与物品的高阶交互，有效提取了特征间的高低阶交互。在四个公开数据集上的实验表明，该算法能有效提高推荐精度。

关键词: 深度学习, 评分数据, 隐式反馈, 特征交叉

LU Yuecong, WANG Ruiqin, JIN Nan. Deep Collaborative Filtering Algorithm Based on Multi-Dimensional Feature Crossover[J]. Computer Engineering and Applications, 2022, 58(22): 72-78.

陆悦聪, 王瑞琴, 金楠. 基于多维特征交叉的深度协同过滤算法[J]. 计算机工程与应用, 2022, 58(22): 72-78.

References

[1] RESNICK P，VARIAN H R.Recommender systems[J].Communications of the ACM，1997，40（3）：56-58.
[2] KOREN Y，BELL R，VOLINSKY C.Matrix factorization techniques for recommender systems[J].Computer，2009，42（8）：30-37.
[3] RUSLAN S，ANDRIY M，GEOFFREY H.Restricted Boltzmann machines for collaborative filtering[C]//Proceedings of the 24th International Conference on Machine Learning，2007：791-798.
[4] DONG X，YU L，WU Z，et al.A hybrid collaborative filtering model with deep structure for recommender systems[C]//Proceedings of the 31st AAAI Conference on Artificial Intelligence，2017：1309-1315.
[5] ZHANG W，DU T，WANG J.Deep learning over multi-field categorical data[C]//Proceedings of the 38th European Conference on Information Retrieval.Cham：Springer，2016：45-57.
[6] XUE H J，DAI X，ZHANG J，et al.Deep matrix factorization models for recommender systems[C]//Proceedings of the 26th International Joint Conference on Artificial Intelligence，2017：3203-3209.
[7] 冯兴杰，曾云泽.基于评分矩阵与评论文本的深度推荐模型[J].计算机学报，2020，43（5）：884-900.
FENG X J，ZENG Y Z.In-depth recommendation model based on rating matrix and review text[J].Chinese Journal of Computers，2020，43（5）：884-900.
[8] ZHANG S，YAO L，XU X.AutoSVD++：an efficient hybrid collaborative filtering model via contractive auto-encoders[C]//Proceedings of the 40th International ACM SIGIR Conference on Research and Development in Information Retrieval，2017：957-960.
[9] SARWAR B，KARYPIS G，KONSTAN J，et al.Item-based collaborative filtering recommendation algorithms[C]//Proceedings of the 10th International Conference on World Wide Web，2001：285-295.
[10] ADOMAVICIUS G，TUZHILIN A.Toward the next generation of recommender systems：a survey of the state-of-the-art and possible extensions[J].IEEE Transactions on Knowledge and Data Engineering，2005，17（6）：734-749.
[11] BOKDE D，GIRASE S，MUKHOPADHYAY D.Matrix factorization model in collaborative filtering algorithms：a survey[J].Procedia Computer Science，2015，49：136-146.
[12] HE X，LIAO L，ZHANG H，et al.Neural collaborative filtering[C]//Proceedings of the 26th International Conference on World Wide Web，2017：173-182.
[13] WANG S H，CHENG M J，MA Z Q，et al.Neural multi-task collaborative filtering[J].Evolutionary Intelligence，2020.DOI：10.1007/s12065-020-00409-5.
[14] NASSAR N，JAFAR A，RAHHAL Y.Multi-criteria collaborative filtering recommender by fusing deep neural network and matrix factorization[J].Journal of Big Data，2020，7：34.
[15] HE X，DU X，WANG X，et al.Outer product-based neural collaborative filtering[J].arXiv：1808.03912，2018.
[16] HU Y，KOREN Y，VOLINSKY C.Collaborative filtering for implicit feedback datasets[C]//Proceedings of the 2008 8th IEEE International Conference on Data Mining，2008：263-272.
[17] KOREN Y.Factorization meets the neighborhood：a multifaceted collaborative filtering model[C]//Proceedings of the 14th ACM SIGKDD International Conference on Knowledge Discovery and Data Mining，2008：426-434.
[18] 陈碧毅，黄玲，王昌栋，等.融合显式反馈与隐式反馈的协同过滤推荐算法[J].软件学报，2020，31（3）：794-805.
CHEN B Y，HUANG L，WANG C D，et al.Collaborative filtering recommendation algorithm combining explicit feedback and implicit feedback[J].Journal of Software，2020，31（3）：794-805.
[19] ZHU Z，HE Y，ZHANG Y，et al.Unbiased implicit recommendation and propensity estimation via combinational joint learning[C]//Proceedings of the 14th ACM Conference on Recommender Systems，2020：551-556.
[20] LIAN J，ZHOU X，ZHANG F，et al.xDeepFM：combining explicit and implicit feature interactions for recommender systems[C]//Proceedings of the 24th ACM SIGKDD International Conference on Knowledge Discovery and Data Mining，2018：1754-1763.
[21] 薛峰，刘凯，王东，等.基于深度神经网络和加权隐反馈的个性化推荐[J].模式识别与人工智能，2020，33（4）：295-302.
XUE F，LIU K，WANG D，et al.Personalized recommendation based on deep neural network and increased implicit feedback[J].Pattern Recognition and Artificial Intelligence，2020，33（4）：295-302.
[22] WANG H，WANG N，YEUNG D Y.Collaborative deep learning for recommender systems[C]//Proceedings of the 21st ACM SIGKDD International Conference on Knowledge Discovery and Data Mining，2015：1235-1244.
[23] MONGIA A，JHAMB N，CHOUZENOUX E，et al.Deep latent factor model for collaborative filtering[J].Signal Processing，2020，169：107366.
[24] WU Y，DUBOIS C，ZHENG A X，et al.Collaborative denoising auto-encoders for top-n recommender systems[C]//Proceedings of the 9th ACM International Conference on Web Search and Data Mining，2016：153-162.
[25] DUREDDY H V，KADEN Z.Handling cold-start collaborative filtering with reinforcement learning[J].arXiv：1806.
06192，2018.
[26] QU Y，CAI H，REN K，et al.Product-based neural networks for user response prediction[C]//Proceedings of the 2016 IEEE 16th International Conference on Data Mining，2016：1149-1154.
[27] DENG Z H，HUANG L，WANG C D，et al.DeepCF：a unified framework of representation learning and matching function learning in recommender system[C]//Proceedings of the 33rd AAAI Conference on Artificial Intelligence，2019：61-68.