Collaborative Filtering Recommendation Algorithm Based on Graph Convolution Attention Neural Network

doi:10.3778/j.issn.1002-8331.2206-0190

Abstract

Abstract: With the rapid iterative development of information technology, the problem of information overload is becoming more and more serious. The recommendation algorithm can solve the information overload to a certain extent, but the traditional recommendation algorithm can not effectively solve the related problems such as data sparsity and recommendation accuracy. This paper proposes a graph convolution attention collaborative filtering（GCACF） recommendation method. Firstly, the model obtains the relevant interactive information of users and projects and transforms into corresponding feature vectors. Secondly, the feature vector aggregates with the propagation of graph convolution neural network and the attention mechanism redistributes the aggregated weight coefficients. Finally, the BPR loss function optimizes aggregated eigenvector and the model obtains the final recommendation result. Through the comparative experiments on Movielens-1M and Amazon-baby on two public datasets, GCACF is superior to the baseline method in precision, recall, Mrr, hit and NDCG.

Key words: recommendation system, deep learning, collaborative recommend, attention mechanism, graph convolution neural network

摘要： 随着信息技术的快速迭代发展，信息过载问题日益严重，推荐算法在一定程度上可以解决信息过载，但是传统推荐算法无法有效解决数据稀疏性和推荐准确性等相关问题。提出一种基于注意力的图卷积神经协同推荐方法（GCACF）。获取用户和项目的相关交互信息，并将其转换为相应的特征向量；将特征向量使用图卷积神经网络的传播方式聚合本地化信息，同时使用注意力机制重新分配聚合后的权重系数；最后将聚合后的特征向量使用BPR损失函数优化相关参数并得出最终推荐结果。在MovieLens-1M和Amazon-baby两个公开数据集进行对比实验，结果表明，GCACF在准确率、召回率、Mrr、命中率和NDCG五个指标上均优于基线方法。

关键词: 推荐系统, 深度学习, 协同推荐, 注意力, 图卷积神经网络

WANG Wei, DU Yuxuan, ZHENG Xiaoli, ZHANG Chuang. Collaborative Filtering Recommendation Algorithm Based on Graph Convolution Attention Neural Network[J]. Computer Engineering and Applications, 2023, 59(13): 247-258.

王巍, 杜雨晅, 郑小丽, 张闯. 基于图卷积自注意力机制的神经协同推荐算法[J]. 计算机工程与应用, 2023, 59(13): 247-258.

References

[1] STANLEY A J，CLIPSHAM P S.Information overload-myth or reality?[C]//IEEE Colloquium on IT Strategies for Information Overload，1998.
[2] GARNER W.Search engines[J].Nursing Standard，2006，22：20.
[3] WANG L，GAWTHROP P J.Data compression for estimation of the physical parameters of the SYSID’06 benchmark[J].IFAC Proceedings Volumes，2006，39：231-236.
[4] BOCHKOV N P，SRAM R J，KULESHOV N P，et al.System for the evaluation of the risk from chemical mutagens for man：Basic principles and practical recommendations[J].Mutation Research/Environmental Mutagenesis and Related Subjects，1976，38（3）：191-201.
[5] LIU Y，WANG S L，ZHANG J F，et al.A neural collaborative filtering method for identifying miRNA-disease associations[J].Neurocomputing，2021，422：176-185.
[6] ANAND S T.Generating items recommendations by fusing content and user-item based collaborative filtering[J].Procedia Computer Science，2020，167：1934-1940.
[7] CHEN H，QIAN F，CHEN J，et al.Attribute-based neural collaborative filtering[J].Expert Systems with Applications，2021，185（4）：115539.
[8] SRINIVAS R，VERMA N，KRAKA E，et al.Deep learning-based ligand design using shared latent implicit fingerprints from collaborative filtering[J].Journal of Chemical Information and Modeling，2021，61（5）：2159-2174.
[9] 刘佳.基于矩阵分解协同过滤算法的评分预测[J].科技创新与应用，2016（5）：86.
LIU J.Score prediction based on matrix decomposition collaborative filtering algorithm[D].Journal of Scientific and Technological Innovation and Application，2016（5）：86.
[10] ANWAR T，UMA V，SRIVASTAVA G.Rec-CFSVD++：implementing recommendation system using collaborative filtering and singular value decomposition（SVD）++[J].International Journal of Information Technology and Decision Making，2021（4）：1-19.
[11] HAN X，WANG Z，XU H J.Time-weighted collaborative filtering algorithm based on improved mini batch K-means clustering[J].Advances in Science and Technology，2021，105：309-317.
[12] KHALEDIAN N，MARDUKHi F.CFMT：a collaborative filtering approach based on the nonnegative matrix factorization technique and trust relationships[J].Journal of Ambient Intelligence and Humanized Computing，2022（5）：13.
[13] YU F，ZENG A，GILLARD S，et al.Network-based recommendation algorithms：a review[J].Physica A：Statistical Mechanics and its Applications，2016，452：192-208.
[14] ZHAO W X，MU S，HOU Y，et al.Recbole：towards a unified，comprehensive and efficient framework for recommendation algorithms[C]//Proceedings of the 30th ACM International Conference on Information & Knowledge Management，2021：4653-4664.
[15] WANG H，ZHANG F，XIE X，et al.DKN：deep knowledge-aware network for news recommendation[C]//Proceedings of the 2018 World Wide Web Conference，2018：1835-1844.
[16] SUN Q.Evaluation model of classroom teaching quality based on improved RVM algorithm and knowledge recommendation[J].Journal of Intelligent and Fuzzy Systems，2021，40（2）：2457-2467.
[17] CAI L，WEN W，WU B，et al.A coarse-to-fine user preferences prediction method for point-of-interest recommendation[J].Neurocomputing，2021，422（3）：1-11.
[18] FEIN G S，MERRITT E.Digital windshield information system employing a recommendation engine keyed to a map database system：US Patent 7，796，056[P].2010-09-14.
[19] ZHOU G，MOU N，FAN Y，et al.Deep interest evolution network for click-through rate prediction[C]//Proceedings of the AAAI Conference on Artificial Intelligence，2019：5941-5948.
[20] HIDASI B，KARATZOGLOU A，BALTRUNAS L，et al.Session-based recommendations with recurrent neural networks[J].arXiv：1511.06939，2015.
[21] BRONSTEIN M M，BRUNA J，LECUN Y，et al.Geometric deep learning：going beyond euclidean data[J].IEEE Signal Processing Magazine，2017，34（4）：18-42.
[22] KIPF T N，WELLING M.Semi-supervised classification with graph convolutional networks[J].arXiv：1609.02907，2016.
[23] 徐启东.非神经网络协同过滤推荐系统综述[J].长江信息通信，2021，34（11）：69-71.
XU Q D.Summary of non-neural network collaborative filtering recommendation system[J].Changjiang Information and Communications，2021，34（11）：69-71.
[24] LIU J G，ZHOU T，GUO Q，et al.Overview of the evaluated algorithms for the personal recommendation systems[J].Complex Systems & Complexity Science，2009，6（3）：1-10.
[25] YUE W，WANG Z，ZHANG J，et al.An overview of recommendation techniques and their applications in healthcare[J].Journal of automation，2021，8（4）：17.
[26] 王成，朱志刚，张玉侠，等.基于用户的协同过滤算法的推荐效率和个性化改进[J].小型微型计算机系统，2016，37（3）：428-432.
WANG C，ZHU Z G，ZHANG Y X，et al.Improvement in recommendation efficiency and personalized of user-based collaborative filtering algorithm[J].Journal of Chinese Computer Systems，2016，37（3）：428-432，.
[27]   周强.基于用户的协同过滤推荐算法研究[J].南昌高专学报，2006，21（3）：88-89.
ZHOU Q.Researches into recommandatory algorithm of coordinated filtration in view of consummers[J].Journal of Nanchang Junior College，2006，21（3）：88-89.
[28] 傅鹤岗，王竹伟.对基于项目的协同过滤推荐系统的改进[J].重庆理工大学学报（自然科学），2010（9）：69-74.
FU H G，WANG Z W.Improvement of item-based collaborative filtering algorithm[J].Journal of Chongqing University of Technology（Natural Science），2010（9）：69-74.
[29]   周万珍，曹迪，许云峰，等.推荐系统研究综述[J].河北科技大学学报，2020，41（1）：76-87.
ZHOU W Z，CAO D，XU Y F，et al.A survey of rec-ommendation systems[J].Journal of Hebei University of Science and Technology，2020，41（1）：76-87.
[30] 李改，李磊.基于矩阵分解的协同过滤算法[J].计算机工程与应用，2011，47（30）：4-7.
LI G，LI L.Collaborative filtering algorithm based on matrix decomposition[J].Computer Engineering and Applications，2011，47（30）：4-7.
[31] 张川.基于矩阵分解的协同过滤推荐算法研究[D].长春：吉林大学，2013.
ZHANG C.Research on collaborative filtering recommendation algorithm based on matrix decomposition[D].Changchun：Jilin University，2013.
[32] TANG J，QU M，WANG M，et al.LINE：large-scale information network embedding[C]//Proceedings of the International World Wide Web Conferences Steering Committee，2015.
[33] BAI T，WEN J R，ZHANG J，et al.A neural collaborative filtering model with interaction-based neighborhood[C]//Proceedings of the 2017 ACM on Conference on Information and Knowledge Management，2017.
[34] BERG R，KIPF T N，WELLING M.Graph convolutional matrix completion[J].arXiv：1706.02263，2017.
[35] WANG X，HE X，WANG M，et al.Neural graph collaborative filtering[C]//Proceedings of the 42nd International ACM SIGIR Conference on Research and Development in Information Retrieval，2019：165-174.
[36] HE X，DENG K，WANG X，et al.LightGCN：simplifying and powering graph convolution network for recommendation[C]//Proceedings of the 43rd International ACM SIGIR Conference on Research and Development in Information Retrieval，2020：639-648.
[37] WANG X，JIN H，ZHANG A，et al.Disentangled graph collaborative filtering[C]//Proceedings of the 43rd International ACM SIGIR Conference on Research and Development In Information Retrieval，2020.
[38] WU S，TANG Y，ZHU Y，et al.Session-based recommendation with graph neural networks[C]//Proceedings of the 33rd AAAI Conference on Artificial Intelligence，2019.
[39] XU C，ZHAO P，LIU Y，et al.Graph contextualized self-attention network for session-based recommendation[C]//Proceedings of the 28th International Joint Conference on Artificial Intelligence，2019.
[40] WANG H，ZHAO M，XIE X，et al.Knowledge graph convolutional networks for recommender systems[J].arXiv：1905.04413，2019.
[41] WANG X，HE X，CAO Y，et al.KGAT：knowledge graph attention network for recommendation[C]//Proceedings of the 25th ACM SIGKDD International Conference，2019.
[42] RENDLE S，FREUDENTHALER C，GANTNER Z，et al.BPR：Bayesian personalized ranking from implicit feedback[C]//Proceedings of the 25th Conference on Uncertainty in Artificial Intelligence，Montreal，QC，Canada，June 18-21，2009.
[43] XUE H J，DAI X，ZHANG J，et al.Deep matrix factorization models for recommender systems[C]//Proceedings of the 26th International Joint Conference on Artificial Intelligence，2017.
[44] HE X N，HE Z K，SONG J K，et al.NAIS：neural attentive item similarity model for recommendation[J].IEEE Transactions on Knowledge and Data Engineering，2018，30：2354-2366.
[45] 杜雨晅，王巍，张闯，等.基于自适应图卷积注意力神经协同推荐算法[J].计算机应用研究，2022（6）：1760-1766.
DU Y X，WANG W，ZHANG C，et al.Collaborative filtering recommendation algorithm based on adaptive neural graph convolution attention neural network[J].Application Research of Computers，2022（6）：1760-1766.