Neural Collaborative Recommendation Algorithm Based on Attention Mechanism and Knowledge Graph

doi:10.3778/j.issn.1002-8331.2207-0314

Abstract

Abstract: At present, the traditional recommendation algorithm based on collaborative filtering has poor performance in the face of sparse data and cold start. However, the recommendation system assisted by knowledge graph can effectively alleviate this problem. Supplemented by attention mechanism, a neural collaborative recommendation algorithm combining attention mechanism and knowledge graph is designed. Then the attention mechanism is used to learn and aggregate the higher-order potential relationship information in the knowledge graph. At the same time, the user’s final preference is obtained through gated recurrent neural network training based on the user’s long-term and short-term interest preferences. Finally, the collaborative filtering method is used to generate the recommendation list. Through experiments on MovieLens-1M and Amazon-Book datasets, the recommended recall rate, accuracy rate, hit rate and NDCG evaluation indicators are all improved, which validates the effectiveness of the proposed method.

Key words: knowledge graph, attention mechanism, neural network, collaborative filtering

摘要： 目前传统的基于协同过滤的推荐算法面对数据稀疏和冷启动问题时表现欠佳，而知识图谱辅助的推荐系统可以有效缓解这一问题，辅以注意力机制，设计了一种融合注意力机制与知识图神经协同推荐算法。首先根据用户与项目的交互图与项目属性的知识图谱进行组合，以此为基础进行嵌入表示；然后利用注意力机制来学习知识图谱中的高阶潜在关系信息并进行聚合，同时结合用户的长短期兴趣偏好通过门控循环神经网络训练获取用户最终偏好进行推荐；最后采用协同过滤方法生成推荐列表。在MovieLens-1M和Amazon-Book数据集上进行实验，所提算法在推荐召回率、准确率、命中率和NDCG的评价指标上均有提升，验证了算法的有效性。

关键词: 知识图谱, 注意力机制, 神经网络, 协同过滤

ZHANG Chuang, WANG Wei, DU Yuxuan, ZHENG Xiaoli, HE Tingting. Neural Collaborative Recommendation Algorithm Based on Attention Mechanism and Knowledge Graph[J]. Computer Engineering and Applications, 2023, 59(22): 111-120.

张闯, 王巍, 杜雨晅, 郑小丽, 何婷婷. 融合注意力机制与知识图神经协同推荐算法[J]. 计算机工程与应用, 2023, 59(22): 111-120.

References

[1] HU B，SHI C，ZHAO W X，et al.Leveraging meta-path based context for top-n recommendation with a neural coattention model[C]//Proceedings of the 24th ACM SIGKDD International Conference on Knowledge Discovery and Data Mining.New York：ACM，2018：1531-1540.
[2] ZHANG F，YUAN N J，LIAN D，et al.Collaborative knowledge base embedding for recommender systems[C]//Proceedings of the 22nd ACM SIGKDD International Conference on Knowledge Discovery and Data Mining.New York：ACM，2016：353-362.
[3] JU C，WANG J，ZHOU G.The commodity recommendation method for online shopping based on data mining[J].Multimedia Tools and Applications，2019，78（21）：30097-30110.
[4] WU X，CHENG B，CHEN J.Collaborative filtering service recommendation based on a novel similarity computation method[J].IEEE Transactions on Services Computing，2015，10（3）：352-365.
[5] XUE F，HE X，WANG X，et al.Deep item-based collaborative filtering for top-n recommendation[J].ACM Transactions on Information Systems，2019，37（3）：33.
[6] WANG X，WANG D，XU C，et al.Explainable reasoning over knowledge graphs for recommendation[C]//Proceedings of the 33rd AAAI Conference on Artificial Intelligence，Hawaii，2019：5329-5336.
[7] RENDLE S，GANTNER Z，FREUDENTHALER C，et al.Fast contextaware recommendations with factorization machines[C]//Proceedings of the 34th International ACM SIGIR Conference on Research and Development in Information Retrieval，2011：635-644.
[8] XIANG H，TAT C.Neural factorization machines for sparse predictive analytics[C]//Proceedings of the 40th International ACM SIGIR Conference on Research and Development in Information Retrieval，2017：355-364.
[9] CHENG H T，KOC L，HARMSEN J，et al.Wide & deep learning for recommender systems[C]//Proceedings of the 1st Workshop on Deep Learning for Recommender Systems，2016：7-10.
[10] JIAN L，XIAO Z，FU Z，et al.xDeepFM：combining explicit and implicit feature interactions for recommender systems[C]//Proceedings of the 24th ACM SIGKDD International Conference on Knowledge Discovery and Data Mining，2018：1754-1763.
[11] SHAN Y，HOENS T R，JIAO J，et al.Deep crossing：web scale modeling without manually crafted combinatorial features[C]//Proceedings of the 22nd ACM SIGKDD International Conference on Knowledge Discovery and Data Mining，2016：255-262.
[12] ZHOU G，SONG C，ZHU X，et al.Deep interest network for click through rate prediction[C]//Proceedings of the 24th ACM SIGKDD International Conference on Knowledge Discovery and Data Mining，2018：1059-1068.
[13] WANG H，ZHANG F，WANG J，et al.RippleNet：propagating user preferences on the knowledge graph for recommender systems[C]//Proceedings of the 27th ACM International Conference on Information and Knowledge Management.New York：ACM，2018：417-426.
[14] WANG H W，ZHAO M.Knowledge graph convolutional networks for recommender systems[C]//Proceedings of the 2019 World Wide Web Conference，San Francisco，2019：3307-3313.
[15] WANG X，HE X，CAO Y，et al.KGAT：knowledge graph attention network for recommendation[C]//Proceedings of the 25th ACM SIGKDD International Conference on Knowledge Discovery and Data Mining，Anchorage，2019：950-958.
[16] ABDEL-BASSET M，MOHAMED M，ELHOSENY M，et al.Cosine similarity measures of bipolar neutrosophic set for diagnosis of bipolar disorder diseases[J].Artificial Intelligence in Medicine，2019，101：101735.
[17] PIAO G，BRESLIN J G.A study of the similarities of entity embeddings learned from different aspects of a knowledge base for item recommendations[C]//Proceedings of the 2018 European Semantic Web Conference.Cham：Springer，2018：345-359.
[18] 唐晓波，魏巍.基于本体的推荐系统研究综述[J].图书馆学研究，2016（18）：7-12.
TANG X B，WEI W.Review of ontology-based recommendation systems[J].Library Science Research，2016（18）：7-12.
[19] LIN Y，LIU Z，SUN M，et al.Learning entity and relation embeddings for knowledge graph completion[C]//Proceedings of the 29th AAAI Conference on Artificial Intelligence.Menlo Park：AAAI，2015：2181-2187.
[20] YANG B，YIH W，HE X，et al.Embedding entities and relations for learning and inference in knowledge bases[J].arXiv：1412.6575，2014.
[21] FENG Y，QIANG L，SHU W，et al.A dynamic recurrent model for next basket recommendation[C]//Proceedings of the 39th International ACM SIGIR Conference on Research and Development in Information Retrieval，2016：729-732．
[22] 贾丹.基于GRU的序列化数据推荐算法研究[D].太原：太原理工大学，2020.
JIA D.Research on recommendation algorithm of serialized data based on GRU[D].Taiyuan：Taiyuan University of Technology，2020.
[23] 李全，李书明，许新华，等.融合时空信息的双向GRU下一个地点推荐[J].小型微型计算机系统，2021，42（7）：1402-1406.
LI Q，LI S M，XU X H，et al.Next location recommendation based on bi-directional GRU confusing space and time information[J].Journal of Chinese Computer Systems，2021，42（7）：1402-1406.
[24] REND L S，GANTNE R Z.BPR：Bayesian personalized ranking from implicit feedback[C]//Proceedings of the 25th Conference on Uncertainty in Artificial Intelligence，Montreal，2009：18-21.
[25] KINGMA D，BA J.Adam：a method for stochastic optimization[J].arXiv：1412.6980，2014.
[26] AI Q，AZIZI V，CHEN X，et al.Learning heterogeneous knowledge base embeddings for explainable recommendation[J].Algorithms，2018，11（9）：137.
[27] 张屹晗，王巍，刘华真，等.基于知识图嵌入的协同过滤推荐算法[J].计算机应用研究，2021，38（12）：3590-3596.
ZHANG Y H，WANG W，LIU H Z，et al.Collaborative filtering recommendation algorithm based on knowledge graph embedding[J].Application Research of Computers，2021，38（12）：3590-3596.