Graph Attention Recommendation Model Based on Dual-End Knowledge Graph

doi:10.3778/j.issn.1002-8331.2103-0248

Abstract

Abstract: In view of the existing graph neural network（GNN） in capturing knowledge graph（KG） information and further using it for recommendation, focusing on the problems of project-side modeling, this paper proposes graph attention recommendation model based on dual-end knowledge graph. This model effectively enhances recommendation by mining relevant attributes on KG from the user side and the item side. From the perspective of the user side, it spreads user interest through the connections between entities in the knowledge graph and expands the users potential interest along the users historical clicks in KG. From the project side perspective, by capturing high-level structure and semantic information in KG, it samples the neighbors of each entity as the receiving field. The method obtains entity-entity interaction information through graph attention, and models high-order neighborhood information, finally uses the cross-entropy loss function for training. The results show that the model proposed in this paper is superior to other advanced approaches in accuracy and reliability on the three data sets about movie, book and music recommendation.

Key words: recommender systems, knowledge graph, graph attention mechanism, higher-order connectivity, embedding propagation

摘要： 针对现有图神经网络在捕获知识图谱信息并进一步用于推荐时，侧重于项目端建模所存在的问题，提出一种基于双端知识图的图注意推荐模型。该模型通过从用户端和项目端在知识图谱上挖掘相关属性来有效增强推荐。从用户端角度，通过知识图谱中实体之间的联系传播用户兴趣，沿着知识图谱中用户的历史点击项来扩展用户的潜在兴趣；从项目端角度，通过捕获知识图谱中的高阶结构和语义信息，对每个实体的邻居抽样作为接收场，通过图注意获得实体-实体交互信息，以此建模高阶邻域信息，最后使用交叉熵损失函数进行训练。结果表明，所提模型在关于电影、书籍和音乐推荐的三个数据集上，有效提高了推荐的准确性和可解释性。

关键词: 推荐系统, 知识图谱, 图注意机制, 高阶连通性, 偏好传播

SUN Wei, CHEN Pinghua, XIONG Jianbin, SHEN Jianfang. Graph Attention Recommendation Model Based on Dual-End Knowledge Graph[J]. Computer Engineering and Applications, 2022, 58(20): 141-147.

孙伟, 陈平华, 熊建斌, 申建芳. 基于双端知识图的图注意推荐模型[J]. 计算机工程与应用, 2022, 58(20): 141-147.

References

[1] BERG R，KIPF T N，WELLING M.Graph convolutional matrix completion[J].arXiv：1706.02263，2017.
[2] WANG Q，MAO Z，WANG B，et al.Knowledge graph embedding：a survey of approaches and applications[J].IEEE Transactions on Knowledge & Data Engineering，2017，29（12）：2724-2743.
[3] HUANG J，ZHAO W X，DOU H，et al.Improving sequential recommendation with knowledge-enhanced memory networks[C]//The 41st International ACMSIGIR Conference，2018.
[4] WANG H，ZHANG F，XIE X，et al.DKN：deep knowledge-aware network for news recommendation[C]//Proceedings of the 2018 World Wide Web Conference，2018：1835-1844.
[5] BORDES A，USUNIER N，GARCIA-DURAN A，et al.Translating embeddings for modeling multi-relational data[C]//Advances in Neural Information Processing Systems，2013：2787-2795.
[6] LIN Y，LIU Z，SUN M，et al.Learning entity and relation embeddings for knowledge graph completion[C]//Proceedings of the AAAI Conference on Artificial Intelligence，2015.
[7] ZHANG F，YUAN N J，LIAN D，et al.Collaborative knowledge base embedding for recommender systems[C]//Proceedings of the 22nd ACM SIGKDD International Conference on Knowledge Discovery and Data Mining，2016：353-362.
[8] LIU Yong，ZHAO Peilin，LIU Xin，et al.Learning user dependencies for recommendation[C]//Twenty-sixth International Joint Conference on Artificial Intelligence，2017.
[9] YU X，REN X，SUN Y，et al.Personalized entity recommendation：a heterogeneous information network approach[C]//Proceedings of the 7th ACM International Conference on Web Search and Data Mining，2014：283-292.
[10] ZHAO H，YAO Q，LI J，et al.Meta-graph based recommendation fusion over heterogeneous information networks[C]//KDD 2017，2017.
[11] WANG H，ZHANG F，WANG J，et al.Ripplenet：propagating user preferences on the knowledge graph for recommender systems[C]//Proceedings of the 27th ACM International Conference on Information and Knowledge Management，2018：417-426.
[12] 杨鹏，邵堃，霍星，等.融合用户隐含偏好的社会化推荐算法[J].小型微型计算机系统，2019，40（10）：2039-2045.
YANG P，SHAO K，HUO X，et al.Social recommendation algorithm integrating users’ implicit preferences[J].Journal of Chinese Computer Systems，2019，40（10）：2039-2045.
[13] HE X，DENG K，WANG X，et al.LightGCN：simplifying and powering graph convolution network for recommendation[J].arXiv：2002.02126，2020.
[14] KIPF T N，WELLING M.Semi-supervised classification with graph convolutional networks[C]//ICLR Internationnal Conference on Learning Representations，2016.
[15] BRUNA J，ZAREMBA W，SZLAM A，et al.Spectral networks and locally connected networks on graphs[J].arXiv：1312.6203，2013.
[16] DEFFERRARD M，BRESSON X，VANDERGHEYNST P.Convolutional neural networks on graphs with fast localized spectral filtering[C]//Advances in Neural Information Processing Systems，2016：3844-3852.
[17] WANG H，ZHAO M，XIE X，et al.Knowledge graph convolutional networks for recommender systems[C]//The World Wide Web Conference，2019：3307-3313.
[18] 秦川，祝恒书，庄福振，等.基于知识图谱的推荐系统研究综述[J].中国科学：信息科学，2020（7）：937-956.
QIN C，ZHU H S，ZHUANG F Z，et al.A survey on knowledge graph-based recommender systems[J].Scientia Sinica（Informationis），2020.
[19] WANG X，HE X，CAO Y，et al.Kgat：knowledge graph attention network for recommendation[C]//Proceedings of the 25th ACM SIGKDD International Conference on Knowledge Discovery & Data Mining，2019.