Graph Attention Matrix Completion Based on Context of Knowledge Graph

doi:10.3778/j.issn.1002-8331.2011-0418

Abstract

Abstract: In order to solve the graph convolution-encoder weight sharing and cannot distinguish the importance between neighbors in the process of extracting user and item information, graph neural network method cannot show capturing the non-local context information of the knowledge graph（KG） in the process of using the KG as auxiliary information, this paper proposes graph attention encoder framework based on bi-directional interactive graph pass, which displays the local and non-local context information of the KG. First, the embedding vector of the user and the item is obtained by the graph attention encoder. Second, the algorithm captures the local context information of the KG through the user-specific graph attention mechanism. In addition, random walk sampling is used to extract the non-local context of the entity and recurrent neural network is used to model the dependency between the entity and the non-local context entity. Finally, the links in the bipartite graph are reconstructed by bi-linear decoder. Compared with existing methods, the experimental results on real datasets verify the superiority of this model.

Key words: matrix completion, graph attention network, knowledge graph, contextual

摘要： 针对图卷积编码器提取用户、项目信息过程中权重共享，不能区分邻域之间重要性，以及知识图谱作为辅助信息时，基于图神经网络方法无法显示对知识图谱非本地上下文（最相关的高阶邻居集合）信息进行捕获的问题，提出一种基于双向交互图传递的图注意编码器框架，显示利用知识图谱本地（一阶邻居集合）和非本地上下文信息。通过图注意编码器获取用户、项目的嵌入向量；考虑用户对实体的个性化偏好，通过特定于用户的图注意机制来捕获知识图的本地上下文信息；使用随机游走抽样提取实体的非本地上下文，并使用递归神经网络建模实体与非本地上下文实体之间的依赖关系，通过一个双线性解码器重建二部图中的链接。与现有的方法相比，在真实数据集上的实验结果验证了该模型的优越性。

关键词: 矩阵补全, 图注意网络, 知识图谱, 上下文

SUN Wei, CHEN Pinghua. Graph Attention Matrix Completion Based on Context of Knowledge Graph[J]. Computer Engineering and Applications, 2022, 58(11): 171-177.

孙伟, 陈平华. 基于知识图谱上下文的图注意矩阵补全[J]. 计算机工程与应用, 2022, 58(11): 171-177.

References

[1] VAN DEN BERG R，KIPF T N，WELLING M.Graph convolutional matrix completion[J].arXiv：1706.02263，2017.
[2] MA W，ZHANG M，CAO Y，et al.Jointly learning explainable rules for recommendation with knowledge graph[C]//The World Wide Web Conference，2019：1210-1221.
[3] HAMILTON W，YING Z，LESKOVEC J.Inductive representation learning on large graphs[C]//Advances in Neural Information Processing Systems，2017：1024-1034.
[4] DEFFERRARD M，BRESSON X，VANDERGHEYNST P.Convolutional neural networks on graphs with fast localized spectral filtering[C]//Advances in Neural Information Processing Systems，2016：3844-3852.
[5] KIPF T N，WELLING M.Semi-supervised classification with graph convolutional networks[C]//ICLR Internationnal Conference on Learning Representations，2017.
[6] LI Y，TARLOW D，BROCKSCHMIDT M，et al.Gatedgraph sequence neural networks[J].arXiv：1511.05493，2015.
[7] YING R，HE R，CHEN K，et al.Graph convolutional neural networks for web-scale recommender systems[C]//Proceedings of the 24th ACMSIGKDD International Conference on Knowledge Discovery & Data Mining，2018：974-983.
[8] AI Q，AZIZI V，CHEN X，et al.Learning heterogeneous knowledge base embeddings for explainable recommendation[J].Algorithms，2018，11（9）：137.
[9] CAO Y，WANG X，HE X，et al.Unifying knowledge graph learning and recommendation：towards a better understanding of user preferences[C]//The World Wide Web Conference，2019：151-161.
[10] LIU Y，ZHAO L，LIU G，et al.Dynamic Bayesian logistic matrix factorization for recommendation with implicit feedback[C]//Proceedings of IJCAI，2018：3463-3469.
[11] KIPF T N，WELLING M.Variational graph autoencoders[J].arXiv：1611.07308，2016.
[12] XU Q，SHEN F，LIU L，et al.GraphCAR：content-aware multimedia recommendation with graph autoencoder[C]//The 41st International ACM SIGIR Conference，2018.
[13] CANDèS E J，RECHT B.Exact matrix complete on via convex optimization[J].Foundations of Computational Mathematics，2009，9（6）：717.
[14] KALOFOLIAS V，BRESSON X，BRONSTEIN M，et al.Matrix completion on graphs[J].arXiv：1408.1717，2014.
[15] MONTI F，BRONSTEIN M，BRESSON X.Geometric matrix completion with recurrent multi-graph neural networks[C]//Advances in Neural Information Processing Systems，2017：3697-3707.
[16] YING R，HE R，CHEN K，et al.Graph convolutional neural networks for web-scale recommender systems[C]//Proceedings of the 24th ACM SIGKDD International Conference on Knowledge Discovery & Data Mining，2018：974-983.
[17] SUN Z，GUO Q，YANG J，et al.Research commentary on recommendations with side information：a survey and research directions[J].Electronic Commerce Research and Applications，2019，37：100879.
[18] ZHANG F，YUAN N J，LIAN D，et al.Collaborative knowledge base embedding for recommender systems[C]//the 22nd ACM SIGKDD International Conference，2016.
[19] DONG Y，CHAWLA N V，SWAMI A.metapath2vec：scalable representation learning for heterogeneous networks[C]//Proceedings of the 23rd ACM SIGKDD International Conference on Knowledge Discovery and Data Mining，2017：135-144.
[20] HU B，SHI C，ZHAO W X，et al.Leveraging meta-path based context for top-n recommendation with a neural co-attention model[C]//Proceedings of the 24th ACM SIGKDD International Conference on Knowledge Discovery & Data Mining，2018：1531-1540.
[21] HE X，LIAO L，ZHANG H，et al.Neural collaborative filtering[C]//Proceedings of the 26th International Conference on World Wide Web，2017：173-182.
[22] WANG H，ZHAO M，XIE X，et al.Knowledge graph convolutional networks for recommender systems[C]//The World Wide Web Conference，2019：3307-3313.
[23] WANG H，ZHANG F，ZHAO M，et al.Multi-task feature learning for knowledge graph enhanced recommendation[C]//The World Wide Web Conference，2019：2000-2010.
[24] WU S，ZHANG W，SUN F，et al.Graph neural networks in recommender systems：a survey[J].arXiv：2011.02260，2020.
[25] WANG H，LESKOVEC J.Unifying graph convolutional neural networks and label propagation[J].arXiv：2002. 06755，2020.
[26] AI Q，AZIZI V，CHEN X，et al.Learning heterogeneous knowledge base embeddings for explainable recommendation[J].Algorithms，2018，11（9）：137.
[27] WANG H W，ZHANG F Z,WANG J L，et al.Ripple network：propagating user preferences on the knowledge graph for recommender systems[C]//Proc 27th ACM Int Conf Information and Knowledge Management，2018.
[28] WANG X，HE X，CAO Y，et al.Kgat：knowledge graph attention network for recommendation[C]//Proceedings of the 25th ACM SIGKDD International Conference on Knowledge Discovery & Data Mining，2019：950-958.