Research Advances on Graph Neural Network Recommendation of Knowledge Graph Enhancement

doi:10.3778/j.issn.1002-8331.2205-0268

Abstract

Abstract: The existing recommendation methods are mainly based on the users’ historical interaction behavior, and the user and item-related feature information are not fully utilized, resulting in the effect of the recommendation is not ideal. The graph neural network（GNN） recommendation enhanced by knowledge graph（KG） is based on the interaction graph constructed by user and item interaction behavior, and the knowledge graph with the same graph structure is introduced and processed by the graph neural network technology, so as to realize personalized recommendation. In this paper, the research progress of graph neural network recommendation enhanced by existing knowledge graph is discussed. Firstly, on the basis of the discussion of graph neural network recommendation and knowledge graph recommendation, the relevant research results of graph neural network recommendation enhanced by the current knowledge graph are deeply analyzed from the aspects of item knowledge graph and collaborative knowledge graph. Then, the main problems in the graph neural network recommendation research based on the existing knowledge graph enhancement are pointed out from the aspects of large-scale dynamic knowledge graph processing, user preference mining for item attributes, knowledge graph embedding learning problem and so on. Finally, the main research directions of GNN recommendation enhanced by knowledge graph in the future are predicted from the following aspects：GNN recommendation enhanced by knowledge graph in dynamic sequential sequence, GNN recommendation enhanced by knowledge graph in meta-learning, GNN recommendation enhanced by multi-model knowledge graph, GNN cross-domain recommendation enhanced by knowledge graph and so on.

Key words: knowledge graph, graph neural network, recommendation system, item knowledge graph, collaborative knowledge graph

摘要： 已有推荐方法主要基于用户与项目的历史交互行为，未充分运用用户及项目相关特征信息，推荐效果并不理想。知识图谱（knowledge graph，KG）增强的图神经网络（graph neural network，GNN）推荐，是以用户与项目交互行为构建的交互图为基础，引入同为图结构的知识图谱，并运用图神经网络技术进行处理，从而实现个性化推荐。深入探讨了现有知识图谱增强的图神经网络推荐研究进展。首先在对图神经网络推荐和知识图谱推荐进行探讨的基础上，从项目知识图谱和协同知识图谱视角，深入分析了当前知识图谱增强的图神经网络推荐取得的相关研究成果；然后从大规模动态知识图谱处理、用户对项目属性的偏好挖掘、知识图谱的图嵌入学习等方面，指出了已有知识图谱增强的图神经网络推荐研究存在的主要问题；最后从动态时序知识图谱增强的GNN推荐、元学习的知识图谱增强GNN推荐、多模态知识图谱增强的GNN推荐、知识图谱增强的GNN跨领域推荐等方面，展望了知识图谱增强的图神经网络推荐未来主要研究方向。

关键词: 知识图谱, 图神经网络, 推荐系统, 项目知识图谱, 协同知识图谱

WU Guodong, WANG Xueni, LIU Yuliang. Research Advances on Graph Neural Network Recommendation of Knowledge Graph Enhancement[J]. Computer Engineering and Applications, 2023, 59(4): 18-29.

吴国栋, 王雪妮, 刘玉良. 知识图谱增强的图神经网络推荐研究进展[J]. 计算机工程与应用, 2023, 59(4): 18-29.

References

[1] XIONG H，LIU Z.A situation information integrated personalized travel package recommendation approach based on TD-LDA model[C]//2015 International Conference on Behavioral，Economic and Socio-Cultural Computing，Nanjing，2015：32-37.
[2] QING Y X.An intelligent E-commerce recommendation algorithm based on collaborative filtering technology[C]//2014 7th International Conference on Intelligent Computation Technology and Automation，Changsha，2014：80-83.
[3] SHU J，SHEN X，LIU H，et al.A content-based recommendation algorithm for learning resources[J].Multimedia Systems，2018，24（2）：163-173.
[4] ADOMAVICIUS G，TUZHILIN A，Toward the next generation of recommender systems：a survey of the state-of-the-art and possible extensions[J].IEEE Transactions on Knowledge and Data Engineering，2005，17（6）：734-749.
[5] 黄立威，江碧涛，吕守业，等.基于深度学习的推荐系统研究综述[J].计算机学报，2018，41（7）：1619-1647.
HUANG L W，JIANG B T，LV S Y，et al.Survey on deep learning based recommender systems[J].Chinese Journal of Computers，2018，41（7）：1619-1647.
[6] GORI M，MONFARDINI G，SCARSELLI F.A new model for learning in graph domains[C]//2005 IEEE International Joint Conference on Neural Networks，2005：729-734.
[7] LIU Q，LI Y，DUAN H，et al.Knowledge graph construction techniques[J].Journal of Computer Research and Development，2016，53（3）：582-600.
[8] WANG Q，MAO Z D，WANG B，et al.Knowledge graph embedding：a survey of approaches and applications[J].IEEE Transactions on Knowledge and Data Engineering，2017，29（12）：2724-2743.
[9] CATHERINE R，COHEN W.Personalized recommendations using knowledge graphs：a probabilistic logic programming approach[C]//Proceedings of the 10th ACM Conference on Recommender Systems，2016：325-332.
[10] GUO Q Y，ZHUANG F Z，QIN C，et al.A survey on knowledge graph-based recommender systems[J].IEEE Transactions on Knowledge and Data Engineering，2022，34（8）：3549-3568.
[11] WU S，SUN F，ZHANG W，et al.Graph neural networks in recommender systems：a survey[J].arXiv：2011.02260，2020.
[12] CHENG H T，KOC L，HARMSEN J，et al.Wide & deep learning for recommender systems[C]//Proceedings of the 1st Workshop on Deep Learning for Recommender Systems，2016：7-10.
[13] KIPF T N，WELLING M.Semi-supervised classification with graph convolutional networks[J].arXiv：1609.02907，2017.
[14] BERG R，KIPF T N，WELLING M.Graph convolutional matrix completion[J].arXiv：1706.02263，2017.
[15] HE X，DENG K，WANG X，et al.LightGCN：simplifying and powering graph convolution network for recommendation[C]//Proceedings of the 43rd International ACM SIGIR Conference on Research and Development in Information Retrieval，2020：639-648.
[16] CHENL，WU L，HONG R，et al.Revisiting graph based collaborative filtering：a linear residual graph convolutional network approach[C]//Proceedings of the 34th AAAI Conference on Artificial Intelligence，2020：27-34.
[17] LI Q，HAN Z，WU X M.Deeper insights into graph convolutional networks for semi-supervised learning[C]//Proceedings of the 32nd AAAI Conference on Artificial Intelligence，2018.
[18] WANG H，LIAN D，GE Y.Binarized collaborative filtering with distilling graph convolutional networks[J].arXiv：1906.
01829，2019.
[19] FAN W，MA Y，LI Q，et al.Graph neural networks for social recommendation[C]//2019 World Wide Web Conference，2019：417-426.
[20] LIU F，CHENG Z，ZHU L，et al.Interest-aware message-passing GCN for recommendation[C]//Proceedings of the Web Conference 2021，2021：1296-1305.
[21] ZHANG J，SHI X，ZHAO S，et al.Star-GCN：stacked and reconstructed graph convolutional networks for recommender systems[C]//Proceedings of the 28th International Joint Conference on Artificial Intelligence，2019：4264-4270.
[22] 张祎，孟小峰.InterTris：三元交互的领域知识图谱表示学习[J].计算机学报，2021，44（8）：1535-1548.
ZHANG Y，MENG X F.InterTris：Specific domain knowledge graph representation learning by Interaction among triple elements[J].Chinese Journal of Computers，2021，44（8）：1535-1548.
[23] ZHANG F，YUAN N J，LIAN D，et al.Collaborative knowledge base embedding for recommender systems[C]//Proceedings of the 22nd ACM SIGKDD International Conference on Knowledge Discovery and Data Mining，2016：353-362.
[24] WANG H，ZHANG F，XIE X，et al.DKN：deep knowledge-aware network for news recommendation[C]//Proceedings of the 2018 World Wide Web Conference，2018：1835-1844.
[25] SHI C，HU B，ZHAO W X，et al.Heterogeneous information network embedding for recommendation[J].IEEE Transactions on Knowledge and Data Engineering，2018，31（2）：357-370.
[26] MNIH A，SALAKHUTDINOV R R.Probabilistic matrix factorization[C]//Advances in Neural Information Processing Systems，2008：1257-1264.
[27] WANG H，ZHANG F，WANG J，et al.RippleNet：propagating user preferences on the knowledge graph for recommender systems[C]//Proceedings of the 27th ACM International Conference on Information and Knowledge Management，2018：417-426.
[28] WANG H，ZHAO M，XIE X，et al.Knowledge graph convolutional networks for recommender systems[C]//2019 World Wide Web Conference，2019：3307-3313.
[29] 刘欢，李晓戈，胡立坤，等.基于知识图谱驱动的图神经网络推荐模型[J].计算机应用，2021，41（7）：1865-1870.
LIU F，LI X G，HU L K，et al.Knowledge graph driven recommendation model of graph neural network[J].Journal of Computer Applications，2021，41（7）：1865-1870.
[30] TIEN D N，VAN H P.Graph neural network combined knowledge graph for recommendation system[C]//International Conference on Computational Data and Social Networks.Cham：Springer，2020：59-70.
[31] HE X，LIAO L，ZHANG H，et al.Neural collaborative filtering[C]//Proceedings of the 26th International Conference on World Wide Web，2017：173-182.
[32] WANG H，ZHANG F，ZHANG M，et al.Knowledge-aware graph neural networks with label smoothness regularization for recommender systems[C]//Proceedings of the 25th ACM SIGKDD International Conference on Knowledge Discovery and Data Mining，2019：968-977.
[33] ZHAO B，XU Z，TANG Y，et al.Effective knowledge-aware recommendation via graph convolutional networks[C]//International Conference on Web Information Systems and Applications.Cham：Springer，2020：96-107.
[34] TOGASHI R，OTANI M，SATOH S.Alleviating cold-start problems in recommendation through pseudo-labelling over knowledge graph[C]//Proceedings of the 14th ACM International Conference on Web Search and Data Mining，2021：931-939.
[35] BLUM A，MITCHELL T.Combining labeled and unlabeled data with co-training[C]//Proceedings of the 11th Annual Conference on Computational Learning Theory，1998：92-100.
[36] LIU Y，YANG S，XU Y，et al.Contextualized graph attention network for recommendation with item knowledge graph[J].IEEE Transactions on Knowledge and Data Engineering，2023，35（1）：181-195.
[37] 孙伟，陈平华.基于知识图谱上下文的图注意矩阵补全[J].计算机工程与应用，2022，58（11）：171-177.
SUN W，CHEN P H.Graph attention matrix completion based on the context of knowledge graph[J].Computer Engineering and Applications，2022，58（11）：171-177.
[38] CHO K，VAN M B，GULCEHRE C，et al.Learning phrase representations using RNN encoder-decoder for statistical machine translation[C]//Proceedings of the 2014 Conference on Empirical Methods in Natural Language Processing，2014：1724-1734.
[39] WANG X，HE X，CAO Y，et al.KGAT：knowledge graph attention network for recommendation[C]//Proceedings of the 25th ACM SIGKDD International Conference on Knowledge Discovery and Data Mining，2019：950-958.
[40] 荣沛，苏凡军.基于知识图注意网络的个性化推荐算法[J].计算机应用研究，2021，38（2）：398-402.
RONG P，SU F J.Personalized recommendation algorithm based on knowledge graph attention network[J].Application Research of Computers，2021，38（2）：398-402.
[41] YANG Z，DONG S.HAGERec：hierarchical attention graph convolutional network incorporating knowledge graph for explainable recommendation[J].Knowledge-Based Systems，2020，204：106194.
[42] QU Y，BAI T，ZHANG W，et al.An end-to-end neighborhood-based interaction model for knowledge-enhanced recommendation[C]//Proceedings of the 1st International Workshop on Deep Learning Practice for High-Dimensional Sparse Data，2019：1-9.
[43] WANG X，HUANG T，WANG D，et al.Learning intents behind interactions with knowledge graph for recommendation[C]//Proceedings of the Web Conference 2021，2021：878-887.
[44] SHA X，SUN Z，ZHANG J.Attentive knowledge graph embedding for personalized recommendation[J].arXiv：1910.08288，2019.
[45] TAI C Y，WU M R，CHU Y W，et al.MVIN：learning multiview items for recommendation[C]//Proceedings of the 43rd International ACM SIGIR Conference on Research and Development in Information Retrieval，2020：99-108.
[46] BARSHAN E，FIEGUTH P.Stage-wise training：an improved feature learning strategy for deep models[C]//Proceedings of the 1st Workshop on Feature Extraction：Modern Questions and Challenges，2015：49-59.
[47] YING R，HE R，CHEN K，et al.Graph convolutional neural networks for web-scale recommender systems[C]//Proceedings of the 24th ACM SIGKDD International Conference on Knowledge Discovery and Data Mining，2018：974-983.
[48] LYU X，LI G，HUANG J，et al.Rule-guided graph neural networks for recommender systems[C]//International Semantic Web Conference.Cham：Springer，2020：384-401.
[49] FENG Y，HU B，LV F，et al.ATBRG：adaptive target-behavior relational graph network for effective recommendation[C]//Proceedings of the 43rd International ACM SIGIR Conference on Research and Development in Information Retrieval，2020：2231-2240.
[50] 梁顺攀，涂浩，王荣生，等.融合重要性采样和池化聚合的知识图推荐算法[J].小型微型计算机系统，2021，42（5）：967-971.
LIANG S P，TU H，WANG R S，et al.Knowledge graph recommendation algorithm combining importance sampling and pooling aggregation[J].Journal of Chinese Computer Systems，2021，42（5）：967-971.
[51] CHANAA A，EL FADDOULI N E.Predicting learners need for recommendation using dynamic graph-based knowledge tracing[C]//International Conference on Artificial Intelligence in Education.Cham：Springer，2020：49-53.
[52] HU L M，LI C，SHI C，et al.Graph neural news recommendation with long-term and short-term interest modeling[J].Information Processing & Management，2020，57（2）：102-142.
[53] 李凡长，刘洋，吴鹏翔，等.元学习研究综述[J].计算机学报，2021，44（2）：422-446.
LI F C，LIU Y，WU P X，et al.A survey on recent advances in meta-learning[J].Chinese Journal of Computers，2021，44（2）：422-446.
[54] CHEN M，ZHANG W，ZHANG W，et al.Meta relational learning for few-shot link prediction in knowledge graphs[C]//Proceedings of the 2019 Conference on Empirical Methods in Natural Language Processing and the 9th International Joint Conference on Natural Language Processing，2019：4217-4226.
[55] 孙睿.基于多模态知识图谱的推荐系统[D].成都：电子科技大学，2021.
SUN R.Resommender system based on multi-modal knowledge graphs[D].Chengdu：University of Electronic Science and technology of China，2021.