Research Progress of Knowledge Graph Completion Based on Knowledge Representation Learning

doi:10.3778/j.issn.1002-8331.2212-0119

Abstract

Abstract: A knowledge graph（KG） is a graph-based data structure in which knowledge is presented in the form of triples（head entities, relationships, tail entities）. With the development of artificial intelligence, knowledge graph has played an important role in intelligent system recommendation, question answering, knowledge search and so on. However, the constructed knowledge graph is incomplete, which affects the downstream task application of knowledge graph. Knowledge graph completion can solve this problem well. In recent years, knowledge graph completion method based on knowledge representation learning has become a research hotspot. It learns the embedded features of entities and relations in low-dimensional continuous vector space in the form of representation vector, aiming at predicting unknown factual information for knowledge graph completion. According to the different types of KG, firstly, it is divided into static knowledge graph completion, temporal knowledge graph completion and multimodal knowledge graph completion. Secondly, the key problems, design ideas, model evaluation and other aspects intended to be solved by these three knowledge graph completion methods are compared and summarized. Finally, the future development direction of knowledge graph completion is prospected to provide references for researchers in related fields.

Key words: knowledge graph, knowledge graph completion, knowledge representation learning

摘要： 知识图谱（KG）是一种基于图的数据结构，其知识是以三元组的形式呈现，即（头实体，关系，尾实体）。随着人工智能的发展，知识图谱已在系统推荐、智能问答、知识搜索等领域发挥了重要作用。然而构建的知识图谱具有不完整性，影响了知识图谱的下游任务应用，知识图谱补全能够很好地解决这一问题。近年来，基于知识表示学习的知识图谱补全方法成为研究的热点，其以表示向量的形式在低维连续向量空间中学习实体和关系的嵌入特征，旨在预测未知的事实信息进行知识图谱补全。根据KG类型的不同，将其分为静态知识图谱补全、时序知识图谱补全以及多模态知识图谱补全，对这三类知识图谱补全方法拟解决的关键问题、设计思路、模型评价等方面进行对比总结，展望知识图谱补全未来的发展方向，为相关领域的研究人员提供参考。

关键词: 知识图谱, 知识图谱补全, 知识表示学习

YU Mengbo, DU Jianqiang, LUO Jigen, NIE Bin, LIU Yong, QIU Junyang. Research Progress of Knowledge Graph Completion Based on Knowledge Representation Learning[J]. Computer Engineering and Applications, 2023, 59(18): 59-73.

于梦波, 杜建强, 罗计根, 聂斌, 刘勇, 邱俊洋. 基于知识表示学习的知识图谱补全研究进展[J]. 计算机工程与应用, 2023, 59(18): 59-73.

References

[1] CHEN D，ZHAO H.Research on the method of extracting domain knowledge from the freebase RDF dumps[J].IEEE Access，2018，6：50306-50322.
[2] BOI?SKI T，SZYMA?SKI J，DUDEK B，et al.NLP questions answering using DBpedia and YAGO[J].Vietnam Journal of Computer Science，2020，7（4）.
[3] FREIRE N，ROBSON G，HOWARD J B，et al.Cultural heritage metadata aggregation using web technologies：IIIF，Sitemaps and Schema.org[J].International Journal on Digital Libraries，2020，21（1）：19-30.
[4] 张明星，张骁雄，刘姗姗，等.利用知识图谱的推荐系统研究综述[J].计算机工程与应用，2023，59（4）：30-42.
ZHANG M X，ZHANG X X，LIU S S，et al.Review of recommendation systems using knowledge graph[J].Computer Engineering and Applications，2023，59（4）：30-42.
[5] 王智悦，于清，王楠，等.基于知识图谱的智能问答研究综述[J].计算机工程与应用，2020，56（23）：1-11.
WANG Z Y，YU Q，WANG N，et al.Survey of intelligent question answering research based on knowledge graph[J].Computer Engineering and Applications，2020，56（23）：1-11.
[6] NGUYEN D Q，NGUYEN T N，PHUNG D.A relational memory-based embedding model for triple classification and search personalization[C]//Proceedings of the 58th Annual Meeting of the Association for Computational Linguistics（ACL），2020：3429-3435.
[7] 李端阳.基于表示学习的知识图谱补全技术研究[D].郑州：郑州轻工业大学，2022.
LI D Y.Research on knowledge graph completion technology based on representation learning[D].Zhengzhou：Zhengzhou University of Light Industry，2022.
[8] HILMAN D，?ERBAN O.A unified link prediction architecture applied on a novel heterogenous knowledge base[J].Knowledge-Based Systems，2022，241：108228.
[9] BORDES A，USUNIER N，GARCIA-DURAN A，et al.Translating embeddings for modeling multi-relational data[C]//Advances in Neural Information Processing Systems，2013.
[10] WANG Z，ZHANG J，FENG J，et al.Knowledge graph embedding by translating on hyperplanes[C]//Proceedings of the AAAI Conference on Artificial Intelligence，2014.
[11] LIN Y，LIU Z，SUN M，et al.Learning entity and relation embeddings for knowledge graph completion[C]//Proceedings of the AAAI Conference on Artificial Intelligence，2015.
[12] JI G，HE S，XU L，et al.Knowledge graph embedding via dynamic mapping matrix[C]//Proceedings of the 53rd Annual Meeting of the Association for Computational Linguistics and the 7th International Joint Conference on Natural Language Processing（volume 1：long papers），2015：687-696.
[13] FAN M，ZHOU Q，CHANG E，et al.Transition-based knowledge graph embedding with relational mapping properties[C]//Proceedings of the 28th Pacific Asia Conference on Language，Information and Computing，2014：328-337.
[14] XIAO H，HUANG M，ZHU X.From one point to a manifold：knowledge graph embedding for precise link prediction[J].arXiv：1512.04792，2015.
[15] 陈晓军，向阳.STransH：一种改进的基于翻译模型的知识表示模型[J].计算机科学，2019，46（9）：184-189.
CHEN X J，XIANG Y.STransH：a revised knowledge translation-based model for knowledge representaion[J].Journal of Computer Science，2019，46（9）：184-189.
[16] ZHU Q，ZHOU X，ZHANG P，et al.A neural translating general hyperplane for knowledge graph embedding[J].Journal of Computational Science，2019，30：108-117.
[17] SUN Z，DENG Z H，NIE J Y，et al.Rotate：knowledge graph embedding by relational rotation in complex space[J].arXiv：1902.10197，2019.
[18] XIAO H，HUANG M，HAO Y，et al.TransG：a generative mixture model for knowledge graph embedding[J].arXiv：1509.05488，2015.
[19] FENG J，HUANG M，WANG M，et al.Knowledge graph embedding by flexible translation[C]//Proceedings of the Fifteenth International Conference on Principles of Knowledge Representation and Reasoning，2016：557-560.
[20] XIAO H，HUANG M，HAO Y，et al.TransA：an adaptive approach for knowledge graph embedding[J].arXiv：1509.
05490，2015.
[21] JI G，LIU K，HE S，et al.Knowledge graph completion with adaptive sparse transfer matrix[C]//Proceedings of the AAAI Conference on Artificial Intelligence，2016.
[22] QIAN W，FU C，ZHU Y，et al.Translating embeddings for knowledge graph completion with relation attention mechanism[C]//27th International Joint Conference on Artificial Intelligence，2018：4286-4292.
[23] YANG S，TIAN J，ZHANG H，et al.TransMS：knowledge graph embedding for complex relations by multidirectional semantics[C]//28th International Joint Conference on Artificial Intelligence，2019：1935-1942.
[24] REN F，LI J，ZHANG H，et al.TransP：a new knowledge graph embedding model by translating on positions[C]//2020 IEEE International Conference on Knowledge Graph（ICKG），2020：344-351.
[25] ZHANG S，TAY Y，YAO L，et al.Quaternion knowledge graph embeddings[C]//Advances in Neural Information Processing Systems，2019.
[26] CHEN H，WANG W，LI G，et al.A quaternion-embedded capsule network model for knowledge graph completion[J].IEEE Access，2020，8：100890-100904.
[27] BALAZEVIC I，ALLEN C，HOSPEDALES T.Multi-relational poincaré graph embeddings[C]//Advances in Neural Information Processing Systems，2019.
[28] ZHANG Z，CAI J，ZHANG Y，et al.Learning hierarchy-aware knowledge graph embeddings for link prediction[C]//Proceedings of the AAAI Conference on Artificial Intelligence，2020：3065-3072.
[29] XU C，LI R.Relation embedding with dihedral group in knowledge graph[J].arXiv：1906.00687，2019.
[30] HUANG X，TANG J，TAN Z，et al.Knowledge graph embedding by relational and entity rotation[J].Knowledge-Based Systems，2021，229：107310.
[31] 陈恒，祁瑞华，朱毅，等.球坐标建模语义分层的知识图谱补全方法[J].计算机工程与应用，2021，57（15）：101-108.
CHEN H，QI R H，ZHU Y，et al.Knowledge graph completion method for semantic hierarchies of spherical coordinate modeling[J].Computer Engineering and Applications，2021，57（15）：101-108.
[32] RIEDEL S，YAO L，MCCALLUM A，et al.Relation extraction with matrix factorization and universal schemas[C]//Proceedings of the 2013 Conference of the North American Chapter of the Association for Computational Linguistics：Human Language Technologies，2013：74-84.
[33] KAZEMI S M，POOLE D.Simple embedding for link prediction in knowledge graphs[C]//Advances in Neural Information Processing Systems，2018.
[34] HALIASSOS A，KONSTANTINIDIS K，MANDIC D P.Supervised learning for nonsequential data：a canonical polyadic decomposition approach[J].IEEE Transactions on Neural Networks and Learning Systems，2021，33（10）：5162-5176.
[35] YANG B，YIH W，HE X，et al.Embedding entities and relations for learning and inference in knowledge bases[J].arXiv：1412.6575，2014.
[36] TROUILLON T，WELBL J，RIEDEL S，et al.Complex embeddings for simple link prediction[C]//International Conference on Machine Learning，2016：2071-2080.
[37] BALA?EVI? I，ALLEN C，HOSPEDALES T M.Tucker：tensor factorization for knowledge graph completion[J].arXiv：1901.09590，2019.
[38] KOLDA T G，BADER B W.Tensor decompositions and applications[J].SIAM Review，2009，51（3）：455-500.
[39] NICKEL M，ROSASCO L，POGGIO T.Holographic embeddings of knowledge graphs[C]//Proceedings of the AAAI Conference on Artificial Intelligence，2016.
[40] GARCíA-DURáN A，BORDES A，USUNIER N.Effective blending of two and three-way interactions for modeling multi-relational data[C]//European Conference on Machine Learning and Knowledge Discovery in Databases（ECML PKDD 2014），Nancy，France，September 15-19，2014：434-449.
[41] BORDES A，GLOROT X，WESTON J，et al.A semantic matching energy function for learning with multi-relational data：application to word-sense disambiguation[J].Machine Learning，2014，94：233-259.
[42] LIU H，WU Y，YANG Y.Analogical inference for multi-relational embeddings[C]//International Conference on Machine Learning，2017：2168-2178.
[43] LIU Q，JIANG H，EVDOKIMOV A，et al.Probabilistic reasoning via deep learning：Neural association models[J].arXiv：1603.07704，2016.
[44] DETTMERS T，MINERVINI P，STENETORP P，et al.Convolutional 2d knowledge graph embeddings[C]//Proceedings of the AAAI Conference on Artificial Intelligence，2018.
[45] BALA?EVI? I，ALLEN C，HOSPEDALES T M.Hypernetwork knowledge graph embeddings[C]//Artificial Neural Networks and Machine Learning-ICANN 2019：Workshop and Special Sessions：28th International Conference on Artificial Neural Networks，Munich，Germany，September 17-19，2019：553-565.
[46] VU T，NGUYEN T D，NGUYEN D Q，et al.A capsule network-based embedding model for knowledge graph completion and search personalization[C]//Proceedings of the 2019 Conference of the North American Chapter of the Association for Computational Linguistics：Human Language Technologies（Volume 1：Long and Short Papers），2019：2180-2189.
[47] JIANG X，WANG Q，WANG B.Adaptive convolution for multi-relational learning[C]//Proceedings of the 2019 Conference of the North American Chapter of the Association for Computational Linguistics：Human Language Technologies（Volume 1：Long and Short Papers），2019：978-987.
[48] VASHISHTH S，SANYAL S，NITIN V，et al.Interacte：improving convolution-based knowledge graph embeddings by increasing feature interactions[C]//Proceedings of the AAAI Conference on Artificial Intelligence，2020：3009-3016.
[49] XIE Z，ZHOU G，LIU J，et al.ReInceptionE：relation-aware inception network with joint local-global structural information for knowledge graph embedding[C]//Proceedings of the 58th Annual Meeting of the Association for Computational Linguistics，2020：5929-5939.
[50] DASGUPTA S S，RAY S N，TALUKDAR P.Hyte：Hyperplane-based temporally aware knowledge graph embedding[C]//Proceedings of the 2018 Conference on Empirical Methods in Natural Language Processing，2018：2001-2011.
[51] GARCíA-DURáN A，DUMAN?I? S，NIEPERT M.Learning sequence encoders for temporal knowledge graph completion[J].arXiv：1809.03202，2018.
[52] GOEL R，KAZEMI S M，BRUBAKER M，et al.Diachronic embedding for temporal knowledge graph completion[C]//Proceedings of the AAAI Conference on Artificial Intelligence，2020：3988-3995.
[53] XU Y，SUN S，ZHANG H，et al.Time-aware graph embedding：a temporal smoothness and task-oriented approach[J].ACM Transactions on Knowledge Discovery from Data（TKDD），2021，16（3）：1-23.
[54] SADEGHIAN A，ARMANDPOUR M，COLAS A，et al.ChronoR：rotation based temporal knowledge graph embedding[C]//Proceedings of the AAAI Conference on Artificial Intelligence，2021：6471-6479.
[55] LIN L，SHE K.Tensor decomposition-based temporal knowledge graph embedding[C]//2020 IEEE 32nd International Conference on Tools with Artificial Intelligence（ICTAI），2020.
[56] XU C，CHEN Y Y，NAYYERI M，et al.Temporal knowledge graph completion using a linear temporal regularizer and multivector embeddings[C]//Proceedings of the 2021 Conference of the North American Chapter of the Association for Computational Linguistics：Human Language Technologies，2021：2569-2578.
[57] SHAO P，ZHANG D，YANG G，et al.Tucker decomposition-based temporal knowledge graph completion[J].Knowledge-Based Systems，2022，238：107841.
[58] MA Y，TRESP V，DAXBERGER E A.Embedding models for episodic knowledge graphs[J].Journal of Web Semantics，2019，59：100490.
[59] TRIVEDI R，DAI H，WANG Y，et al.Know-evolve：deep temporal reasoning for dynamic knowledge graphs[C]//International Conference on Machine Learning，2017：3462-3471.
[60] JIN W，QU M，JIN X，et al.Recurrent event network：autoregressive structure inference over temporal knowledge graphs[J].arXiv：1904.05530，2019.
[61] ZHU C，CHEN M，FAN C，et al.Learning from history：modeling temporal knowledge graphs with sequential copy-generation networks[C]//Proceedings of the AAAI Conference on Artificial Intelligence，2021：4732-4740.
[62] LI Z，JIN X，LI W，et al.Temporal knowledge graph reasoning based on evolutional representation learning[C]//Proceedings of the 44th International ACM SIGIR Conference on Research and Development in Information Retrieval，2021：408-417.
[63] SUN R，CAO X，ZHAO Y，et al.Multi-modal knowledge graphs for recommender systems[C]//Proceedings of the 29th ACM International Conference on Information & Knowledge Management，2020：1405-1414.
[64] XIE R，LIU Z，LUAN H，et al.Image-embodied knowledge representation learning[J].arXiv：1609.07028，2016.
[65] XIE R，LIU Z，JIA J，et al.Representation learning of knowledge graphs with entity descriptions[C]//Proceedings of the AAAI Conference on Artificial Intelligence，2016.
[66] MOUSSELLY-SERGIEH H，BOTSCHEN T，GUREVYCH I，et al.A multimodal translation-based approach for knowledge graph representation learning[C]//Proceedings of the Seventh Joint Conference on Lexical and Computational Semantics，2018：225-234.
[67] PEZESHKPOUR P，CHEN L，SINGH S.Embedding multimodal relational data for knowledge base completion[C]//Proceedings of the 2018 Conference on Empirical Methods in Natural Language Processing，2018：3208-3218.
[68] WANG Z，LI L，LI Q，et al.Multimodal data enhanced representation learning for knowledge graphs[C]//2019 International Joint Conference on Neural Networks（IJCNN），2019：1-8.
[69] WANG M，WANG S，YANG H，et al.Is visual context really helpful for knowledge graph? A representation learning perspective[C]//Proceedings of the 29th ACM International Conference on Multimedia，2021：2735-2743.
[70] ZHAO Y，CAI X，WU Y，et al.MoSE：modality split and ensemble for multimodal knowledge graph completion[J].arXiv：2210.08821，2022.
[71] CHEN X，ZHANG N，LI L，et al.Hybrid transformer with multi-level fusion for multimodal knowledge graph completion[C]//Proceedings of the 45th International ACM SIGIR Conference on Research and Development in Information Retrieval，2022：904-915.
[72] LEBLAY J，CHEKOL M W.Deriving validity time in knowledge graph[C]//Companion Proceedings of the the Web Conference 2018，2018：1771-1776.
[73] LEETARU K，SCHRODT P A.Gdelt：global data on events，location，and tone，1979-2012[C]//ISA Annual Convention，2013：1-49.
[74] J?GER K.The limits of studying networks via event data：evidence from the ICEWS dataset[J].Journal of Global Security Studies，2018，3（4）：498-511.
[75] LIN Q，MAO R，LIU J，et al.Fusing topology contexts and logical rules in language models for knowledge graph completion[J].Information Fusion，2023，90：253-264.
[76] CHEN X，CHEN M，SHI W，et al.Embedding uncertain knowledge graphs[C]//Proceedings of the AAAI Conference on Artificial Intelligence，2019：3363-3370.
[77] YANG Z，DING M，ZHOU C，et al.Understanding negative sampling in graph representation learning[C]//Proceedings of the 26th ACM SIGKDD International Conference on Knowledge Discovery & Data Mining，2020：1666-1676.
[78] NIU G，ZHANG Y，LI B，et al.Rule-guided compositional representation learning on knowledge graphs[C]//Proceedings of the AAAI Conference on Artificial Intelligence，2020：2950-2958.
[79] CHENG J，ZHANG F，YANG Z.Knowledge graph representation learning with multi-scale capsule-based embedding model incorporating entity descriptions[J].IEEE Access，2020，8：203028-203038.
[80] ZHANG Z，CAO L，CHEN X，et al.Representation learning of knowledge graphs with entity attributes[J].IEEE Access，2020，8：7435-7441.
[81] MIRTAHERI M，ROSTAMI M，REN X，et al.One-shot learning for temporal knowledge graphs[J].arXiv：2010.
12144，2020.