Research on Joint Extraction Method of Entity and Relation in Tourism Domain

doi:10.3778/j.issn.1002-8331.2112-0027

Abstract

Abstract: Extracting relational triples from textual information is a key task in building knowledge graphs, which has received wide attention from industry and academia in recent years. To address the problems of entity nesting and relation overlapping in the process of information extraction in tourism domain, a joint extraction model BAMRel based on the biaffine attention mechanism is proposed, which uses the biaffine attention mechanism to construct a classification matrix in the entity identification part and the relation extraction part by sharing the encoding layer, and fuses the entity type information in the relation extraction part to improve the relation extraction effect and it also increases the interaction between the two tasks. In addition, the relation extraction dataset TFRED in the tourism domain is constructed by distant supervision and manual verification, and the BAMRel model achieves an F1 value of 91.8% on this dataset, which effectively solves the entity nesting and relation overlapping problems. To verify the robustness of the model, a comparison experiment is conducted with the mainstream joint extraction model on the Baidu DuIE dataset, and the BAMRel model achieves the highest F1 value of 80.2%.

Key words: joint extraction, entity nesting, relation overlapping, knowledge graph, tourism domain

摘要： 从文本信息中抽取关系三元组是构建知识图谱的关键任务，近年来受到工业界和学术界的广泛关注。针对旅游领域信息抽取过程中出现的实体嵌套和关系重叠问题，提出了一种基于双仿射注意力机制的实体关系联合抽取模型BAMRel，该模型通过共享编码层参数利用双仿射注意力机制在实体识别部分和关系抽取部分构建分类矩阵，并在关系抽取部分融合实体类型信息，提升关系抽取效果的同时增加了两个任务之间的交互。此外，通过远程监督和人工校验构建了旅游领域关系抽取数据集TFRED，BAMRel模型在此数据集上F1值达到了91.8%，有效地解决了实体嵌套和关系重叠问题。为了验证模型的鲁棒性，在百度DuIE数据集上与主流联合抽取模型进行了对比实验，BAMRel模型取得了最高的F1值80.2%。

关键词: 联合抽取, 实体嵌套, 关系重叠, 知识图谱, 旅游领域

CHEN Yun, Gulila Adonbek, MA Yajing. Research on Joint Extraction Method of Entity and Relation in Tourism Domain[J]. Computer Engineering and Applications, 2022, 58(18): 284-296.

陈赟, 古丽拉·阿东别克, 马雅静. 旅游领域实体和关系联合抽取方法研究[J]. 计算机工程与应用, 2022, 58(18): 284-296.

References

[1] 黄恒琪，于娟，廖晓，等.知识图谱研究综述[J].计算机系统应用，2019，28（6）：1-12.
HUANG H Q，YU J，LIAO X，et al.Review on knowledge graphs[J].Computer Systems & Applications，2019，28（6）：1-12.
[2] SINGHAL A.Introducing the knowledge graph：things，not strings[J].Official Google Blog，2012，5：16.
[3] LUO L，YANG Z，YANG P，et al.An attention-based BiLSTM-CRF approach to document-level chemical named entity recognition[J].Bioinformatics，2018，34（8）：1381-1388.
[4] ZHENG S，WANG F，BAO H，et al.Joint extraction of entities and relations based on a novel tagging scheme[C]//Proceedings of the 55th Annual Meeting of the Association for Computational Linguistics （Volume 1：Long Papers），2017：1227-1236.
[5] DONG C，ZHANG J，ZONG C，et al.：Character-based LSTM-CRF with radical-level features for Chinese named entity recognition[J].Natural Language Understanding and Intelligent Applications，2016：239-250.
[6] DEVLIN J，CHANG M W，LEE K，et al.Bert：pre-training of deep bidirectional transformers for language understanding[C]//Proceedings of the 2019 Conference of the North American Chapter of the Association for Computational Linguistics：Human Language Technologies，Volume 1（Long and Short Papers），2019：4171-4186.
[7] CHANG Y，KONG L，JIA K，et al.Chinese named entity recognition method based on BERT[C]//2021 IEEE International Conference on Data Science and Computer Application（ICDSCA），2021：294-299.
[8] SUN C，YANG Z，WANG L，et al.Biomedical named entity recognition using BERT in the machine reading comprehension framework[J].Journal of Biomedical Informatics，2021，118：103799.
[9] BOUDJELLAL N，ZHANG H，KHAN A，et al.ABioNER：a BERT-based model for Arabic biomedical named-entity recognition[J].Complexity，2021：1-6.
[10] JIA L，LIU S，WEI F，et al.Nested named entity recognition via an independent-layered pretrained model[J].IEEE Access，2021，9：109693-109703.
[11] FU Y，TAN C，CHEN M，et al.Nested named entity recognition with partially-observed treecrfs[C]//Proceedings of the AAAI Conference on Artificial Intelligence，2021：2-9.
[12] SHEN Y，MA X，TAN Z，et al.Locate and label：a two-stage identifier for nested named entity recognition[C]//Proceedings of the 59th Annual Meeting of the Association for Computational Linguistics and the 11th International Joint Conference on Natural Language Processing（Volume 1：Long Papers），2021：2782-2794.
[13] LI X，FENG J，MENG Y，et al.A unified MRC framework for named entity recognition[C]//Proceedings of the 58th Annual Meeting of the Association for Computational Linguistics，2020：5849-5859.
[14] YU J，BOHNET B，POESIO M.Named entity recognition as dependency parsing[C]//Proceedings of the 58th Annual Meeting of the Association for Computational Linguistics，2020.
[15] LIN Y，SHEN S，LIU Z，et al.Neural relation extraction with selective attention over instances[C]//Proceedings of the 54th Annual Meeting of the Association for Computational Linguistics（Volume 1：Long Papers），2016：2124-2133.
[16] JI G，LIU K，HE S，et al.Distant supervision for relation extraction with sentence-level attention and entity descriptions[C]//Proceedings of the AAAI Conference on Artificial Intelligence，2017.
[17] CHRISTOU D，TSOUMAKAS G.Improving distantly-supervised relation extraction through bert-based label and instance embeddings[J].IEEE Access，2021，9：62574-62582.
[18] XIAO Y，JIN Y，CHENG R，et al.Hybrid attention-based transformer block model for distant supervision relation extraction[J].Neurocomputing，2022，470：29-39.
[19] FENG J，HUANG M，ZHAO L，et al.Reinforcement learning for relation classification from noisy data[C]//Proceedings of the AAAI Conference on Artificial Intelligence，2018.
[20] SOARES L B，FITZGERALD N，LING J，et al.Matching the blanks：distributional similarity for relation learning[C]//Proceedings of the 57th Annual Meeting of the Association for Computational Linguistics，2019：2895-2905.
[21] WANG H，TAN M，YU M，et al.Extracting multiple-relations in one-pass with pre-trained transformers[C]//Proceedings of the 57th Annual Meeting of the Association for Computational Linguistics，2019：1371-1377.
[22] KONG B，LIU S，WEI F，et al.Chinese relation extraction using extend softword[J].IEEE Access，2021，9：110299-110308.
[23] WANG G，LIU S，WEI F.Weighted graph convolution over dependency trees for nontaxonomic relation extraction on public opinion information[J].Applied Intelligence，2022，52（3）：3403-3417.
[24] KATE R，MOONEY R.Joint entity and relation extraction using card-pyramid parsing[C]//Proceedings of the Fourteenth Conference on Computational Natural Language Learning，2010：203-212.
[25] LI Q，JI H.Incremental joint extraction of entity mentions and relations[C]//Proceedings of the 52nd Annual Meeting of the Association for Computational Linguistics（Volume 1：Long Papers），2014：402-412.
[26] MIWA M，SASAKI Y.Modeling joint entity and relation extraction with table representation[C]//Proceedings of the 2014 Conference on Empirical Methods in Natural Language Processing（EMNLP），2014：1858-1869.
[27] YANG B，CARDIE C.Joint inference for fine-grained opinion extraction[C]//Proceedings of the 51st Annual Meeting of the Association for Computational Linguistics（Volume 1：Long Papers），2013：1640-1649.
[28] MIWA M，BANSAL M.End-to-end relation extraction using lstms on sequences and tree structures[C]//Proceedings of the 54th Annual Meeting of the Association for Computational Linguistics（Volume 1：Long Papers），2016：1105-1116.
[29] FU T J，LI P H，MA W Y.GraphRel：modeling text as relational graphs for joint entity and relation extraction[C]//Proceedings of the 57th Annual Meeting of the Association for Computational Linguistics，2019：1409-1418.
[30] FEI H，REN Y，JI D.Boundaries and edges rethinking：an end-to-end neural model for overlapping entity relation extraction[J].Information Processing & Management，2020，57（6）：102311.
[31] ZHAO K，XU H，CHENG Y，et al.Representation iterative fusion based on heterogeneous graph neural network for joint entity and relation extraction[J].Knowledge-Based Systems，2021，219：106888.
[32] LIU J，CHEN S，WANG B，et al.Attention as relation：learning supervised multi-head self-attention for relation extraction[C]//Proceedings of the Twenty-Ninth International Conference on Artificial Intelligence，2021：3787-3793.
[33] LAI T，CHENG L，WANG D，et al.RMAN：relational multi-head attention neural network for joint extraction of entities and relations[J].Applied Intelligence，2022，52（3）：3132-3142.
[34] GENG Z，ZHANG Y，HAN Y.Joint entity and relation extraction model based on rich semantics[J].Neurocomputing，2021，429：132-140.
[35] NGUYEN D Q，VERSPOOR K.End-to-end neural relation extraction using deep biaffine attention[C]//European Conference on Information Retrieval，2019：729-738.
[36] LI S，HE W，SHI Y，et al.Duie：a large-scale chinese dataset for information extraction[C]//CCF International Conference on Natural Language Processing and Chinese Computing，2019：791-800.
[37] BEKOULIS G，DELEU J，DEMEESTER T，et al.Joint entity recognition and relation extraction as a multi-head selection problem[J].Expert Systems with Applications，2018，114：34-45.
[38] WEI Z，SU J，WANG Y，et al.A novel cascade binary tagging framework for relational triple extraction[C]//Proceedings of the 58th Annual Meeting of the Association for Computational Linguistics，2020.
[39] ZENG D，ZHANG H，LIU Q.Copymtl：copy mechanism for joint extraction of entities and relations with multi-task learning[C]//Proceedings of the AAAI Conference on Artificial Intelligence，2020：9507-9514.
[40] NAYAK T，NG H T.Effective modeling of encoder-decoder architecture for joint entity and relation extraction[C]//Proceedings of the AAAI Conference on Artificial Intelligence，2020：8528-8535.
[41] ZHANG R H，LIU Q，FAN A X，et al.Minimize exposure bias of Seq2Seq models in joint entity and relation extraction[C]//Findings of the Association for Computational Linguistics（EMNLP 2020），2020：236-246.
[42] 陈仁杰，郑小盈，祝永新.融合实体类别信息的实体关系联合抽取[J].计算机工程，2022，48（3）：46-53.
CHEN R J，ZHENG X Y，ZHU Y X.Joint entity and relation extraction via fusing entity type information[J].Computer Engineering，2022，48（3）：46-53.