Chinese Named Entity Recognition Methods Combined with Entity Boundary Cues

doi:10.3778/j.issn.1002-8331.2211-0119

Abstract

Abstract: As a basic task in information extraction, named entity recognition (NER) can provide effective support for machine translation, relation extraction and other downstream tasks, and is of great research significance. To tackle the problem of fuzzy entity boundary in Chinese named entity recognition methods, a named entity recognition model combining entity boundary cue is proposed. The model is composed of three modules：boundary detection, cue generation and entity classification. Firstly, the entity boundary detection module is used to identify the entity boundary. Then, the entity span is generated according to the boundary information in the cue generation module, and the text sequence with the boundary cue label is obtained. Through the boundary cue label, the model can perceive the entity boundary in the sentence, and learn the semantic dependence characteristics of the entity boundary and context. Finally, the text sequence with boundary cue tags is employed as the input of entity classification module, and the semantic interaction between tags is enhanced by the Biaffine mechanism, then combined with the joint prediction of multilayer perceptron and Biaffine mechanism as the result of entity recognition. The F1 values of this model on ACE2005 Chinese dataset and Weibo dataset reaches 90.47% and 73.54% respectively, which verifies the effectiveness of the model for Chinese named entity recognition.

Key words: Chinese named entity identification, nested named entity recognition, cue tags, boundary detection

摘要： 命名实体识别作为信息抽取领域的一个基础任务，能为机器翻译、关系抽取等下游任务提供有效支撑，具有重要的研究意义。针对中文命名实体识别方法中存在的实体边界模糊的问题，提出了一种结合实体边界线索的命名实体识别模型，模型由边界检测、线索生成、实体分类三个模块组成。利用边界检测模块识别实体边界。在线索生成模块中依据边界信息生成实体跨度，得到带边界线索标签的文本序列，使模型通过边界线索标签感知句子中的实体边界，学习实体边界和上下文的语义依赖特征。将带有边界线索标签的文本序列作为实体分类模块的输入，使用双仿射机制增强标签之间的语义交互，并结合双仿射机制与多层感知机的共同预测作为实体识别的结果。该模型在ACE2005中文数据集和Weibo数据集上的F1值分别达到了90.47%和73.54%，验证了模型对中文命名实体识别的有效性。

关键词: 命名实体识别, 嵌套命名实体识别, 线索标签, 边界检测

HUANG Rong, CHEN Yanping, HU Ying, HUANG Ruizhang, QIN Yongbin. Chinese Named Entity Recognition Methods Combined with Entity Boundary Cues[J]. Computer Engineering and Applications, 2024, 60(6): 199-206.

黄蓉, 陈艳平, 扈应, 黄瑞章, 秦永彬. 结合实体边界线索的中文命名实体识别方法[J]. 计算机工程与应用, 2024, 60(6): 199-206.

References

[1] 邓依依, 邬昌兴, 魏永丰, 等. 基于深度学习的命名实体识别综述[J]. 中文信息学报, 2021, 35(9): 30-45.
DENG Y Y, WU C X, WEI Y F, et al. A survey on named entity recognition based on deep learning[J]. Journal of Chinese Information Processing, 2021, 35(9): 30-45.
[2] 赵山, 罗睿, 蔡志平. 中文命名实体识别综述[J]. 计算机科学与探索, 2022, 16(2): 296-304.
ZHAO S, LUO R, CAI Z P. Survey of Chinese named entity recognition[J]. Journal of Frontiers of Computer Science and Technology, 2022, 16(2): 296-304.
[3] 余诗媛, 郭淑明, 黄瑞阳, 等. 嵌套命名实体识别研究进展[J]. 计算机科学, 2021, 48(11A): 1-10.
YU S Y, GUO S M, HUANG R Y, et al. Overview of nested named entity recognition[J]. Computer Science, 2021, 48(11A): 1-10.
[4] CHEN Y, WU Y, QIN Y, et al. Recognizing nested named entity based on the neural network boundary assembling model[J]. IEEE Intelligent Systems, 2019, 35(1): 74-81.
[5] CHEN C, KONG F. Enhancing entity boundary detection for better Chinese named entity recognition[C]//Proceedings of the 59th Annual Meeting of the Association for Computational Linguistics and the 11th International Joint Conference on Natural Language Processing, 2021: 20-25.
[6] TAN C, QIU W, CHEN M, et al. Boundary enhanced neural span classification for nested named entity recognition[C]//Proceedings of the AAAI Conference on Artificial Intelligence, 2020: 9016-9023.
[7] 李冬梅, 罗斯斯, 张小平, 等. 命名实体识别方法研究综述[J]. 计算机科学与探索, 2022, 16(9): 1954-1968.
LI D M, LUO S S, ZHANG X P, et al. Review on named entity recognition[J]. Journal of Frontiers of Computer Science and Technology, 2022, 16(9): 1954-1968.
[8] MORWAL S, JAHAN N, CHOPRA D. Named entity recognition using hidden Markov model (HMM)[J]. International Journal on Natural Language Computing, 2012, 1(4): 15-23.
[9] ZHENG Q S, LIU S X. Research of web text named entity recognition based on CRF[J]. Journal of Zhongyuan University of Technology, 2016: 70-73.
[10] CUCERZEN S, YAROWSKY D. Language independent named entity recognition combining morphological and contextual evidence[C]//1999 Joint SIGDAT Conference on Empirical Methods in Natural Language Processing and Very Large Corpora, 1999.
[11] COLLOBERT R, WESTON J, BOTTOU L, et al. Natural language processing (almost) from scratch[J]. Journal of Machine Learning Research, 2011, 12(12): 2493-2537.
[12] HUNANG Z, WEI X, KAI Y. Bidirectional LSTM-CRF models for sequence tagging[J]. arXiv:1508.01991, 2015.
[13] CHIU J, NICHOLS E. Named entity recognition with bidirectional LSTM-CNNs[J]. Transactions of the Association for Computational Linguistics, 2016, 4: 357-370.
[14] MA X, HOVY E. End-to-end sequence labeling via bi-directional LSTM-CNNs-CRF[C]//Proceedings of the 54th Annual Meeting of the Association for Computational Linguistics, 2016: 1064-1074.
[15] ZHANG Y, YANG J. Chinese NER using lattice LSTM[C]//Proceedings of the 56th Annual Meeting of the Association for Computational Linguistics, 2018: 1554-1564.
[16] MA R, PENG M, ZHANG Q, et al. Simplify the usage of lexicon in Chinese NER[C]//Proceedings of the 58th Annual Meeting of the Association for Computational Linguistics, 2020: 5951-5960.
[17] JU M, MIWA M, ANANIADOU S. A neural layered model for nested named entity recognition[C]//Proceedings of the 2018 Conference of the North American Chapter of the Association for Computational Linguistics: Human Language Technologies, 2018: 1446-1459.
[18] WANG J, SHOU L, CHEN K, et al. Pyramid: a layered model for nested named entity recognition[C]//Proceedings of the 58th Annual Meeting of the Association for Computational Linguistics, 2020: 5918-5928.
[19] SOHRAB M G, MIWA M. Deep exhaustive model for nested named entity recognition[C]//Proceedings of the 2018 Conference on Empirical Methods in Natural Language Processing, 2018: 2843-2849.
[20] XU M, JIANG H, WATCHARAWITTAYAKUL S. A FOFE-based local detection approach for named entity recognition and mention detection[C]//Proceedings of the 55th Annual Meeting of the Association for Computational Linguistics, Canada, 2017: 1237-1247.
[21] XIA C, ZHANG C, YANG T, et al. Multi-grained named entity recognition[C]//57th Annual Meeting of the Association for Computational Linguistics, Italy, Jul, 2019: 1430-1440.
[22] LI J, FEI H, LIU J, et al. Unified named entity recognition as word-word relation classification[C]//Proceedings of the AAAI Conference on Artificial Intelligence, 2022: 10965-10973.
[23] ZHENG C, CAI Y, XU J, et al. A boundary-aware neural model for nested named entity recognition[C]//Proceedings of the 2019 Conference on Empirical Methods in Natural Language Processing and the 9th International Joint Conference on Natural Language Processing. Association for Computational Linguistics, 2019.
[24] SHEN Y, MA X, TAN Z, et al. Locate and label: a two-stage identifier for nested named entity recognition[C]//Proceedings of the 59th Annual Meeting of the Association for Computational Linguistics and the 11th International Joint Conference on Natural Language Processing, 2021: 2782-2794.
[25] DEVLIN J, CHANG M W, LEE K, et al. BERT: pre-training of deep bidirectional transformers for language understanding[C]//Proceedings of the 2019 Conference of the North American Chapter of the Association for Computational Linguistics: Human Language Technologies, Minnesota, Jun 2019: 4171-4186.
[26] VASWANI A, SHAZEER N, PARMAR N, et al. Attention is all you need[C]//Proceedings of the 31st International Conference on Neural Information Processing Systems, 2017: 6000-6010.