Research on End-To-End Nested Named Entity Recognition Method

doi:10.3778/j.issn.1002-8331.2109-0498

Abstract

Abstract: Named entity recognition（NER） is regarded as a basic research in natural language processing. Inspired by the one-stage object detection algorithm in computer vision, this paper proposes an effective end-to-end method for identifying nested named entities by using its algorithm idea and introducing regression operation. Based on multi-task learning framework, the paper uses deep neural network to transform sentences into text feature graphs to regress nested entity boundaries, and designs centrality method to suppress low-quality boundaries. A comparative experiment is carried out with several methods on ACE2005 Chinese dataset. Experiments show that this method is effective in identifying nested named entities in text, and the computer vision algorithm idea and boundary regression mechanism achieve ideal results in natural language processing tasks.

Key words: nest named entities, regression operation, center score, end to end, multi-tasklearning

摘要： 命名实体识别（NER）被视为自然语言处理中的一项基础性研究任务。受计算机视觉中单阶段（one-stage）目标检测算法启发，借鉴其算法思想并引入回归运算，提出有效识别嵌套命名实体的端到端方法。基于多目标学习框架，利用深度神经网络将句子转换为文本特征图以回归预测嵌套实体边界，设计中心度方法抑制低质量边界。与多种方法在ACE2005中文数据集上进行对比实验。实验结果表明，该方法有效识别文本中的嵌套命名实体，且计算机视觉算法思想和边界回归机制在自然语言处理任务中取得理想的效果。

关键词: 嵌套命名实体, 回归运算, 中心度, 端到端, 多目标学习

DENG Liyuan, CHEN Yanpin, WU Yuefei, QIN Yongbin, HUANG Ruizhang, ZHENG Qinghua, TAN Xi. Research on End-To-End Nested Named Entity Recognition Method[J]. Computer Engineering and Applications, 2023, 59(7): 278-284.

邓力源, 陈艳平, 武乐飞, 秦永彬, 黄瑞章, 郑庆华, 谭曦. 端到端的嵌套命名实体识别方法研究[J]. 计算机工程与应用, 2023, 59(7): 278-284.

References

[1] MCCALLUM A，LI W.Early results for named entity recognition with conditional random fields，feature induction and web-enhanced lexicons[J].Association for Computational Linguistics，2003，4：188-191.
[2] HOCHREITER S，SCHMIDHUBER J.Long short-term memory[J].Neural Computation，1997，9（8）：1735-1780.
[3] DODDINGTON G R，MITCHELL A，PRZYBOCKI M A，et al.The automatic content extraction（ACE） program-tasks，data，and evaluation[J].Proceedings of LREC，2004，2（1）：837-840.
[4] ALEX B，HADDOW B，GROVER C.Recognising nested named entities in biomedical text[C]//Proceedings of Workshop on Biological，Translational，and Clinical Language Processing，2007：65-72.
[5] LU W，ROTH D.Joint mention extraction and classification with mention hypergraphs[C]//Proceedings of the 2015 Conference on Empirical Methods in Natural Language Processing，2015：857-867.
[6] WANG B，LU W，WANG Y，et al.A neural transition-based model for nested mention recognition[J].arXiv：1810.01808，2018.
[7] SOHRAB M G，MIWA M.Deep exhaustive model for nested named entity recognition[C]//Proceedings of the 2018 Conference on Empirical Methods in Natural Language Processing，2018：2843-2849.
[8] STRAKOVá J，STRAKA M，HAJI? J.Neural architectures for nested NER through linearization[J].arXiv：1908.06926，2019.
[9] ZHENG C，CAI Y，XU J，et al.A boundary-aware neural model for nested named entity recognition[C]//Proceedings of the 2019 Conference on Empirical Methods in Natural Language Processing and the 9th International Joint Conference on Natural Language Processing（EMNLP-IJCNLP），2019：357-366.
[10] SIMONYAN K，ZISSERMAN A.Very deep convolutional networks for large-scale image recognition[J].arXiv：1409.1556，2014.
[11] SZEGEDY C，LIU W，JIA Y，et al.Going deeper with convolutions[C]//Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition，2015：1-9.
[12] GIRSHICK R.Fast R-CNN[C]//Proceedings of the IEEE International Conference on Computer Vision，2015：1440-1448.
[13] ERHAN D，SZEGEDY C，TOSHEV A，et al.Scalable object detection using deep neural networks[C]//Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition，2014：2147-2154.
[14] REDMON J，DIVVALA S，GIRSHICK R，et al.You only look once：unified，real-time object detection[C]//Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition，2016：779-788.
[15] LIU W，ANGUELOV D，ERHAN D，et al.SSD：single shot multibox detector[C]//Proceedings of the European Conference on Computer Vision，2016：21-37.
[16] FINKEL J R，MANNING C D.Nested named entity recognition[C]//Proceedings of the 2009 Conference on Empirical Methods in Natural Language Processing，2009：141-150.
[17] FINKEL J R，MANNING C D.Joint parsing and named entity recognition[C]//Proceedings of Human Language Technologies：the 2009 Annual Conference of the North American Chapter of the Association for Computational Linguistics，2009：326-334.
[18] ZHANG X，LI D，WU X.Parsing named entity as syntactic structure[C]//Proceedings of the 15th Annual Conference of the International Speech Communication Association，2014.
[19] JIE Z，MUIS A，LU W.Efficient dependency-guided named entity recognition[C]//Proceedings of the AAAI Conference on Artificial Intelligence，2017：3457-3465.
[20] CHEN Y，ZHENG Q，CHEN P.A boundary assembling method for Chinese entity-mention recognition[J].IEEE Intelligent Systems，2015，30（6）：50-58.
[21] XU M，JIANG H.A FOFE-based local detection approach for named entity recognition and mention detection[J].arXiv：1611.00801，2016.
[22] JU M，MIWA M，ANANIADOU S.A neural layered model for nested named entity recognition[C]//Proceedings of the 2018 Conference of the North American Chapter of the Association for Computational Linguistics：Human Language Technologies，2018：1446-1459.
[23] LIN H，LU Y，HAN X，et al.Sequence-to-nuggets：nested entity mention detection via anchor-region networks[C]//Proceedings of the 57th Annual Meeting of the Association for Computational Linguistics，2019：5182-5192.
[24] LI F，ZHANG M，TIAN B，et al.Recognizing irregular entities in biomedical text via deep neural networks[J].Pattern Recognition Letters，2018，105：105-113.
[25] CHEN Y，WU L，DENG L，et al.A boundary regression model for nested named entity recognition[J].arXiv：2011.14330，2020.
[26] SIVIC J，ZISSERMAN A.Video Google：a text retrieval approach to object matching in videos[C]//Proceedings of the IEEE International Conference on Computer Vision，2003：1470-1470.
[27] ZHANG C，YANG Z，HE X，et al.Multimodal intelligence：representation learning，information fusion，and applications[J].IEEE Journal of Selected Topics in Signal Processing，2020，14（3）：478-493.
[28] HUANG Z，XU W，YU K.Bidirectional LSTM-CRF models for sequence tagging[J].arXiv：1508.01991，2015.