Research and Application of Named Entity Recognition for Bidding Materials

doi:10.3778/j.issn.1002-8331.2108-0118

Abstract

Abstract: In the bidding field, each unit has different writing methods for the material data. Through the entity identification of the material data, the standardization of the material data can be realized, which provides a basis for the subsequent material inquiry and analysis. The traditional identification method of named entity of materials has some problems, such as inaccurate word segmentation, unable to deal with polysemy effectively, and failing to consider the unique character characteristics of Chinese characters, which affect the recognition effect. In view of the above problems, a CB-BILSTM-CRF model is proposed, which uses CNN to extract the Wubi encoding of Chinese characters, and combines it with the character features obtained by BERT to enhance the representation ability of grammatical and semantic information in different contexts. The BiLSTM model is used to extract and process the combined features in a deep level. The CRF model obtains the optimal sequence results. The experimental results show that the F1 value of the material data collected by this model reaches 95.82%, which is better than other common models. At the same time, the “intelligent material” online identification web platform is built on this basis, so that users can quickly extract effective information from a large amount of data.

Key words: name entity recognition, bidding material identification, BERT, bi-directional long-short term memory（BiLSTM）, conditional random field（CRF）

摘要： 招标领域中各单位对物料数据的书写方法各不相同，通过对物料数据的实体识别能够实现对物料数据的标准化，为后续的物料查询及分析提供基础。传统的物料命名实体识别方法存在分词不准确，无法有效地处理一词多义，没有考虑中文特有的字形特征等问题，从而影响识别效果。针对上述问题，提出了一种CB-BiLSTM-CRF模型，采用卷积神经网络对汉字的五笔编码进行提取，与BERT所获得的字符特征相结合，以增强不同语境中的语法和语义信息的表征能力，通过BiLSTM模型对组合特征进行深层次提取处理，CRF模型获得最优序列结果。实验结果表明，该模型在收集到的招标领域中物料数据的F1值达到95.82%，优于其他常用模型。同时，在此基础上搭建了“智能物料”在线识别网页平台，用户可以快速在大量数据中提取到有效信息。

关键词: 命名实体识别, 招标物料识别, BERT预训练模型, 双向长短期记忆网络, 条件随机场

MI Jianxia, XIE Hongwei. Research and Application of Named Entity Recognition for Bidding Materials[J]. Computer Engineering and Applications, 2023, 59(2): 314-320.

米健霞, 谢红薇. 面向招标物料的命名实体识别研究及应用[J]. 计算机工程与应用, 2023, 59(2): 314-320.

References

[1] MCCALLUM A，FREITAG D，PEREIRA F.Maximum entropy Markov models for information extraction and segmentation[C]//Proceedings of 17th International Conf on Machine Learning，2000：591-598.
[2] LAFFERTY J，MCCALLUM A，PEREIRA F.Conditional random fields：probabilistic models for segmenting and labeling sequence data[C]//Proceedings of 17th International Conf on Machine Learning.San Francisco：Morgan Kaufmann Publishers，2001：282-289.
[3] 于江德，樊孝忠，尹继豪.隐马尔可夫模型在自然语言处理中的应用[J].计算机工程与设计，2007，28（22）：5514-5516.
YU J D，FAN X Z，YIN J H.Application of hidden Markov model in natural language processing[J].Computer Engineering and Design，2007，28（22）：5514-5516.
[4] KALCHBRENNER N，GREFENSTETTE E，BLUNSOM P.A convolutional neural network for modelling sentences[C]//Proceedings of the Association for Computational Linguistics（ACL），2014：655-665.
[5] LAMPLE G，BALLESTEROS M，SUBRAMANIAN S，et al.Neural architectures for named entity recognition[C]//Proceedings of NAACL-HLT，2016：260-270.
[6] ZHU X，SOBIHANI P，GUO H.Long short-term memory over recursive structures[C]//Proceedings of the 32nd International Conference on Machine Learning（LCML-15）， 2015：1604-1612.
[7] HUANG Z，WEI X，KAI Y.Bidirectional LSTM-CRF models for sequence tagging[J].arXiv：1508.01991，2015.
[8] 梅丰，孙承杰，孙珂，等.面向网络文本的中文产品命名实体识别[J].郑州大学学报（理学版），2010，42（1）：62-66.
MEI F，SUN C J，SUN K，et al.Web oriented Chinese pro-
duct named entity recognition[J].Journal of Zhengzhou University（Natural Science Edition），2010，42（1）：62-66.
[9] 刘非凡，赵军，吕碧波，等.面向商务信息抽取的产品命名实体识别研究[J].中文信息学报，2006（1）：7-13.
LIU F F，ZHAO J，LYU B B，et al.Study on product named entity recognition for business information extraction[J].Journal of Chinese Information Processing，2006（1）：7-13.
[10] 谷川，周宏宇，于江德.融合多特征的中文产品命名实体识别[J].科学技术与工程，2013，13（31）：9417-9421.
GU C，ZHOU H Y，YU J D.Fusion of multiple features for Chinese product named entity recognition[J].Science Technology and Engineering，2013，13（31）：9417-9421.
[11] 蒋超.研报领域的产品词命名实体识别的研究[D].南宁：广西大学，2017.
JIANG C.Research on named entity recognition of product words in the field of research and report[D].Nanning：Guangxi University，2017.
[12] 李博，康晓东，张华丽，等.采用Transformer-CRF的中文电子病历命名实体识别[J].计算机工程与应用，2020，56（5）：153-159.
LI B，KANG X D，ZHANG H L，et al.Named entity recognition in Chinese electronic medical records using Transformer-CRF[J].Computer Engineering and Applications，2020，56（5）：153-159.
[13] 买买提阿依甫，吾守尔·斯拉木，帕丽旦·木合塔尔，等.基于BiLSTM-CNN-CRF模型的维吾尔文命名实体识别[J].计算机工程，2018，4408）：230-236.
MAIMAITAIFU，URSHUL S，PALIDAN M，et al.Uyghur named entity recognition based on BILSTM-CNN-CRF model[J].Computer Engineering，2018，44（8）：230-236.
[14] 李一斌，张欢欢.基于双向GRU-CRF的中文包装产品实体识别[J].华东理工大学学报（自然科学版），2019，45（3）：486-490.
LI Y B，ZHANG H H.Chinese packaging product entity recognition based on bidirectional GRU-CRF[J].Journal of East China University of Science and Technology（Natural Science Edition），2019，45（3）：486-490.
[15] 张应成，杨洋，蒋瑞，等.基于BiLSTM-CRF的商情实体识别模型[J].计算机工程，2019，45（5）：308-314.
ZHANG Y C，YANG Y，JIANG R，et al.Business situation entity recognition model based on BILSTM-CRF[J].Computer Engineering，2019，45（5）：308-314.
[16] 唐焕玲，王慧，隗昊，等.面向时钟领域的BERT-LCRF命名实体识别方法[J].计算机工程与应用，2022，58（18）：218-226.
TANG H L，WANG H，WEI H，et al.BERT-LCRF named entity recognition method oriented clock domain[J].Computer Engineering and Applications，2022，58（18）：218-226.
[17] DONG C，ZHANG J，ZONG C，et al.Character-based LSTM-CRF with radical-level features for Chinese named entity recognition[M]//Natural language understanding and intelligent applications.[S.l.]：Springer International Publishing，2016.
[18] 赵健，冯乔生，何娟娟.面向汉字识别的新特征及其提取方法[J].软件，2015，36（3）：31-36.
ZHAO J，FENG Q S，HE J J.New feature extraction method for Chinese character recognition[J].Software，2015，36（3）：31-36.
[19] DAI F Z，CAI Z.Glyph-aware embedding of chinese characters[C]//Proceedings of the First Workshop on Subword and Character Level Models in NLP，2017：64-69.
[20] DEVLIN J，CHANG M W，LEE K，et al.BERT：pretraining of deep bidirectional transformers for language understanding[C]//Proceedings of NAACL-HLT，2019：4171-4186.

[21] HOCHREITER S，SCHMIDHUBER J.Long short-term memory[J].Neural Computation，1997，9（8）：1735-1780.

[22] LAFFERTY J D，MCCALLUM A，PEREIRA F C N.Conditional random fields：probabilistic models for segmenting and labeling sequence data[C]//Proc 18th International Conf on Machine Learning，2001：282-289.