基于命名实体识别的违法广告词检测方法

doi:10.3778/j.issn.1002-8331.2204-0147

摘要/Abstract

摘要： 伴随着广告的普及，违法广告检测的意义重大。面对目前已有的违法广告检测方法仅能判断是否违法，而不能提取违法词并关联违法法条的问题，提出一种基于命名实体识别的违法广告词检测方法，此方法将触及违法条例关键词作为特殊的实体进行识别。具体包括以下步骤：使用BERT（bidirectional encoder representation from transformers）预训练模型提取动态字向量作为模型的输入，构建双向长短期记忆网络获取广告文本上下文的信息输出得分向量，最后结合条件随机场对标签进行限制，获取到最优标签。实验结果表明，这种基于命名实体识别的检测方法可有效地完成违法广告的检测，不仅可以提取违法词，而且还可识别出违法词触犯的相应法条。

关键词: 广告, 违法关键词, 深度学习, 命名实体识别, 条件随机场

Abstract: With the popularization of advertising, the detection of illegal advertising is of great significance. In the face of the existing illegal advertising detection methods can only judge whether illegal or not, but cannot extract illegal words and associate the illegal regulations, an illegal advertising detection method based on named entity recognition is proposed in this paper. The illegal keywords that touch the illegal regulations are regarded as entities which are informal. Firstly, the BERT（bidirectional encoder representations from transformers） pre-training model will provide dynamic vector representations of common Chinese words. Then, the word vector is fed into the BiLSTM（bi-directional long short-term memory） combined with contextual information to obtain the characteristics of each word. Finally, the best labels can be predicted by constraining the labels through the CRF（conditional random field）. The experimental results show that the detection method based on named entity recognition can effectively complete the detection of the illegal advertising, which not only can extract illegal words but also can identify the corresponding legal regulations that the illegal words break.

Key words: advertising, illegal key words, deep learning, named entity recognition（NER）, conditional random field（CRF）

袁子博, 姚涛, 闫连山. 基于命名实体识别的违法广告词检测方法[J]. 计算机工程与应用, 2023, 59(15): 141-150.

YUAN Zibo, YAO Tao, YAN Lianshan. Detection Method of Illegal Advertising Words Based on Named Entity Recognition[J]. Computer Engineering and Applications, 2023, 59(15): 141-150.

参考文献

[1] 张海楠，伍大勇，刘悦，等.基于深度神经网络的中文命名实体识别[J].中文信息学报，2017，31（4）：28-35.
ZHANG H N，WU D Y，LIU Y，et al.Chinese named entity recognition based on deep neural network[J].Journal of Chinese Information Processing，2017，31（4）：28-35.
[2] 汪海燕，黎建辉，杨风雷.支持向量机理论及算法研究综述[J].计算机应用研究，2014，31（5）：1281-1286.
WANG H Y，LI J H，YANG F L.Overview of support vector machine analysis and algorithm[J].Application Research of Computers，2014，31（5）：1281-1286.
[3] CHOPRA D，JOSHI N，MATHUR I.Named entity recognition in hindi using hidden markov model[C]//Second International Conference on Computational Intelligence & Communication Technology，2016：581-586.
[4] NITA P，AJAY P，PAWAR B V.Named entity recognition using conditional random fields[J].Procedia Computer Science，2020，167：1181-1188.
[5] DEVLIN J，CHANG M W，LEE K，et al.BERT：pre-training of deep bidirectional transformers for language understanding[C]//Proceedings of the 2019 Conference on the North American Chapter of the Association for Computational Linguistics：Human Language Technologies，Volume 1（Long and Short Papers），2019：4171-4186.
[6] GRAVES A，JAITLY N，MOHAMED A.Hybrid speech recognition with deep bidirectional LSTM[C]//2013 IEEE Workshop on Automatic Speech Recognition and Understanding，2013：273-278.
[7] ZHENG S，JAYASUMANA S，ROMERA-PAREDES B，et al.Conditional random fields as recurrent neural networks[C]//Proceedings of the IEEE International Conference on Computer Vision，2015：1529-1537.
[8] 张知临.工商网上违法广告智能识别关键技术研究与实现[D].杭州：浙江大学，2013.
ZHANG Z L.Research and implementation on onlineillegal advertising identifying technology[D].Hangzhou：Zhejiang University，2013.
[9] 党倩.基于无人机的高速公路违法广告设施智能巡查技术应用[J].电子技术与软件工程，2020（19）：123-125.
DANG Q.Application of intelligent patrol technology for illegal advertising facilities on expressway based on UAV[J].Electronic Technology & Software Engineering，2020（19）：123-125.
[10] 龙诗杰.基于微博平台的自媒体药品广告监管策略研究[D].重庆：重庆医科大学，2020.
LONG S J.Research on the regulatory strategy of drug advertising on we-media：the case of drug advertising posted by weibo users[D].Chongqing：Chongqing Medical University，2020
[11] 柳泽波.数据驱动的互联网违法广告主题挖掘与关联识别研究[D].杭州：浙江大学，2020.
LIU Z B.Data-driven topics mining and classification of illegal internet advertisiing[D].Hangzhou：Zhejiang University，2020.
[12] WANG Y，GUO H，SONG Q.An intelligent system for detecting illegal words in online advertisement[C]//International Symposium on Computational Intelligence & Design，2017：391-395.
[13] 赵鹏飞，赵春江，吴华瑞，等.基于注意力机制的农业文本命名实体识别[J].农业机械学报，2021，52（1）：185-192.
ZHAO P F，ZHAO C J，WU H R，et al.Named entity recognition of Chinese agricultural text based on attention mechanism[J].Journal of Agricultural Machinery，2021，52（1）：185-192.
[14] 杨锦锋，于秋滨，关毅，等.电子病历命名实体识别和实体关系抽取研究综述[J].自动化学报，2014，40（8）：1537-1562.
YANG J F，YU Q B，GUAN Y，et al.An overview of research on electronic medical record oriented named entity recognition and entity relation extraction[J].Acta Automatica Sinica，2014，40（8）：1537-1562.
[15] 刘小安，彭涛.基于卷积神经网络的中文景点识别研究[J].计算机工程与应用，2020，56（4）：140-145.
LIU X A，PENG T.Research on Chinese scenic spot named entity recognition based on convolutional neural network[J].Computer Engineering and Applications，2020，56（4）：140-145.
[16] MCDONOUGH K，MONCLA L，VAN DE CAMP M.Named entity recognition goes to old regime France：geographic text analysis for early modern French corpora[J].International Journal of Geographical Information Science，2019，33（12）：2498-2522.
[17] BENGIO Y，SCHWENK H，JEAN-SéBASTIEN SENéCA L，et al.Neural probabilistic language models[J].The Journal of Machine Learning Research，2003，3（6）：1137-1155.
[18] MIKOLOV T，SUTSKEVER I，CHEN K，et al.Distributed representations of words and phrases and their compositionality[J].Advances in Neural Information Processing Systems，2013，26.
[19] PETERS M，NEUMANN M，IYYER M，et al.Deep contextualized word representations[C]//Proceedings of the 2018 Conference of the North American Chapter of the Association for Computational Linguistics：Human Language Technologies，Volume 1（Long Papers），2018：2227-2237.
[20] CUI Y，CHE W，LIU T，et al.Pre-training with whole word masking for chinese bert[J].IEEE/ACM Transactions on Audio，Speech，and Language Processing，2021，29：3504-3514.
[21] LIU Y H，OTT M，GOYAL N，et al.RoBERTa：a robustly optimized bert pretraining approach[J].IEICE Transactions on Fundamentals of Electronics，Communications and Computer Sciences，2019，1907：11692.
[22] ELMAN J L.Finding structure in time[J].Cognitive Science，1990，14（2）：179-211.
[23] 费宁，张浩然.TensorFlow架构与实现机制的研究[J].计算机技术与发展，2019，29（9）：31-34.
FEI N，ZHANG H R.Research on TensorFlow architecture and mechanism[J].Computer Technology and Development，2019，29（9）：31-34.
[24] WANG C，CHEN W，XU B.Named entity recognition with gated convolutional neural networks[M]//Chinese computational linguistics and natural language processing based on naturally annotated big data.Cham：Springer，2017：110-121.
[25] SRIVASTAVA N，HINTON G，KRIZHEVSKY A，et al.Dropout：a simple way to prevent neural networks from overfitting[J].Journal of Machine Learning Research，2014，15（1）：1929-1958.
[26] LIU Y，LU J，YANG J，et al.Sentiment analysis for e-commerce product reviews by deep learning model of Bert-BiGRU-Softmax[J].Mathematical Biosciences and Engineering，2020，17（6）：7819-7837.
[27] 杨飘，董文永.基于BERT嵌入的中文命名实体识别方法[J].计算机工程，2020，46（4）：40-45.
YANG P，DONG W Y.Chinese named entity recognition method based on bert embedding[J].Computer Engineering，2020，46（4）：40-45.