Real-Time Face Mask Detection and Standard Wearing Recognition Method in Natural Environment

doi:10.3778/j.issn.1002-8331.2106-0363

Abstract

Abstract:

The novel coronavirus has a strong infectious effect. It can prevent the spread of airborne droplets and aerosols by wearing masks standard. However, some people do not wear masks or wear masks irregularly in public. It is not conducive to the development of epidemic prevention and control work. In order to solve this problem, the article improves YOLOv4 and proposes a real-time face mask detection and standard wearing recognition method in natural environment. For the large number of model parameters and the difficult of deploy, a lightweight backbone network L-CSPDarkNet （Light CSPDarkNet） is proposed to improve the detection speed of the model, and a lightweight feature enhancement module Light-FEB（Light Feature Enhancement Black） and multi-scale attention are proposed. The Multi-Scale-Sam （Multi Scale Sam） module enhances the feature extraction capabilities of the lightweight backbone network. Experimental results show that the accuracy of the proposed method reaches 91.94%, which is 3.55 percentage points higher than the original YOLOv4, and the detection speed reaches 75 frames per second, which is higher than the 35 frames per second of the original YOLOv4, and the false detection has been improved.

Key words: novel coronavirus, face mask detection, lightweight backbone network, feature enhancement, attention mechanism

摘要：

新冠状病毒具有很强的传染性，规范佩戴口罩可以阻隔病毒通过空气中的飞沫、气溶胶等载体传播，然而在公共场合时有公民不佩戴口罩或不规范佩戴口罩的现象，不利于疫情防控工作的开展。为解决这一问题，提出了一种自然环境下的实时人脸口罩检测与规范佩戴识别方法，采用YOLOv4算法，在自然环境下对公民口罩佩戴情况进行检测。针对模型参数量大，难以部署应用的难题，引入轻量级骨干网络L-CSPDarkNet（LightCSPDarkNet）以提高模型的检测速度，同时提出轻量级特征增强模块Light-FEB（Light Feature Enhancement Black）和多尺度注意力机制Multi-Scale-Sam（MultiScaleSam）增强轻量级主干网络的特征提取能力。实验结果表明，该算法精度可达91.94%，相比于原始YOLOv4算法提高了3.55个百分点，检测速度达到75?frame/s，高于原始YOLOv4的35?frame/s，可满足实际应用的需求。

关键词: 新冠状病毒, 人脸口罩检测, 轻量级骨干网络, 特征增强, 注意力机制

DING Pei, ALIFU·Kuerban, GENG Liting, HAN Wenxuan. Real-Time Face Mask Detection and Standard Wearing Recognition Method in Natural Environment[J]. Computer Engineering and Applications, 2021, 57(24): 268-275.

丁培，阿里甫·库尔班，耿丽婷，韩文轩. 自然环境下实时人脸口罩检测与规范佩戴识别[J]. 计算机工程与应用, 2021, 57(24): 268-275.

References

[1] 刘甜，任家材，张世英，等.新型冠状病毒疫情下细胞学标本固定后的蜡块制作体会[J].临床与实验病理学杂志，2021，37（1）：3-5.
LIU T，REN J C，ZHANG S Y，et al.Experience in making wax blocks of cytology specimens after fixation under the new coronavirus epidemic[J].Journal of Clinical and Experimental Pathology，2021，37（1）：3-5.
[2] 何进椅，陈隽，张孝莉，等.预防新型冠状病毒肺炎的医用防护口罩选择及佩戴建议[J].中华灾害救援医学，2021，9（2）：825-828.
HE J Y，CHEN J，ZHANG X L，et al.Selection of medical protective masks to prevent new coronavirus pneumonia and recommendations for wearing[J].Chinese Disaster Rescue Medicine，2021，9（2）：825-828.
[3] FELZENSZWALB P F，GIRSHICK R B，MCALLESTER D A，et al.Object detection with discriminatively trained part-based models[J].IEEE Transactions on Pattern Analysis & Machine Intelligence，2010，32（9）：1627-1645.
[4] FELZENSZWALB P F，MCALLESTER D A，RAMANAN D.A discriminatively trained，multiscale，deformable part model[C]//Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition，2008：1-8.
[5] VIOLA P，JONES M J.Robust real-time face detection[J].International Journal of Computer Vision，2004，57（2）：137-154.
[6] 黄梓桐，阿里甫·库尔班.无人机平台下的行人与车辆目标实时检测[J].计算机工程与应用，2021，57（17）：169-174.
HUANG Z T，ALIFU·K R B.Real-time detection of pedestrian and vehicle targets under UAV platform[J].Computer Engineering and Applications，2021，57（17）：169-174.
[7] REN S，HE K，GIRSHICK R，et al.Faster R-CNN：towards real-time object detection with region proposal networks[J].IEEE Transactions on Pattern Analysis and Machine Intelligence，2017，39（6）：1137-1149.
[8] HE K M，ZHANG X Y，REN S Q，et al.Spatial pyramid pooling in deep convolutional networks for visual recognition[J].IEEE Transactions on Pattern Analysis and Machine Intelligence，2015，37（9）：1904-1916.
[9] GIRSHICK R.Fast R-CNN[C]//Proceedings of the IEEE International Conference on Computer Vision，2015：1440-1448.
[10] LIU W，ANGUELOV D，ERHAN D，et al.SSD：single shot multibox detector[C]//Proceedings of the European Conference on Computer Vision（ECCV），2016：21-37.
[11] REDMON J，DIVVALA S，GIRSHICK R，et al.You only look once：unified，real-time object detection[C]//Proceedings of the IEEE Computer Vision & Pattern Recognition，2016：779-788.
[12] REDMON J，FARHADI A.Yolo9000：better，faster，stronger[C]//Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition，2017：7263-7271.
[13] REDMON J，FARHADI A.YOLOv3：an incremental improvement[J].arXiv：1804.02767.2018.
[14] BOCHKOVSKIY A，WANG C Y，LIAO H Y M.YOLOv4：optimal speed and accuracy of object detection[J].arXiv：2004.10934，2020.
[15] 唐翔翔，沈薇，朱明，等.基于改进YOLOv4的输电线路异物检测算法[J].安徽大学学报（自然科学版），2021（5）：58-63.
TANG X X，SHEN W，ZHU M，et al.Based on the improvement of YOLOv4 transmission line foreign object detection algorithm[J].Journal of Anhui University（Natural Science Edition），2021（5）：58-63.
[16] 孔维刚，李文婧，王秋艳，等.基于改进YOLOv4算法的轻量化网络设计与实现[J/OL].计算机工程（2021-04-30）[2021-08-11].https：//doi.org/10.19678/j.issn.1000-3428.0060948.
KONG W G，LI W Q，WANG Q Y，et al.Lightweight network design and implementation based on impr-oved YOLOv4 algorithm[J].Computer Engineering（2021-04-30）[2021-08-11].https：//doi.org/10.19678/j.issn.1000-3428.
0060948.
[17] 王滢暄，宋焕生，梁浩翔，等.基于改进的YOLOv4高速公路车辆目标检测研究[J].计算机工程与应用，2021，57（13）：218-226.
WANG W X，SONG H S，LIANG H X，et al.Highway vehicle object detection based on improved YOLOv4 method[J].Computer Engineering and Applications，2021，57（13）：218-226.
[18] 邓黄潇.基于迁移学习与RetinaNet的口罩佩戴检测的方法[J].电子技术与软件工程，2020（5）：209-211.
DENG H X.Method of mask wearing detection based on transfer learning and RetinaNet[J].Electronic Technology and Software Engineering，2020（5）：209-211.
[19] 肖俊杰.基于YOLOv3和YCrCb的人脸口罩检测与规范佩戴识别[J].软件，2020，41（7）：164-169.
XIAO J J.Face mask detection and standard wearing recognition based on YOLOv3 and YCrCb[J].Software，2020，41（7）：164-169.
[20] 牛作东，覃涛，李捍东，等.改进RetinaFace的自然场景口罩佩戴检测算法[J].计算机工程与应用，2020，56（12）：1-7.
NIU Z D，TAN T，LI H D，et al.Improved algorithm of retina face for natural scene mask wear detection[J].Computer Engineering and Applications，2020，56（12）：1-7.
[21] SZEGEDY C，VANHOUCKE V，IOFFE S，et al.Rethinking the inception architecture for computer vision[C]//Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition，2016：2818-2826.
[22] 章琳，袁非牛，张文睿，等.全卷积神经网络研究综述[J].计算机工程与应用，2020，56（1）：25-37.
ZHANG L，YUAN F N，ZHANG W R，et al.A survey of fully convolutional neural networks[J].Computer Engineering and Applications，2020，56（1）：25-37.
[23] ZHANG J，LIU S，YAN H，et al.Predicting voxel-level dose distributions for esophageal radiotherapy using densely connected network with dilated convolutions[J].Physics in Medicine & Biology，2020，65（20）.
[24] WOO S，PARK J，LEE J Y，et al.CBAM：convolutional block attention module[C]//Proceedings of the European Conference on Computer Vision（ECCV），2018：3-19.