面向嵌入式平台的安全帽实时检测方法

doi:10.3778/j.issn.1002-8331.2011-0038

摘要/Abstract

摘要： 针对当前基于深度学习的安全帽检测方法因结构复杂和计算量大，难以在嵌入端实现实时检测的问题，提出一种适用于嵌入式平台的轻量化安全帽实时检测方法。该方法以Tiny-YOLOv3检测网络为基础，通过改进特征提取网络和多尺度预测优化网络结构，引入空间金字塔池化模块丰富特征图的多尺度信息，采用[K]-means聚类算法确定适合安全帽检测的锚框，引入CIoU边界框回归损失函数以提高检测精度。实验结果表明：在608×608的输入尺寸下，所提方法的平均准确率、召回率、F1值分别达到87.50%、84%、83%，较Tiny-YOLOv3检测方法分别提升了11.27、11和7个百分点；且在嵌入式平台NVIDIA Jetson Nano上实现了20.58 frame/s的实时检测速度，可满足在嵌入端实现安全帽实时检测的需求。该方法在光线不佳、小目标、密集目标等复杂施工环境下具有良好的适应性和泛化性。

关键词: 安全帽检测, Tiny-YOLOv3, 嵌入式平台, 多尺度预测, 空间金字塔池化

Abstract: Aiming at the problem that current deep learning based hardhat detection methods are difficult to achieve real-time detection at the embedded devices due to complex structure and large amount of calculation, a light-weight hardhat detection method is proposed for embedded platform. Based on Tiny-YOLOv3, the network structure is optimized by improving the feature extraction network and multi-scale prediction. The spatial pyramid pooling module is introduced to enrich the multi-scale information of feature map. K-means clustering algorithm is used to determine the anchor frame suitable for hardhats detection. The bounding box regression loss function CIoU is introduced to improve detection accuracy. Experimental results show that, with the input size of 608×608, the average accuracy, recall rate and F1 value of the proposed method are 87.50%, 84% and 83%, which is 11.27, 11 and 7 percentage points higher than that of Tiny-YOLOv3 detection method. Meanwhile, the proposed method can achieve a real-time detection speed of 20.58 frames per second on the embedded platform NVIDIA Jetson Nano, which can meet the requirement of real-time detection when running on the embedded platform. In addition, the proposed method has good adaptability and generalization in complex construction environment such as poor light, small targets and dense targets.

Key words: hardhat detection, Tiny-YOLOv3, embedded platform, multi-scale prediction, spatial pyramid pooling

农元君, 王俊杰, 徐晓东, 赵雪冰. 面向嵌入式平台的安全帽实时检测方法[J]. 计算机工程与应用, 2022, 58(9): 161-167.

NONG Yuanjun, WANG Junjie, XU Xiaodong, ZHAO Xuebing. Real-Time Hardhats Detection Method for Embedded Platform[J]. Computer Engineering and Applications, 2022, 58(9): 161-167.

参考文献

[1] 中华人民共和国住房和城乡建设部办公厅.住房和城乡建设部办公厅关于2019年房屋市政工程生产安全事故情况的通报[EB/OL].（2020-06-19）[2020-11-01].http：//www.mohurd.gov.cn/wjfb/202006/t20200624_246031.html.
Ministry of Housing and Urban-Rural Development of the People’s Republic of China.Report on production safety accidents of housing and municipal engineering in 2019[EB/OL].（2020-06-19）[2020-11-01].http：//www.mohurd.gov.cn/wjfb/202006/t20200624_246031.html.
[2] GIRSHICK R.Fast R-CNN[C]//IEEE International Conference on Computer Vision，2015：1440-1448.
[3] REN S，HE K，GIRSHICK R，et al.Faster R-CNN：towards real-time object detection with region proposal networks[J].IEEE Transactions on Pattern Analysis and Machine Intelligence，2017，39（6）：1137-1149.
[4] LIU W，ANGUELOV D，ERHAN D，et al.SSD：single shot multibox detector[C]//European Conference on Computer Vision，2016：21-37.
[5] REDMON J，DIVVALA S，GIRSHICK R，et al.You only look once：unified，real-time object detection[C]//IEEE Conference on Computer Vision and Pattern Recognition，2016：779-788.
[6] REDMON J，FARHADI A.YOLO9000：better，faster，stronger[C]//IEEE Conference on Computer Vision and Pattern Recognition，2017：7263-7271.
[7] REDMON J，FARHADI A.YOLOv3：an incremental improvement[EB/OL].（2018-04-08）[2020-11-01].https：//arxiv.org/abs/1804.02767.
[8] 方明，孙腾腾，邵桢.基于改进YOLOv2的快速安全帽佩戴情况检测[J].光学精密工程，2019，27（5）：1196-1205.
FANG M，SUN T T，SHAO Z.Fast helmet-wearing-condition detection based on improved YOLOv2[J].Optics and Precision Engineering，2019，27（5）：1196-1205.
[9] 林俊，党伟超，潘理虎，等.基于YOLO的安全帽检测方法[J].计算机系统应用，2019，28（9）：174-179.
LIN J，DANG W C，PAN L H，et al.Safety helmet detection based on YOLO[J].Computer Systems & Applications，2019，28（9）：174-179.
[10] 施辉，陈先桥，杨英.改进YOLO v3的安全帽佩戴检测方法[J].计算机工程与应用，2019，55（11）：213-220.
SHI J，CHEN X Q，YANG Y.Safety helmet wearing detection method of improved YOLO v3[J].Computer Engineering and Applications，2019，55（11）：213-220.
[11] 王兵，李文璟，唐欢.改进YOLO v3算法及其在安全帽检测中的应用[J].计算机工程与应用，2020，56（9）：33-40.
WANG B，LI W J，TANG H.Improved YOLO v3 algorithm and its application in helmet detection[J].Computer Engineering and Applications，2020，56（9）：33-40.
[12] WU J，CAI N，CHEN W，et al.Automatic detection of hardhats worn by construction personnel：a deep learning approach and benchmark dataset[J].Automation in Construction，2019，106：102894.
[13] 张明媛，曹志颖，赵雪峰，等.基于深度学习的建筑工人安全帽佩戴识别研究[J].安全与环境学报，2019，19（2）：535-541.
ZHANG M Y，CAO Z Y，ZHAO X F，et al.On the identification of the safety helmet wearing manners for the construction company workers based on the deep learning theory[J].Journal of Safety and Environment，2019，19（2）：535-541.
[14] 徐守坤，王雅如，顾玉宛，等.基于改进Faster RCNN的安全帽佩戴检测研究[J].计算机应用研究，2020，37（3）：901-905.
XU S K，WANG Y R，GU Y W，et al.Safety helmet wearing detection study based on improved Faster RCNN[J].Application Research of Computers，2020，37（3）：901-905.
[15] LIN T，DOLLAR P，GIRSHICK R，et al.Feature pyramid networks for object detection[C]//IEEE Conference on Computer Vision and Pattern Recognition，2017：936-944.
[16] HE K，ZHANG X，REN S，et al.Spatial pyramid pooling in deep convolutional networks for visual recognition[J].IEEE Transactions on Pattern Analysis and Machine Intelligence，2015，37（9）：1904-1916.
[17] ZHENG Z H，WANG P，LIU W，et al.Distance-IoU loss：faster and better learning for bounding box regression[EB/OL].（2019-11-19）[2020-11-22].https：//arxiv.org/abs/ 1911.08287.
[18] ZHANG Z，HE T，ZHANG H，et al.Bag of freebies for training object detection neural networks[EB/OL].（2019-04-12）[2020-11-01].https：//arxiv.org/abs/1902.04103.