YOLOv5 Helmet Wear Detection Method with Introduction of Attention Mechanism

doi:10.3778/j.issn.1002-8331.2112-0242

Abstract

Abstract: For high-risk industries such as steel manufacturing, coal mining and construction industries, wearing helmets during construction is one of effective ways to avoid injuries. For the current helmet wearing detection model in a complex environment for small and dense targets, there are problems such as false detection and missed detection, an improved YOLOv5 target detection method is proposed to detect the helmet wearing. A coordinate attention mechanism（coordinate attention） is added to the backbone network of YOLOv5, which embeds location information into channel attention so that the network can pay attention on a larger area. The original feature pyramid module in the feature fusion module is replaced with a weighted bi-directional feature pyramid（BiFPN）network structure to achieve efficient bi-directional cross-scale connectivity and weighted feature fusion. The experimental results on the homemade helmet dataset show that the improved YOLOv5 model achieves an average accuracy of 95.9%, which is 5.1 percentage points higher than the YOLOv5 model, and meets the requirements for small and dense target detection in complex environments.

Key words: helmet wearing detection, YOLOv5 algorithm, weighted bidirectional feature pyramid, coordinate attention mechanism

摘要： 对于钢铁制造业、煤矿行业及建筑行业等高危行业来说，施工过程中佩戴安全帽是避免受伤的有效途径之一。针对目前安全帽佩戴检测模型在复杂环境下对小目标和密集目标存在误检和漏检等问题，提出一种改进YOLOv5的目标检测方法来对安全帽的佩戴进行检测。在YOLOv5的主干网络中添加坐标注意力机制（coordinate attention），该机制将位置信息嵌入到通道注意力当中，使网络可以在更大区域上进行注意。将特征融合模块中原有特征金字塔模块替换成加权双向特征金字塔（BiFPN）网络结构，实现高效的双向跨尺度连接和加权特征融合。在自制安全帽数据集上实验结果表明，改进的YOLOv5模型平均精度达到了95.9%，相比于YOLOv5模型，平均精度提高了5.1个百分点，达到了在复杂环境下对小目标和密集目标检测的要求。

关键词: 安全帽佩戴检测, YOLOv5算法, 加权双向特征金字塔, 坐标注意力机制

WANG Lingmin, DUAN Jun, XIN Liwei. YOLOv5 Helmet Wear Detection Method with Introduction of Attention Mechanism[J]. Computer Engineering and Applications, 2022, 58(9): 303-312.

王玲敏, 段军, 辛立伟. 引入注意力机制的YOLOv5安全帽佩戴检测方法[J]. 计算机工程与应用, 2022, 58(9): 303-312.

References

[1] 刘晓慧，叶西宁.肤色检测和Hu矩在安全帽识别中的应用[J].华东理工大学学报（自然科学版），2014，40（3）：365-370.
LIU X H，YE X N.Skin color detection and Hu moments in helmet recognition research[J].Journal of East China University of Science and Technology（Natural Science Edition），2014，40（3）：365-370.
[2] 李琪瑞.基于人体识别的安全帽视频检测系统研究与实现[D].成都：电子科技大学，2017.
LI Q R.A research and implementation of safety-helmet video detection system based on human body recognition[D].Chengdu：University of Electronic Science and Technology of China，2017.
[3] RUBAIYAT A H M，TOMA T.Automatic detection of helmet uses for construction safety[C]//Proceedings of International Conference on Web Intelligence Workshops.Piscataway，NJ：IEEE Press，2017：135-142.
[4] CHIVERTON J.Helmet presence classification with motorcycle detection and tracking[J].IET Intelligent Transport Systems，2012，6（3）：259-269.
[5] GIRSHICK R，DONAHUE J，DARRELL T，et al.Rich feature hierarchies for accurate object detection and semantic segmentation[C]//Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition，2014：580-587.
[6] HE K M，ZHANG X，REN S，et al.Spatial pyramid pooling in deep convolutional networks for visual recognition[J].IEEE Transactions on Pattern Analysis and Machine Intelligence，2015，37（9）：1904-1916.
[7] GIRSHICK R.Fast R-CNN[C]//Proceedings of the IEEE International Conference on Computer Vision，2015：1440-1448.
[8] REN S，HE K，GIRSHICK R，et al.Faster R-CNN：towards real-time object detection with region proposal networks[J].IEEE Transactions on Pattern Analysis and Machine Intelligence，2017，39（6）：1137-1149.
[9] HE K，GKIOXARI G，DOLLAR P，et al.Mask R-CNN[J].IEEE Transactions on Pattern Analysis and Machine Intelligence，2020，42（2）：386-397.
[10] REDMON J，DIVVALA S，GIRSHICK R，et al.You only look once：unified，real-time object detection[C]//Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition，2016：779-788.
[11] REDMON J，FARHADI A.YOLO9000：better，faster，stronger[C]//Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition，2017：6517-6525.
[12] REDMON J，FARHADI A.YOLOv3：an incremental improvement[C]//Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition，2018：89-95.
[13] BOCHKOVSKIY A，WANG C Y，LIAO H Y M.YOLOv4：optimal speed and accuracy of object detection[C]//IEEE Conference on Computer Vision and Pattern Recognition（CVPR），2020.
[14] LIU W，ANGUELOV D，ERHAN D，et al.SSD：single shot multibox detector[C]//European Conference on Computer Vision.Cham:Springer，2016：21-37.
[15] 徐守坤，王雅如，顾玉宛，等.基于改进Faster RCNN的安全帽佩戴检测研究[J].计算机应用研究，2020，37（3）：901-905.
XU S K，WANG Y R，GU Y W，et al.Research on helmet wearing detection based on improved Faster RCNN[J].Application Research of Computers，2020，37（3）：901-905.
[16] SHRIVASTAVA A，GUPTA A，GIRSHICK R.Training region-based object detectors with online hard example mining[C]//Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition，2016：761-769.
[17] 施辉，陈先桥，杨英.改进YOLO v3的安全帽佩戴检测方法[J].计算机工程与应用，2019，55（11）：213-220.
SHI H，CHEN X Q，YANG Y.Safety helmet wearing detection method of improved YOLO v3[J].Computer Engineering and Applications，2019，55（11）：213-220.
[18] LIU S，QI L，QIN H，et al.Path aggregation network for instance segmentation[C]//Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition，2018：8759-8768.
[19] HOU Q B，ZHOU D Q，FENG J S.Coordinate attention for efficient mobile network design[C]//Proceedings of the IEEE/CVF Conference on Computer Vision and Pattern Recognition，2021：13713-13722.
[20] HU J，SHEN L，SUN G.Squeeze-and-excitation networks[C]//Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition，2018：7132-7141.
[21] WOO S，PARK J，LEE J Y，et al.CBAM：convolution block attention module[C]//Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition，2018：3-19.
[22] TAN M，PANG R，LE Q V.EfficientDet：scalable and efficient object detection[C]//IEEE Conference on Computer Vision and Pattern Recognition，2020：10778-10787.
[23] REZATOFIHHI H，TSOI N，GWAK J，et al.Generalized intersection over union：a metric and a loss for bounding box regression[C]//Proceedings of the IEEE/CVF Conference on Computer Vision and Pattern Recognition，2019：658-666.
[24] ZHENG Z，WANG P，LIU W，et al.Distance-IoU loss：faster and better learning for bounding box regression[C]//Proceedings of the AAAI Conference on Artificial Intelligence，2020：12993-13000.
[25] LIN T Y，GOYAL P，GIRSHICK R，et al.Focal loss for dense object detection[C]//Proceedings of the IEEE International Conference on Computer Vision and Pattern Recognition，2017：1-8.