Small Target-Oriented Multi-Space Hierarchical Helmet Detection

doi:10.3778/j.issn.1002-8331.2210-0353

Abstract

Abstract: As there are factors affecting the detection effect such as small targets and distances in the target video, it is difficult to capture small targets. A multi-spatial hierarchical helmet wearing detection algorithm for small targets is proposed in the article, which will be personalized and improved on the basis of Yolov5s network model. Firstly, a multi-spatial attention module is designed to consider the effects of spatial features from different perspectives and fuse them to enhance the spatial location relationships of salient features. Secondly, features at multiple spatial scales are fused while combining multiple features in the feature extraction process to adapt to the capture of targets at different spatial levels and improve the detection of small targets. Thirdly, data augmentation is used to improve the generalizability of the dataset to adapt the training targets to more diverse scenarios. Finally, the loss function is optimized to enhance the regression capability and improve the training effect. The experimental results show that the proposed algorithm achieves an average accuracy of 91.5%, significantly reducing the number of missed detections. In addition, the proposed algorithm has been deployed to real construction sites and has shown superior performance in detecting small targets, which is of great value for application.

Key words: helmet detection, Yolov5s, multi-spatial attention module, data augmentation, multi-spatial scale fusion

摘要： 由于目标视频中存在目标小、距离远等影响检测效果的因素，对小目标的捕捉难度较大，提出一种面向小目标的多空间层次安全帽佩戴检测算法，该算法将在Yolov5s的网络模型基础上进行个性化改进。设计一种多空间注意力模块，从不同角度考虑空间特征的效果并加以融合，加强显著性特征的空间位置关系；融合多空间尺度的特征，同时结合特征提取过程中的多种特征，适应对不同空间层次目标的捕捉，提高对小目标的检测能力；利用数据增强提高数据集的泛用性，使训练目标适应更多样的情景；优化损失函数，增强回归能力，提高训练效果。实验结果表明，所提算法的平均准确率达到91.5%，明显地减少了漏检情况。除此之外，将其部署到实际施工现场，展现了出对小目标优越的检测性能，具有极大的应用价值。

关键词: 安全帽检测, Yolov5s, 多空间注意力模块, 数据增强, 多空间尺度融合

LI Jiaxin, HU Yang, HUANG Xiezhou, LI Hongjun. Small Target-Oriented Multi-Space Hierarchical Helmet Detection[J]. Computer Engineering and Applications, 2024, 60(6): 230-237.

李嘉信, 胡杨, 黄协舟, 李洪均. 面向小目标的多空间层次安全帽检测[J]. 计算机工程与应用, 2024, 60(6): 230-237.

References

[1] WANG L, TANG J, LIAO Q. A study on radar target detection based on deep neural networks[J], IEEE Sensors Letters, 2019, 3(3): 1-4.
[2] JAMTSHO Y, RIYAMONGKOL P, WARANUSAST R. Real-time license plate detection for non-helmeted motorcyclist using YOLO[J]. ICT Express, 2021, 7(1): 104-109.
[3] HUANG L, FU Q. HE M, et al. Detection algorithm of safety helmet wearing based on deep learning[J]. Concurrency and Computation: Practice and Experience, 2021, 33(13): e6234.
[4] PATHAK A R, PANDEY M, RAUTARAY S. Application of deep learning for object detection[J]. Procedia Computer Science, 2018, 132: 1706-1717.
[5] CHEN S B, DAI B M, TANG J, et al. A refined single-stage detector with feature enhancement and alignment for oriented objects[J]. IEEE Journal of Selected Topics in Applied Earth Observations and Remote Sensing, 2021, 14: 8898-8908.
[6] EDGAR M P, GIBSON G M, PADGETT M J. Principles and prospects for single-pixel imaging[J]. Nature Photonics, 2019, 13(1): 13-20.
[7] ZHENG W, TANG W, JIANG L, et al. SE-SSD: self-ensembling single-stage object detector from point cloud[C]//Proceedings of the IEEE/CVF Conference on Computer Vision and Pattern Recognition, New York, Jun 19-25, 2021: 14494-14503.
[8] LI M, ZHU H, CHEN H, et al. Research on object detection algorithm based on deep learning[J]. Journal of Physics: Conference Series, 2021, 1995(1): 310-314.
[9] SHARMA T, DEBAQUE B, DUCLOS N, et al. Deep learning-based object detection and scene perception under bad weather conditions[J]. Electronics, 2022, 11(4): 563.
[10] HUANG H, TANG X, WEN F, et al. Small object detection method with shallow feature fusion network for chip surface defect detection[J]. Scientific Reports, 2022, 12(1): 3914.
[11] LI D, XU J, WANG J, et al. A multi-scale fusion convolutional neural network based on attention mechanism for the visualization analysis of EEG signals decoding[J]. IEEE Transactions on Neural Systems and Rehabilitation Engineering, 2020, 28(12): 2615-2626.
[12] CHEN L, ZHANG Z, PENG L. Fast single shot multibox detector and its application on vehicle counting system[J]. IET Intelligent Transport Systems, 2018, 12(10): 1406-1413.
[13] CARION N, MASSA F, SYNNAEVE G, et al. End-to-end object detection with transformers[C]//European Conference on Computer Vision, Aug 23-28, 2020. Cham: Springer, 2020: 213-229.
[14] ZHU B, WANG J, JIANG Z, et al. Autoassign: differentiable label assignment for dense object detection[J]. arXiv:2007.03496, 2020.
[15] REN S, HE K, GIRSHICK R, et al. Faster R-CNN: towards real-time object detection with region proposal networks[C]//Advances in Neural Information Processing Systems, Canada, Dec 7-12, 2015: 91-99.
[16] HURTIK P, MOLEK V, HULA J, et al. Poly-YOLO: higher speed, more precise detection and instance segmentation for YOLOv3[J]. Neural Computing and Applications, 2022, 34(10): 8275-8290.
[17] ZHU X, LYU S, WANG X, et al. TPH-YOLOv5: improved YOLOv5 based on transformer prediction head for object detection on drone-captured scenarios[C]//Proceedings of the IEEE/CVF International Conference on Computer Vision, Canada, Oct 10-17, 2021: 2778-2788.
[18] GIRSHICK R, DONAHUE J, DARRELL T, et al. Rich feature hierarchies for accurate object detection and semantic segmentation[C]//Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition, Columbus, Jun 24-29, 2014: 580-587.
[19] QI G, ZHANG Y, WANG K, et al. Small object detection method based on adaptive spatial parallel convolution and fast multi-scale fusion[J]. Remote Sensing, 2022, 14(2): 420.
[20] ZHU L, LEE F, CAI J, et al. An improved feature pyramid network for object detection[J]. Neurocomputing, 2022, 483: 127-139.
[21] LIU W, ANGUELOV D, ERHAN D, et al. SSD: single shot multibox detector[C]//European Conference on Computer Vision, Amsterdam, Oct 11-14, 2016: 21-37.
[22] LIN T Y, GOYAL P, GIRSHICK R, et al. Focal loss for dense object detection[C]//Proceedings of the IEEE International Conference on Computer Vision, Venice, Oct 24-27, 2017: 2980-2988.
[23] REDMON J, FARHADI A. Yolov3: an incremental improvement[J]. arXiv:1804.02767, 2018.
[24] LIU B, ZHANG T, LI Y, et al. Kernel probabilistic k-means clustering[J]. Sensors, 2021, 21(5): 1892.
[25] LU P, DING Y, WANG C. Multi-small target detection and tracking based on improved YOLO and SIFT for drones[J]. International Journal of Innovative Computing, Information and Control, 2021, 17(1): 205-224.