Computer Engineering and Applications ›› 2024, Vol. 60 ›› Issue (5): 328-335.DOI: 10.3778/j.issn.1002-8331.2310-0280

• Engineering and Applications • Previous Articles     Next Articles

Improved Miner Chin Strap Detection and Personnel Tracking with YOLOv8s and DeepSORT

DING Ling, MIAO Xiaoran, HU Jianfeng, ZHAO Zuopeng, ZHANG Xinjian   

  1. 1.Xuzhou Institute of Finance and Economics, Jiangsu United Vocational College of Technology, Xuzhou, Jiangsu 221116, China
    2.School of Computer Science and Technology, China University of Mining and Technology, Xuzhou, Jiangsu 221116, China
    3.Chensilou Coal Mine, Henan Longyu Energy Co., Ltd., Yongcheng, Henan 476600, China
  • Online:2024-03-01 Published:2024-03-01

改进YOLOv8s与DeepSORT的矿工帽带检测及人员跟踪

丁玲,缪小然,胡建峰,赵作鹏,张新建   

  1. 1.江苏联合职业技术学院 徐州财经分院,江苏 徐州 221116
    2.中国矿业大学 计算机科学与技术学院,江苏 徐州 221116
    3.河南龙宇能源股份有限公司 陈四楼煤矿,河南 永城 476600

Abstract: Ensuring proper safety helmet usage is of utmost importance in underground mining inspections to protect workers. However, challenging conditions, such as high temperatures, often lead to non-compliant helmet wearing behavior. Existing detection methods are insufficient for underground environments, resulting in low recognition accuracy and inadequate detection of correctly worn helmets. To address these issues, this paper proposes an improved version of the CM-YOLOv8s algorithm that focuses on the chin strap as a small target for safety helmet detection and compliance assessment. The DeepSORT algorithm is then employed to track workers who fail to comply with helmet-wearing regulations. To begin, a comprehensive dataset is curated utilizing underground surveillance cameras. The CM-YOLOv8s algorithm is leveraged for safety helmet detection by incorporating higher-resolution feature maps and introducing a cascaded query mechanism. This approach enables precise detection of small targets without significantly increasing computational costs. Furthermore, the enhanced DeepSORT algorithm is employed for person tracking by replacing the small residual network in DeepSORT with deeper convolutional layers, thereby enhancing the extraction of appearance information. The proposed algorithm is validated using a self-made dataset for underground safety helmet detection and tracking. Experimental results demonstrate that CM-YOLOv8s achieves an average precision of 92.3% for safety helmet recognition, which is a 4.2 percentage points improvement over YOLOv8s. Additionally, the average accuracy of the safety helmet compliance recognition system, based on CM-YOLOv8s and DeepSORT, is 85.37%, with a detection speed of 59 FPS. The proposed algorithm effectively addresses compliance detection in safety helmet wearing by accurately assessing the position of the chin strap in proximity to the individual’s jaw. It strikes an optimal balance between detection speed and accuracy while exhibiting robust adaptability to the complex underground environments. The successful implementation of this algorithm at the Chensilou Coal Mine over an extended period has demonstrated its efficacy in monitoring and providing early warnings for abnormal safety helmet wearing, thereby bolstering regulatory oversight and promoting the compliant use of safety helmets among miners. The algorithm holds great potential for enhancing safety measures in underground mining inspections and can be applied to similar industrial scenarios. Further research and development in this direction are warranted to expand its applicability and impact.

Key words: safety helmet, chin strap detection, real-time monitoring, YOLOv8, DeepSORT

摘要: 不系帽带,安全帽等于没戴。然而现有的安全帽检测方法,缺乏对帽带异常佩戴的检测研究。针对此问题,结合煤矿井下特殊的作业环境,以人员安全帽帽带检测及人员跟踪为研究对象,提出了CM-YOLOv8s算法检测安全帽及其帽带,利用DeepSORT算法对未系帽带的作业人员进行跟踪。利用井下监控视频制作数据集,使用CM-YOLOv8s对井下人员安全帽帽带进行检测:在YOLOv8s的基础上引入更高分辨率的特征图并新增了一种级联查询机制,在不提高计算成本的前提下能完成对小物体更精准的检测。利用改进DeepSORT对人员进行编码追踪:采用更深层卷积替换DeepSORT中小型残差网络来强化外观信息提取能力。通过自制井下安全帽帽带检测及跟踪数据集对改进算法进行验证,实验结果表明:CM-YOLOv8s的安全帽帽带识别算法平均精度均值达到92.3%,较YOLOv8s提高4.2个百分点。此外,基于CM-YOLOv8s与DeepSORT的安全帽规范佩戴识别系统的平均准确率为85.37%,检测速度达到59?FPS。提出的安全帽帽带检测算法,通过检测帽带是否在人员下颚附近来鉴别安全帽是否规范佩戴,能较好地平衡检测速度与精度,并能适应复杂的井下环境。通过在陈四楼煤矿数月的应用表明,实现了对安全帽佩戴异常的监测预警,加强了对矿工规范佩戴安全帽的有效监管。

关键词: 安全帽, 帽带检测, 实时监测, YOLOv8, DeepSORT