改进YOLOv5s的小目标烟雾火焰检测算法

doi:10.3778/j.issn.1002-8331.2207-0087

摘要/Abstract

摘要： 针对复杂环境中，烟雾火焰检测存在精度低，小目标检测困难等问题，提出一种改进的基于YOLOv5s的小目标烟雾火焰检测算法。基于公开数据集自建了9?981张不相似的烟雾火焰图像数据集，解决现有数据集的限制，提高了模型的训练效率与泛化能力；在网络中添加3-D注意力机制SimAM，增加算法的特征提取能力，而且没有增加额外的参数；修改网络中的Neck结构，将三尺度检测改为四尺度检测，并结合了加权双向特征金字塔网络（BiFPN）结构，对特征融合过程进行修改，提高小目标的检测能力与特征融合能力；通过遗传算法来优化网络中的部分超参数，进一步模型的检测能力。实验结果表明，改进后的算法比原始YOLOv5s算法平均检测精度提高了7.2%，同时对小目标检测精度更高，误检漏检等情况减少。

关键词: 烟雾检测, 火焰检测, YOLOv5s, 小目标检测, 3-D注意力机制

Abstract: Aiming at the problems of low accuracy in smoke and fire detection and difficulty in small target detection in complex environments, an improved small target smoke, and fire detection algorithm based on YOLOv5s is proposed. Firstly, based on the public datasets, the paper builds 9 981 dissimilar smoke and flame image datasets to solve the limitations of existing datasets and improve the training efficiency and generalization ability of the model. Secondly, it adds a 3-D attention mechanism SimAM to the network, increases the feature extraction ability of the algorithm, and no additional parameters are added. It modifies the Neck structure in the network, changes the three-scale detection to the four-scale detection, and combines the weighted bidirectional feature pyramid network（BiFPN） structure to alter the feature fusion process to improve the detection ability of small targets and feature fusion ability. Finally, some hyperparameters in the network are optimized by genetic algorithm, and the detection ability of the model is further improved. The experimental results show that the average detection accuracy of the improved algorithm is improved by 7.2% compared with the original YOLOv5s algorithm, the detection accuracy of small targets is higher, and the false detection and missed detection are reduced.

Key words: smoke detection, fire detection, YOLOv5s, small object detection, 3-D attention mechanism

王一旭, 肖小玲, 王鹏飞, 向家富. 改进YOLOv5s的小目标烟雾火焰检测算法[J]. 计算机工程与应用, 2023, 59(1): 72-81.

WANG Yixu, XIAO Xiaoling, WANG Pengfei, XIANG Jiafu. Improved YOLOv5s Small Target Smoke and Fire Detection Algorithm[J]. Computer Engineering and Applications, 2023, 59(1): 72-81.

参考文献

[1] BU F，GHARAJEH M S.Intelligent and vision-based fire detection systems：A survey[J].Image and Vision Computing，2019，91：103803
[2] CHEN S J，HOVDE D C，PETERSON K A，et al.Fire detection using smoke and gas sensors[J].Fire Safety Journal，2007，42（8）：507-515
[3] TOEREYIN B U.Computer vision based method for real-time fire and flame detection[J].Pattern Recognition Letters，2006，27（1）：49-58.
[4] 王文豪，刘尚勤，叶庆生.视频火灾检测的设计与实现[J].计算机工程与设计，2008（3）：775-778.
WANG W H，LIU S Q，YE Q S.Design and implementation of fire detection with video[J].Computer Engineering and Design，2008（3）：775-778.
[5] TIAN H D，LI W Q，WANG L，et al.Smoke detection in video：An image separation approach[J].International Journal of Computer Vision，2014，106（2）：192-209.
[6] 卢宏涛，张秦川.深度卷积神经网络在计算机视觉中的应用研究综述[J].数据采集与处理，2016，31（1）：1-17.
LU H T，ZHANG Q C.Applications of deep convolutional neural network in computer vision[J].Journal of Data Acquisition and Processing，2016，31（1）：1-17.
[7] BU F G，GHARAJEH M S.Intelligent and vision-based fire detection systems：A survey[J].Image and Vision Computing，2019，91（C）.
[8] WU S，ZHANG L.Using popular object detection methods for real time forest fire detection[C]//Proceedings of the 11th International Symposium on Computational Intelligence and Design（ISCID），2018：280-284.
[9] LI P，ZHAO W.Image fire detection algorithms based on convolutional neural networks[J].Case Studies in Thermal Engineering，2020，19：100625.
[10] 谢书翰，张文柱，程鹏，等.嵌入通道注意力的YOLOv4火灾烟雾检测模型[J].液晶与显示，2021，36（10）：1445-1453.
XIE S H，ZHANG W Z，CHENG P，et al.Firesmoke detection model based on YOLOv4 with channel attention[J].Chinese Journal of Liquid Crystals and Displays，2021，36（10）：1445-1453.
[11] WANG Z，BOVIK A C，SHEIKH H R，et al.Image quality assessment：From error visibility to structural similarity.[J].IEEE Transactions on Image Processing，2004，13（4）：600-612.
[12] YANG L，ZHANG R Y，LI L，et al.Simam：A simple，parameter-free attention module for convolutional neural networks[C]//Proceedings of the International Conference on Machine Learning，2021：11863-11874.
[13] TAN M，PANG R，LE Q V.Efficientdet：Scalable and efficient object detection[C]//Proceedings of the IEEE/CVF Conference on Computer Vision and Pattern Recognition，2020：10781-10790.
[14] KATOCH S，CHAUHAN S S，KUMAR V.A review on genetic algorithm：Past，present，and future[J].Multimedia Tools and Applications，2021，80（5）：8091-8126.
[15] Ultralytics.YOLOv5[DB/OL].（2020-06-26）[2022-06-01].https：//github.com/ultralytics/YOLOv5.
[16] 杨永波，李栋.改进YOLOv5的轻量级安全帽佩戴检测算法[J].计算机工程与应用，2022，58（9）：201-207.
YANG Y B，LI D.Lightweight helmet wearing detection algorithm of improved YOLOv5[J].Computer Engineering and Applications，2022，58（9）：201-207.
[17] 杨其晟，李文宽，杨晓峰，等.改进YOLOv5的苹果花生长状态检测方法[J].计算机工程与应用，2022，58（4）：237-246.
YANG Q S，LI W K，YANG X F，et al.Improved YOLOv5 method for detecting growth status of apple flowers[J].Computer Engineering and Applications，2022，58（4）：237-246.
[18] YAN B，FAN P，LEI X，et al.A real-time apple targets detection method for picking robot based on improved YOLOv5[J].Remote Sensing，2021，13（9）：1619.
[19] WANG C Y，LIAO H Y M，WU Y H，et al.CSPNet：A new backbone that can enhance learning capability of CNN[C]//Proceedings of the IEEE/CVF Conference on Computer Vision and Pattern Recognition Workshops，2020：390-391.
[20] HE K，ZHANG X，REN S，et al.Deep residual learning for image recognition[C]//Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition，2016：770-778.
[21] HE K，ZHANG X，REN S，et al.Spatial pyramid pooling in deep convolutional networks for visual recognition[J].IEEE Transactions on Pattern Analysis and Machine Intelligence，2015，37（9）：1904-1916.
[22] GUO M H，XU T X，LIU J J，et al.Attention mechanisms in computer vision：A survey[J].Computational Visual Media，2022（1）：1-38.
[23] LIU S，QI L，QIN H，et al.Path aggregation network for instance segmentation[C]//Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition，2018：8759-8768.
[24] SUN Y，XUE B，ZHANG M，et al.Evolving deep convolutional neural networks for image classification[J].IEEE Transactions on Evolutionary Computation，2019，24（2）：394-407.
[25] SUN Y，XUE B，ZHANG M，et al.Automatically designing CNN architectures using the genetic algorithm for image classification[J].IEEE Transactions on Cybernetics，2020，50（9）：3840-3854.
[26] NIKBAKHT S，ANITESCU C，RABCZUK T.Optimizing the neural network hyperparameters utilizing genetic algorithm[J].Journal of Zhejiang University（Science A），2021，22（6）：407-426.
[27] HHHHHHDOGE.fire smoke dataset[DB/OL].（2021-12-21）[2022-06-01].https：//www.kaggle.com/datasets/hhhhhhdoge/fire-smoke-dataset.