Improved Road Damage Detection Algorithm of YOLOv8

doi:10.3778/j.issn.1002-8331.2306-0205

Abstract

Abstract: Road damage detection is an important task to ensure road safety and realize timely repair of road damage. Aiming at the problems of low detection efficiency, high cost and difficulty in applying to mobile terminal devices in existing Road Damage detection algorithms, a lightweight road damage detection algorithm YOLOV8-Road Damage（YOLOV8-RD） with improved YOLOv8 is proposed. First, combining the advantages of CNN and Transformer, a BOT module that can extract global and local feature information of road damage images is proposed to adapt to the large-span and elongated features of crack objects. Then, coordinate attention（CA） is introduced in the end of backbone network and neck network to embed the location information into the channel attention, strengthen the feature extraction ability, and suppress the interference of irrelevant features. In addition, C2fGhost module is used in YOLOv8 neck network to reduce floating point computation in feature channel fusion process, reduce the number of model parameters, and improve feature expression performance. The experimental results show that in RDD2022 data set and Road Damage data set, the improved algorithm is 2% and 3.7% higher than the original algorithm compared with mAP50, while the number of model parameters is only 2.8×106 and the computation amount is only 7.3×109, which are reduced by 6.7% and 8.5% respectively. The detection speed of the algorithm reaches 88 FPS, which can accurately detect the road damage target in real time. Compared with other mainstream target detection algorithms, the effectiveness and superiority of this method are verified.

Key words: road damage detection, deep learning, YOLOv8, attention mechanism, Transformer

摘要： 道路损伤检测是保障道路安全、实现道路损伤及时修复的一项重要任务。针对现有的道路损伤检测算法中检测效率低、成本高昂、难以应用于移动终端设备问题，提出了一种改进YOLOv8的轻量型道路损伤检测算法YOLOv8-Road Damage（YOLOv8-RD）。结合CNN和Transformer的优势，提出了一种能够提取道路损伤图像全局特征信息和局部特征信息的BOT模块，以适应裂纹对象的大跨度与细长特征。在骨干网络末端和颈部网络中引入坐标注意力机制（coordinate attention，CA），将位置信息嵌入到通道注意力中，强化特征提取能力，并抑制无关特征的干扰。在YOLOv8颈部网络中使用C2fGhost模块，以减少特征通道融合过程中的浮点运算量，降低模型参数量，同时提高特征表达性能。实验结果表明，在RDD2022数据集和Road Damage数据集上，改进算法与原算法相比mAP50分别提高了2个百分点和3.7个百分点，而模型参数量仅为2.8×106，计算量仅为7.3×109，分别降低了6.7%和8.5%。算法检测速度达到88?FPS，能够实时准确检测道路损伤目标。通过与其他主流目标检测算法比较，验证了该方法的有效性和优越性。

关键词: 道路损伤检测, 深度学习, YOLOv8, 注意力机制, Transformer

LI Song, SHI Tao, JING Fangke. Improved Road Damage Detection Algorithm of YOLOv8[J]. Computer Engineering and Applications, 2023, 59(23): 165-174.

李松, 史涛, 井方科. 改进YOLOv8的道路损伤检测算法[J]. 计算机工程与应用, 2023, 59(23): 165-174.

References

[1] 初秀民，严新平，陈先桥.路面破损图像二值化方法研究[J].计算机工程与应用，2008，44（28）：161-165．
CHU X M，YAN X P，CHEN X Q.Study of pavement surface distress image binarization[J].Computer Engineering and Applications，2008，44（28）：161-165.
[2] 韩锟，韩洪飞.基于区域级和像素级特征的路面裂缝检测方法[J].铁道科学与工程学报，2018，15（5）：1178-1186.
HAN K，HAN H F.Pavement crack detection method based on region-level and pixel-level features[J].Journal of Railway Science and Engineering，2018，15（5）：1178-1186.
[3] KANG D，BENIPAL S S，GOPAL D L，et al.Hybrid pixel-level concrete crack segmentation and quantification across complex backgrounds using deep learning[J].Automation in Construction，2020，118：103291.
[4] YAMAGUCHI T，MIZUTANI T.Quantitative road crack evaluation by a U-Net architecture using smartphone images and Lidar data[J].Computer-Aided Civil and Infrastructure Engineering，2022：13071.
[5] 李科岑，王晓强，林浩，等.深度学习中的单阶段小目标检测方法综述[J].计算机科学与探索，2022，16（1）：41-58.
LI K C，WANG X Q，LIN H，et al.Survey of one-stage small object detection methods in deep learning[J].Journal of Frontiers of Computer Science and Technology，2022，16（1）：41-58.
[6] 黄凯枫，张博熠，王梦，等.基于改进SSD模型的路面病害识别算法研究[J].江苏科技大学学报（自然科学版），2023，37（2）：53-60.
HUANG K F，ZHANG B Y，WANG M，et al.Research on pavement disease recognition algorithm based on improved SSD model[J].Journal of Jiangsu University of Science and Technology（Natural Science Edition），2023，37（2）：53-60.
[7] 安学刚，党建武，王阳萍，等.基于改进YOLOv4的无人机影像路面病害检测方法[J].无线电工程，2023，53（6）：1285-1294.
AN X G，DANG J W，WANG Y P，et al.UAV image pavement disease detection based on improved YOLOv4[J].Radio Engineering，2023，53（6）：1285-1294.
[8] YU G，ZHOU X L.An improved YOLOv5 crack detection method combined with a bottleneck Transformer[J].Mathematics，2023，11（10）：2377.
[9] 倪昌双，李林，罗文婷，等.改进YOLOv7的沥青路面病害检测[J].计算机工程与应用，2023，59（13）：305-316.
NI C S，LI L，LUO W T，et al.Disease detection of asphalt pavement based on improved YOLOv7[J].Computer Engineering and Applications，2023，59（13）：305-316.
[10] SRINIVAS A，LIN T Y.Bottleneck Transformers for visual recognition[C]//Proceedings of the IEEE/CVF Conference on Computer Vision and Pattern Recognition，2021：16519-16529.
[11] HOU Q，ZHOU D，FENG J.Coordinate attention for efficient mobile network design[C]//Proceedings of the IEEE/CVF Conference on Computer Vision and Pattern Recognition，2021：13713-13722.
[12] HAN K，WANG Y，TIAN Q，et al.Ghostnet：more features from cheap operations[C]//Proceedings of the IEEE/CVF Conference on Computer Vision and Pattern Recognition，2020：1580-1589.
[13] REDMON J，DIVVALA S，GIRSHICK R，et al.You only look once：unified，real-time object detection[C]//Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition，2016：779-788.
[14] REDMON J，FARHADI A.YOLO9000：better，faster，stronger[C]//Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition，2017：7263-7271.
[15] REDMON J，FARHADI A.YOLOv3：an incremental improvement[J].arXiv：1804.02767，2018.
[16] BOCHKOVSKIY A，WANG C Y，LIAO H Y M.YOLOv4：optimal speed and accuracy of object detection[J].arXiv：2004.10934，2020.
[17] 王鹏飞，黄汉明，王梦琪.改进YOLOv5的复杂道路目标检测算法[J].计算机工程与应用，2022，58（17）：81-92.
WANG P F，HUANG H M，WANG M Q.Complex road target detection algorithm based on improved YOLOv5[J].Computer Engineering and Applications，2022，58（17）：81-92.
[18] WANG C Y，BOCHKOVSKIY A，LIAO H Y M.YOLOv7：trainable bag-of-freebies sets new state-of-the-art for real-time object detectors[C]//Proceedings of the IEEE/CVF Conference on Computer Vision and Pattern Recognition，2023：7464-7475.
[19] DOSOVITSKIY A，BEYER L，KOLESNIKOV A，et al.An image is worth 16x16 words：transformers for image recognition at scale[J].arXiv：2010.11929，2020.
[20] ARYA D，MAEDA H，GHOSH S K，et al.Crowdsensing-based road damage detection challenge（CRDDC’2022）[C]//2022 IEEE International Conference on Big Data（Big Data），2022：6378-6386.