Lightweight DCN-YOLO for Strip Surface Defect Detection in Complex Environments

doi:10.3778/j.issn.1002-8331.2303-0100

Abstract

Abstract: At present, deep learning-based intelligent defect detection technologies has gradually penetrated the traditional steel manufacturing industry. To address the challenge of deploying high-precision models in resource constrained edge devices, a lightweight DCN-YOLO model for strip surface defect detection in complex environment is proposed. The model combines the deformable convolutional network（DCN） with the original YOLOv5 to improve the sensitivity of the model to defects of different sizes and shapes. At the same time, two lightweight modules, depth-wise separable convolution（DSConv） and efficient channel attention（ECA）, are introduced into YOLO model. These two modules enable the model to better understand the relationship between each channel in the input data, thus improving the detection accuracy and generalization ability of the model, and greatly reducing the complexity of the model. Then, the effectiveness of each innovation module is verified through ablation experiment and horizontal comparative experiment. Finally, a classic open source strip data set NEU-DET and an actual industrial strip data set are used to verify the effectiveness of the proposed model.

Key words: strip surface defect detection, deformable convolutional network, depthwise separable convolution, efficient channel attention, lightweight YOLOv5, image preprocessing

摘要： 基于深度学习的智能检测技术逐渐在复杂钢铁生产环境带钢表面缺陷检测过程中使用。为了应对在资源受限的边缘设备中部署高精度模型的挑战，提出一个面向复杂环境中带钢表面缺陷检测的轻量级DCN-YOLO模型，该模型将可形变卷积网络DCN与原始YOLOv5结合，以提高模型对不同尺寸和形状缺陷的灵敏度。为降低计算复杂度，在YOLO模型中引入了深度可分离卷积DSConv和高效通道注意力机制ECA两个轻量级模块，使模型更好地理解输入数据中各个通道之间的关系，在提高模型的检测精度和泛化能力的同时，大幅降低模型的计算量。进一步通过消融实验及横向对比实验，验证了每个创新模块的有效性。通过经典的开源带钢数据集NEU-DET和实际工业带钢数据集分别验证了轻量级DCN-YOLO模型在表面缺陷检测精度和计算复杂度方面的优势。

关键词: 带钢表面缺陷检测, 可形变卷积网络, 深度可分离卷积, ECA通道注意力, 轻量级YOLOv5, 图像预处理

LU Junzhe, ZHANG Chengyi, LIU Shipeng, NING Dejun. Lightweight DCN-YOLO for Strip Surface Defect Detection in Complex Environments[J]. Computer Engineering and Applications, 2023, 59(15): 318-328.

卢俊哲, 张铖怡, 刘世鹏, 宁德军. 面向复杂环境中带钢表面缺陷检测的轻量级DCN-YOLO[J]. 计算机工程与应用, 2023, 59(15): 318-328.

References

[1] 汤勃，孔建益，伍世虔.机器视觉表面缺陷检测综述[J].中国图象图形学报，2017，22（12）：24.
TANG B，KONG J Y，WU S Q.Review of surface defect detection based on machine vision[J].Journal of Image and Graphics，2017，22（12）：24.
[2] 熊红林，樊重俊，赵珊，等.基于多尺度卷积神经网络的玻璃表面缺陷检测方法[J].计算机集成制造系统，2020，26（4）：900-909.
XIONG H L，FAN C J，ZHAO S，et al.Glass surface defect detection method based on multiscale convolution neural network[J].Computer Integrated Manufacturing Systems，2020，26（4）：900-909.
[3] 刘珈彤，余建波.晶圆表面缺陷模式识别的二维主成分分析卷积自编码器[J].计算机辅助设计与图形学学报，2020，32（3）：425-436.
LIU J T，YU J B.Recognition of wafer defect based on two-dimensional principal component analysis based convolutional autoencoder[J].Journal of Computer-Aided Design & Graphics，2020，32（3）：425-436.
[4] 马燕婷，赵红东，阎超，等.改进YOLOv5网络的带钢表面缺陷检测方法[J].电子测量与仪器学报，2022，36（8）：150-157.
MA Y T，ZHAO H D，YAN C et al.Strip steel surface defect detection method by improved YOLOv5 network[J].Journal of Electronic Measurement and Instrumentation，2022，36（8）：150-157.
[5] HUMMEL R.Image enhancement by histogram transformation[J].Computer Graphics and Image Processing，1977，6（2）：184-195.
[6] PIZER S M，AMBURN E P，AUSTIN J D，et al.Adaptive histogram equalization and its variations[J].Computer Vision，Graphics and Image Processing，1987，39（3）：355-368.
[7] KIM T K，PAIK J K，KANG B S.Contrast enhancement system using spatially adaptive histogram equalization with temporal filtering[J].IEEE Transactions on Consumer Electronics，1998，44（1）：82-87.
[8] REZA A M.Realization of the contrast limited adaptive histogram equalization（CLAHE） for real-time image enhancement[J].Journal of VLSI Signal Processing Systems for Signal，Image and Video Technology，2004，38（1）：35-44.
[9] LAND E H.The retinex theory of color vision[J].Scientific American，1977，237（6）：108-129.
[10] BUCHSBAUM G.A spatial processor model for object colour perception[J].Journal of the Franklin Institute，1980，310（1）：1-26.
[11] WENG C C，CHEN H，FUH C S.A novel automatic white balance method for digital still cameras[C]// IEEE International Symposium on Circuits and Systems（ISCAS），2005：3801-3804.
[12] LAND E H，MCCANN J J.Lightness and retinex theory[J].JOSA，1971，61（1）：1-11.
[13] RAHMAN Z，JOBSON D J，WOODELL G A.Multi-scale retinex for color image enhancement[C]//Proceedings of 3rd IEEE International Conference on Image Processing，1996：1003-1006.
[14] JOBSON D J，RAHMAN Z，WOODELL G A.A multiscale retinex for bridging the gap between color images and the human observation of scenes[J].IEEE Transactions on Image Processing，1997，6（7）：965-976.
[15] REN S，HE K，GIRSHICK R，et al.Faster R-CNN：towards real-time object detection with region proposal networks[J].IEEE Transactions on Pattern Analysis and Machine Intelligence，2016，39（6）：1137-1149.
[16] ZHANG Z，QIAO S，XIE C，et al.Single-shot object detection with enriched semantics[C]//Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition，2018：5813-5821.
[17] REDMON J，FARHADI A.YOLOv3：an incremental improvement[J].arXiv：1804.02767，2018.
[18] PARK J K，KWON B K，PARK J H，et al.Machine learning-based imaging system for surface defect inspection[J].International Journal of Precision Engineering and Manufacturing-Green Technology，2016，3（3）：303-310.
[19] SONG L，LIN W，YANG Y G，et al.Weak micro-scratch detection based on deep convolutional neural network[J].IEEE Access，2019，7：27547-27554.
[20] REN Q，GENG J，LI J.Slighter faster R-CNN for real-time detection of steel strip surface defects[C]//2018 Chinese Automation Congress（CAC），2018：2173-2178.
[21] WEI R，SONG Y，ZHANG Y.Enhanced faster region convolutional neural networks for steel surface defect detection[J].ISIJ International，2020，60（3）：539-545.
[22] HAN C，LI G，LIU Z.Two-stage edge reuse network for salient object detection of strip steel surface defects[J].IEEE Transactions on Instrumentation and Measurement，2022，71：1-12.
[23] 刘艳菊，王秋霁，张惠玉，等.基于改进SSD的工件表面缺陷检测[J/OL].热加工工艺：1-6[2023-03-12].DOI：10.14158/j.cnki.1001-3814.20211221.
LIU Y J，WANG Q J，ZHANG H Y，et at.Defect detection of workpiece surface based on improved SSD[J/OL].Hot Working Technology：1-6[2023-03-12].DOI：10.14158/j.cnki.1001-3814.20211221.
[24] LI Y，HUANG H，XIE Q，et al.Research on a surface defect detection algorithm based on MobileNet-SSD[J].Applied Sciences，2018，8（9）：1678.
[25] LI J，SU Z，GENG J，et al.Real-time detection of steel strip surface defects based on improved YOLO detection network[J].IFAC-Papers OnLine，2018，51（21）：76-81.
[26] LI M，WANG H，WAN Z.Surface defect detection of steel strips based on improved YOLOv4[J].Computers and Electrical Engineering，2022，102：108208.
[27] 张涛源，谢新林，谢刚，等.融合Transformer的带钢缺陷实时检测算法[J/OL].计算机工程与应用：1-10[2023-03-26].http：//kns.cnki.net/kcms/detail/11.2127.TP.20230214.1441.
032.html.
ZHANG T Y，XIE X L，XIE G，et at.Real-time strip defect detection algorithm fused with Transformer[J/OL].Computer Engineering and Applications：1-10[2023-03-26].http：//kns.cnki.net/kcms/detail/11.2127.TP.20230214.1441.
032.html.
[28] DAI J，QI H，XIONG Y，et al.Deformable convolutional networks[C]//Proceedings of the IEEE International Conference on Computer Vision，2017：764-773.
[29] WANG W，DAI J，CHEN Z，et al.Internimage：exploring large-scale vision foundation models with deformable convolutions[J].arXiv：2211.05778，2022.
[30] CAO D，CHEN Z，GAO L.An improved object detection algorithm based on multi-scaled and deformable convolutional neural networks[J].Human-centric Computing and Information Sciences，2020，10（1）：1-22.
[31] ZHANG C，KIM J.Object detection with location-aware deformable convolution and backward attention filtering[C]//Proceedings of the IEEE/CVF Conference on Computer Vision and Pattern Recognition，2019：9452-9461.
[32] WANG J，XU C，YANG Z，et al.Deformable convolutional networks for efficient mixed-type wafer defect pattern recognition[J].IEEE Transactions on Semiconductor Manufacturing，2020，33（4）：587-596.
[33] ZHAO W，CHEN F，HUANG H，et al.A new steel defect detection algorithm based on deep learning[J].Computa-tional Intelligence and Neuroscience，2021：1-13.
[34] ZHOU S，ZENG Y，LI S，et al.Surface defect detection of rolled steel based on lightweight model[J].Applied Sciences，2022，12（17）：8905.
[35] 叶卓勋，刘妹琴，张森林.基于轻量化深度学习网络的工业环境小目标缺陷检测[J/OL].控制与决策：1-8[2023-03-26].https：//kns.cnki.net/kcms/detail//21.1124.tp.20230117.
1257.003.html.
YE Z X，LIU M Q，ZHANG S L.Small-scale defect detection in industrial environment based on lightweight deep learning network[J/OL].Control and Decision：1-8[2023-03-26].https：//kns.cnki.net/kcms/detail//21.1124.tp.20230117.1257.003.html.
[36] WANG C，SUN M，CAO Y，et al.Lightweight network-based surface defect detection method for steel plates[J].Sustainability，2023，15（4）：3733.
[37] WANG C Y，LIAO H Y M，WU Y H，et al.CSPNet：a new backbone that can enhance learning capability of CNN[C]//Proceedings of the IEEE/CVF Conference on Computer Vision and Pattern Recognition Workshops，2020：390-391.
[38] CHOLLET F.Xception：deep learning with depthwise separable convolutions[C]//Proceedings of the IEEE Con-ference on Computer Vision and Pattern Recognition，2017：1251-1258.
[39] WANG Q，WU B，ZHU P，et al.ECA-Net：efficient channel attention for deep convolutional neural networks[C]//IEEE/CVF Conference on Computer Vision and Pattern Recognition（CVPR），2020：11531-11539.
[40] KIM Y T.Contrast enhancement using brightness preserving bi-histogram equalization[J].IEEE Transactions on Consumer Electronics，1997，43（1）：1-8.
[41] TOMASI C，MANDUCHI R.Bilateral filtering for gray and color images[C]//Sixth International Conference on Computer Vision，1998：839-846.
[42] HU J，SHEN L，SUN G.Squeeze-and-excitation net-works[C]//Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition，2018：7132-7141.
[43] ZHAO Z，LI B，DONG R，et al.A surface defect detection method based on positive samples[C]//Pacific Rim International Conference on Artificial Intelligence.Cham：Springer，2018：473-481.
[44] WANG C Y，BOCHKOVSKIY A，LIAO H.YOLOv7：trainable bag-of-freebies sets new state-of-the-art for real-time object detectors[J].arXiv：2207.02696，2022.