Research on Traffic Sign Recognition Based on CA-ASFF-YOLOv4

doi:10.3778/j.issn.1002-8331.2206-0258

Abstract

Abstract: Traffic sign detection is the core technology of intelligent transportation system. A traffic sign recognition algorithm CA-ASFF-YOLOv4 based on improved YOLOv4 model is presented to solve the problem of low recognition accuracy due to small overall target, multiscale distribution and complex image background of traffic signs in real traffic environment. The algorithm removes the depth feature layer used to detect large targets, introduces a high-resolution feature layer, and adds the attention mechanism CA module after each feature layer, which effectively enhances the feature extraction of small targets from the backbone network. At the same time, the adaptive feature fusion ASFF is used in the neck network instead of the original route aggregation network PAnet to solve the problem of variable target scales by optimizing the feature fusion. It reduces the stacking of residual blocks, suppresses background overlap, and improves the detection accuracy in complex background. The experimental results show that mAP@0.5 of CA-ASFF-YOLOv4 on TT100K traffic sign dataset reaches 91.47%, which is 9 percentage points higher than YOLOv4, and it further improves the recognition accuracy of traffic signs in practical applications.

Key words: traffic sign recognition, YOLOv4, attention mechanism, adaptive feature fusion

摘要： 交通标志识别是智能交通系统的核心技术。针对实际情况下，交通标志总体目标小且呈现多尺度分布、图像背景复杂，造成识别精度低的问题，提出了一种基于改进YOLOv4模型的交通标志识别算法CA-ASFF-YOLOv4。算法去除用于检测大目标的深度特征层，引入高分辨率特征层，并在各个特征层后添加注意力机制CA模块，有效加强了主干网络对小目标的特征提取。在颈部网络使用自适应特征融合ASFF代替原有的路径聚合网络PAnet，通过优化特征融合解决目标尺度多变的问题。减少残差块的堆叠，抑制背景重复叠加，提高复杂背景下的检测精度。实验结果表明，CA-ASFF-YOLOv4在TT100K 交通标志数据集上的mAP@0.5达到了91.47%，比YOLOv4提升了9个百分点，显著提高了实际应用场合中交通标志的检测精度。

关键词: 交通标志识别, YOLOv4, 注意力机制, 自适应特征融合

LENG Kun, QIN Lunming, WANG Xi. Research on Traffic Sign Recognition Based on CA-ASFF-YOLOv4[J]. Computer Engineering and Applications, 2023, 59(17): 169-177.

冷坤, 秦伦明, 王悉. 基于CA-ASFF-YOLOv4的交通标志识别研究[J]. 计算机工程与应用, 2023, 59(17): 169-177.

References

[1] 陈飞，刘云鹏，李思远.复杂环境下的交通标志检测与识别方法综述[J].计算机工程与应用，2021，57（16）：65-73.
CHEN F，LIU Y P，LI S Y.Survey of traffic sign detection and recognition methods in complex environment[J].Computer Engineering and Applications，2021，57（16）：65-73.
[2] BENALLAL M，MEUNIER J.Real-time color segmentation of road signs[C]//Canadian Conference on Electrical and Computer Engineering，2003：1823-1826.
[3] 沙莎，肖学钢.一种多通道融合的交通标志检测方法[J].计算机工程，2009，35（6）：202-204.
SHA S，XIAO X G.Traffic sign detection method with multi-channel integration[J].Computer Engineering，2009，35（6）：202-204.
[4] BARNES N，LOY G.Regular polygon detection[C]//10th IEEE International Conference on Computer Vision，2005：778-785.
[5] STEFANO L D，MATTOCCIA S，TOMBARI F.ZNCC-based template matching using bounded partial correlation[J].Pattern Recognition Letters，2005，26（14）：2129-2134.
[6] HUANG G，ZHU Q，SIEW C.Extreme learning machine：a new learning scheme of feedforward neural networks[C]//2004 IEEE International Joint Conference on Neural Networks，2004：985-990.
[7] GIRSHICK R，DONAHUE J，DARRELL T，et al.Rich feature hierarchies for accurate object detection and semantic segmentation[C]//2014 IEEE Conference on Computer Vision and Pattern Recognition，2014：580-587.
[8] GIRSHICK R.Fast R-CNN[C]//2015 IEEE International Conference on Computer Vision，2015：1440-1448.
[9] REN S Q，HE K M，GIRSHICK R，et al.Faster RCNN：towards real-time object detection with region proposal networks[J].IEEE Transactions on Pattern Analysis and Machine Intelligence，2017，39（6）：1137-1149.
[10] REDMON J，FARHADI A.YOLOV3：an incremental improvement[C]//Proceedings of 2018 IEEE Conference on Computer Vision and Pattern Recognition.Washington DC，USA：IEEE Press，2018：1-6.
[11] BOCHKOVSKIY A，WANG C Y，LIAO H Y M.Yolov4：optimal speed and accuracy of object detection[J].arXiv：2004.10934，2020.
[12] LIN T Y，GOYAL P，GIRSHICK R，et al.Focal loss for dense object detection[C]//Proceedings of the IEEE International Conference on Computer Vision，2017：2999-3007.
[13] LIU W，ANGUELOV D，ERHAN D，et al.SSD：single shot multibox detector[C]//European Conference on Computer Vision.Cham：Springer，2016：21-37.
[14] CIRESAN D，MEIER U，MASCI J，et al.Multicolumn deep neural network for traffic sign classification[J].Neural Networks，2012，32：333-338.
[15] NATARAJAN S，ANNAMRAJU A K，BARADKAR C S.Traffic sign recognition using weighted multi-convolutional neural network[J].IET Intelligent Transport Systems，2018，12（10）：1396-1405.
[16] ZHANG H，QIN L，LI J，et al.Real-time detection method for small traffic signs based on Yolov3[J].IEEE Access，2020，8：64145-64156.
[17] HE K，ZHANG X，REN S，et al.Spatial pyramid pooling in deep convolutional networks for visual recognition[J].IEEE Transactions on Pattern Analysis and Machine Intelligence，2015，37（9）：1904-1916.
[18] WANG W，XIE E，SONG X，et al.Efficient and accurate arbitrary-shaped text detection with pixel aggregation network[C]//Proceedings of the IEEE/CVF International Conference on Computer Vision.Piscataway：IEEE，2019：8440-8449.
[19] HOU Q，ZHOU D，FENG J.Coordinate attention for efficient mobile network design[J].arXiv：2103.02907，2021.
[20] LIU S，HUANG D，WANG Y.Learning spatial fusion for single-shot object detection[J].arXiv：1911.09516，2019.
[21] ZHU Z，LIANG D，ZHANG S，et al.Traffic-sign detection and classification in the wild[C]//2016 IEEE Conference on Computer Vision and Pattern Recognition.Piscataway：IEEE Press，2016.
[22] KISANTAL M，WOJNA Z，MURAWSKI J，et al.Augmentation for small object detection[C]//9th International Conference on Advances in Computing and Information Technology，2019：1-8.
[23] LIU Z，LIN Y T，CAO Y，et al.Swin transformer：hierarchical vision transformer using shifted windows[J].arXiv：2103.14030，2021.
[24] ZHU B，WANG J，JIANG Z，et al.AutoAssign：differentiable label assignment for dense object detection[J].arXiv：2007.03496，2020.