Learning Binary Semantic Embedding for Traffic Signs

doi:10.3778/j.issn.1002-8331.2203-0276

Abstract

Abstract: Traffic sign is an important component of traffic infrastructure. Autonomous vehicles in intelligent transportation systems need to recognize and understand traffic signs to ensure that their driving behavior is safe and comply with traffic laws and regulations. At present, deep neural networks are commonly used to recognize traffic signs. Deep neural network uses a large number of training samples to train neural network parameters and obtain the feature representation favorable to the task. However, massive training data will bring high retrieval cost. In view of the above problem, this paper presents a large-scale traffic signs based on binary semantic embedding retrieval and identification method named BETS. The proposed method embeds the label information and pairwise similarity into binary semantic space, and uses deep neural network in the Hash learning process. Experimental results show that the proposed method BETS can effectively improve the accuracy of large-scale traffic sign retrieval and recognition.

Key words: traffic sign image, binary code, deep neural network, label information

摘要： 交通标识是交通基础设施的重要组成。智能交通系统中的自动驾驶车辆需要识别和理解交通标识，以确保其驾驶行为安全和遵守交通法规。目前，交通标识的识别大都采用深度神经网络方法，利用大量的训练样本对神经网络参数进行训练，获得对任务有利的特征表示，然而，海量的训练数据将带来较高的检索成本。针对以上问题，提出一种基于二值语义嵌入的大规模交通标识检索与识别方法BETS，该方法将标签信息和成对相似性信息嵌入到二值语义空间中，同时使用深度神经网络来进行哈希学习。实验结果表明，该方法可以有效提升大规模交通标识检索与识别的精度和准确性。

关键词: 交通标识图像, 二值码, 深度神经网络, 标签信息

WANG Shaohua, LIU Fasheng, SHI Baiying, LIU Xingbo, NIE Xiushan. Learning Binary Semantic Embedding for Traffic Signs[J]. Computer Engineering and Applications, 2023, 59(13): 205-210.

王少华, 刘法胜, 时柏营, 刘兴波, 聂秀山. 面向交通标识的二值语义嵌入学习方法[J]. 计算机工程与应用, 2023, 59(13): 205-210.

References

[1] LUO Y D，YANG Y，SHEN F M，et al.Robust discrete code modeling for supervised Hashing[J].Pattern Recognition，2018，75：128-135.
[2] DASGUPTA A，KUMAR R，SARLóS T.Fast locality-sensitive Hashing[C]//Proceedings of ACM Sigkdd International Conference on Knowledge Discovery & Data Mining，2011：1073-1081.
[3] SHEN F M.SHEN C H，SHI Q F，et al.Hashing on nonlinear manifolds[J].IEEE Transactions on Image Processing，2015，24（6）：1839-1851.
[4] LAI Z H，CHEN Y D，WU J，et al.Jointly sparse Hashing for image retrieval[J].IEEE Transactions on Image Processing，2018，27（12）：6147-6158.
[5] SHEN F M，ZHOU X，YU J，et al.Scalable zero-shot learning via binary visual-semantic embeddings[J].IEEE Transactions on Image Processing，2019，28（7）：3662-3674.
[6] GIONIS A，INDYK P，MOTWANI R.Similarity search in high dimensions via Hashing[C]//Proceedings of International Conference on Very Large Data Bases，1999：518-529.
[7] ERCOLI S，BERTINI M，BIMBO A D.Compact Hash codes for efficient visual descriptors retrieval in large scale databases[J].IEEE Transactions on Multimedia，2017，19（11）：2521-2532.
[8] WEISS Y，TORRALBA A，FERGUS R.Spectral Hashing[C]//Proceedings of International Conference on Neural Information Processing Systems，2008：1753-1760
[9] GONG Y，LAZEBNIK S，GORDO A，et al.Iterative quantization：a procrustean approach to learning binary codes for large-scale image retrieval[J].IEEE Transactions on Pattern Analysis & Machine Intelligence，2013，35（12）：2916.
[10] DING G G，GUO Y C，ZHOU J L.Collective matrix factorization Hashing for multimodal data[C]//Proceedings of IEEE Conference on Computer Vision and Pattern Recognition（CVPR），2014：2083-2090.
[11] LIU W，WANG J，JI R R，et al.Supervised Hashing with kernels[C]//Proceedings of IEEE Conference on Computer Vision and Pattern Recognition，2012：2074-2081.
[12] MORAN S，LAVRENKO V，OSBORNE M.Variable bit quantisation for LSH[C]//Proceedings of Meeting of the Association for Computational Linguistics，2013：753-758.
[13] GUI J，LIU T L，SUN Z N，et al.Fast supervised discrete Hashing[J].IEEE Transactions on Pattern Analysis and Machine Intelligence，2018，40（2）：490-496.
[14] SHEN F M，SHEN C H，LIU W，et al.Supervised discrete Hashing[C]//Proceedings of IEEE Conference on Computer Visionand Pattern Recognition，2015：37-45.
[15] LUO X，WU Y，XU X S.Scalable supervised discrete Hashing for large?scale search[C]//Proceedings of 2018 World Wide Web Conference，2018：1603-1612.
[16] LUO X，NIE L Q，HE X N，et al.Fast scalable supervised Hashing[C]//Proceedings of International ACMSIGIR Conference on Research & Developmentin Information Retrieval，2018：735-744.
[17] BOLTE J，SABACH S，TEBOULLE M.Proximal alternating linearized minimization for nonconvex and nonsmooth problems[J].Mathematical Programming，2014，146（1/2）：459-494.
[18] LIU Q，LU H T.Natural supervised Hashing[C]//Proceedings of International Joint Conference on Artificial Intelligence，2016.
[19] GUI J，LI P.R2SDH：robust rotated supervised discrete Hashing[C]//Proceedings of the 24th ACM SIGKDD International Conference，2018.
[20] LIU X B，NIE X S，ZHOU Q，et al.Supervised short-length Hashing[C]//Proceedings of the 28th International Joint Conference on Artificial Intelligence，2019.
[21] LIU X B，NIE X S，ZHOU Q，et al.Supervised discrete Hashing with mutual linear regression[C]//Proceedings of the 27th ACM International Conference，2019.
[22] CHEN Y，TIAN Z B，ZHANG H，et al.Strongly constrained discrete Hashing[J].IEEE Transactions on Image Processing，2020，29：3596-3611.