Improved NMS Algorithm for Text Detection in Natural Scenes

doi:10.3778/j.issn.1002-8331.2007-0436

Abstract

Abstract: In recent years, the convolutional neural network algorithm has greatly improved the natural scene text detection effect compared with the traditional algorithm, but how to effectively deal with the neural network output layer candidate box is still worthy of study. The traditional non-maximum suppression（NMS） algorithm selects the highest confidence candidate box as the detection result, and it is often easy to fail to detect longer text and aliased text regions. Considering this problem, the set of candidate box can be sorted, filtered, and fused to obtain a more precise candidatebox, which effectively reduces the detection failure. This method can be directly embedded in the original method without changing the network structure or adding any training amount. By conducting experiments on public datasets and comparing with other methods, this method has great advantages.

Key words: natural scene text detection, convolutional neural network（CNN）, non-maximum suppression（NMS）, order filtering, fusion computing

摘要： 近些年来，卷积神经网络算法在自然场景文本检测效果上较传统算法已经有了很大提升，但如何有效处理神经网络输出层候选框仍然值得研究。非极大值抑制算法（non-maximum suppression，NMS）通过选择最高置信度候选框作为检测结果，往往容易对较长文本以及混叠文本区域检测失效。考虑到该问题，可以将候选框集合进行排序滤波与融合计算，得到更准确的候选框，有效减少上述检测失效的情况。这种方法，可以直接嵌入原有方法中，而不需要改变网络结构或者增加任何训练量。通过在公开数据集上进行实验，对比其他方法，该方法有较大优势。

关键词: 自然场景文本检测, 卷积神经网络, 非极大值抑制, 排序滤波, 融合计算

YANG Youwei, ZHOU Gang. Improved NMS Algorithm for Text Detection in Natural Scenes[J]. Computer Engineering and Applications, 2022, 58(1): 204-208.

杨有为, 周刚. 面向自然场景文本检测的改进NMS算法[J]. 计算机工程与应用, 2022, 58(1): 204-208.

References

[1] 白翔，庞彦伟，章国锋.计算机视觉中的深度学习专题（2020）简介[J].中国科学（信息科学），2020（2）：303-304.BAI X，PANG Y W，ZHANG G F.Introduction to the topic of deep learning in computer vision（2020）[J].Science in China（Information Science），2020（2）：303-304.
[2] LIU W，ANGUELOV D，ERHAN D，et al.SSD：Single shot multibox detector[C]//Proceedings of European Conference on Computer Vision，2016：21-37.
[3] REDMON J，DIVVALA S K，GIRSHICK R，et al.You only look once：Unified，real-time object detection[C]//Proceedings of Conference on Computer Vision and Pattern Recognition，2016：779-788.
[4] LAW H，DENG J.CornerNet：Detecting objects as paired keypoints[C]//Proceedings of European Conference on Computer Vision，2018：765-781.
[5] REN S，HE K，GIRSHICK R，et al.Faster R-CNN：Towards real-time object detection with region proposal networks[C]//Proceedings of Conference on Neural Information Processing Systems，2015：91-99.
[6] DAI J，LI Y，HE K，et al.R-FCN：Object detection via region-based fully convolutional networks[C]//Proceedings of Conference on Computer Vision and Pattern Recognition，2016.
[7] DAI J，QI H，XIONG Y，et al.Deformable convolutional networks[C]//Proceedings of International Conference on Computer Vision，2017：764-773.
[8] HE K，GKIOXARI G，DOLLAR P，et al.Mask R-CNN[C]//Proceedings of International Conference on Computer Vision，2017：2980-2988.
[9] LI Z，PENG C，YU G，et al.Light-head R-CNN：In defense of two-stage object detector[C]//Proceedings of Conference on Computer Vision and Pattern Recognition，2017.
[10] LIAO M，SHI B，BAI X，et al.TextBoxes：A fast text detector with a single deep neural network[C]//Proceedings of International Conference on Artificial Intelligence，2017：4161-4167.
[11] JIANG Y，ZHU X，WANG X，et al.R2CNN：Rotational region CNN for orientation robust scene text detection[C]//Proceedings of Conference on Computer Vision and Pattern Recognition，2017.
[12] ZHOU X，YAO C，WEN H，et al.EAST：An efficient and accurate scene text detector[C]//Proceedings of Conference on Computer Vision and Pattern Recognition，2017：2642-2651.
[13] BODLA N，SINGH B，CHELLAPPA R，et al.Soft-NMS—improving object detection with one line of code[C]//Proceedings of International Conference on Computer Vision，2017：5562-5570.
[14] HE Y，ZHU C，WANG J，et al.Bounding box regression with uncertainty for accurate object detection[C]//Proceedings of 2019 IEEE/CVF Conference on Computer Vision and Pattern Recognition，2019.
[15] KARATZAS D，GOMEZBIGORDA L，NICOLAOU A，et al.ICDAR 2015 competition on robust reading[C]//Proceedings of International Conference on Document Analysis and Recognition，2015：1156-1160.
[16] HE K，ZHANG X，REN S，et al.Deep residual learning for image recognition[C]//Proceedings of Conference on Computer Vision and Pattern Recognition，2016：770-778.