Light-Weight Anchor Free Face Detection Based on Multi-Feature Fusion

doi:10.3778/j.issn.1002-8331.2011-0162

Abstract

Abstract: In view of the slow detection speed caused by the huge amount of computation and parameters in deep convolutional neural networks and the low accuracy by complex scenes in nowadays face detection, this paper presents an anchor-free face detection algorithm combing light-weight backbone and multi-feature fusion. The method firstly constructs a light-weight convolutional neural network as the backbone for feature extraction. Then three different modules are used to process the feature fusion：receptive field enhancement module to strengthen image information extraction, weighted feature fusion module to improve detection accuracy, channel shuffle fusion module to simplify the detection head. Finally, the center point anchor-free detection method is used to calculate the fused features and predict the position of faces. The experimental results show that the final model parameter is only 5.1?MB. The detection accuracy of easy, medium and hard in WIDERFACE verification set are improved by 1.4, 2.2 and 4.8 percentage points respectively compared with the benchmark method, which shows that the method has high accuracy in complex scenes face detection with a light-weight model and verifies the efficiency of the proposed method.

Key words: face detection, feature fusion, anchor free detection, light-weight neural network

摘要： 针对大多数基于深度卷积网络的人脸检测方法存在因模型参数和计算量大造成的检测速度慢，以及复杂场景下人脸检测准确率低的问题，提出一种基于多特征融合的轻量化无锚人脸检测方法。构造轻量化卷积神经网络作为特征提取的骨干网络，以加速网络计算过程；引入三种模块处理并融合特征层，包括：感受野增强模块强化图片信息提取、权重特征融合模块提升检测准确性以及通道混洗融合模块简化计算过程；使用中心点定位的无锚检测方法对融合后的特征进行预测。实验结果显示，该方法模型参数量仅为5.1?MB，对比该基准方法，在WIDERFACE验证集中的简单、中等和困难难度的检测准确率分别提升1.4、2.2和4.8个百分点，表明该方法在保证模型轻量化的同时对复杂场景人脸有着较高的检测精度，验证了所提方法的有效性。

关键词: 人脸检测, 特征融合, 无锚检测, 轻量化神经网络

HUANG Siwei, LI Zhidan, CHENG Jixiang, LIU Andong. Light-Weight Anchor Free Face Detection Based on Multi-Feature Fusion[J]. Computer Engineering and Applications, 2022, 58(11): 242-249.

黄思维, 李志丹, 程吉祥, 刘安东. 基于多特征融合的轻量化无锚人脸检测方法[J]. 计算机工程与应用, 2022, 58(11): 242-249.

References

[1] 严严，陈日伟，王菡子.基于深度学习的人脸分析研究进展[J].厦门大学学报（自然科学版），2017，56（1）：13-24.
YAN Y，CHEN R W，WANG H Z.Recent advances on deep?learning?based face analysis[J].Journal of Xiamen University（Natural Science），2017，56（1）：13-24.
[2] 王庆伟，应自炉.一种基于Haar-Like T特征的人脸检测算法[J].模式识别与人工智能，2015，28（1）：35-41.
WANG Q W，YING Z L.A face detection algorithm based on Haar-Like T features[J].Pattern Recognition and Artificial Intelligence，2015，28（1）：35-41.
[3] 任克强，高晓林，谢斌.基于AFSA和PSO融合优化的AdaBoost人脸检测算法[J].小型微型计算机系统，2016，37（4）：861-865.
REN K Q，GAO X L，XIE B.AdaBoost face detection algorithm based on fusion optimization of AFSA and PSO[J].Journal of Chinese Computer Systems，2016，37（4）：861-865.
[4] 常亮，邓小明，周明全.图像理解中的卷积神经网络[J].自动化学报，2016，42（9）：1300-1312.
CHANG L，DENG X M，ZHOU M Q.Convolutional neural networks in image understanding[J].Acta Automatica Sinica，2016，42（9）：1300-1312.
[5] 李旭冬，叶茂，李涛.基于卷积神经网络的目标检测研究综述[J].计算机应用研究，2017，34（10）：2881-2886.
LI X D，YE M，LI T.Review of object detection based on convolutional neural networks[J].Application Research of Computers，2017，34（10）：2881-2886.
[6] SIMONYAN K，ZISSERMAN A.Very deep convolutional networks for large-scale image recognition[C]//Proceedings of the 3rd International Conference on Learning Representations，San Diego，May 7-9，2015.
[7] HE K，ZHANG X，REN S，et al.Deep residual learning for image recognition[C]//Proceedings of the 2016 IEEE Conference on Computer Vision and Pattern Recognition，June 17-30，2016：770-778.
[8] HOWARD A G，ZHU M，CHEN B，et al.MobileNets：efficient convolutional neural networks for mobile vision applications[J].arXiv：1704.04861，2017.
[9] ZHANG X，ZHOU X，LIN M，et al.ShuffleNet：an extremely efficient convolutional neural network for mobile devices[C]//Proceedings of the 2018 IEEE/CVF Conference on Computer Vision and Pattern Recognition，June 18-23，2018：6848-6856.
[10] REDMON J，DIVVALA S，GIRSHICK R，et al.You only look once：unified，real-time object detection[C]//2016 IEEE Conference on Computer Vision and Pattern Recognition，New York，2016：779-788.
[11] GIRSHICK R，DONAHUE J，DARRELL T，et al.Region-based convolutional networks for accurate object detection and segmentation[J].IEEE Transactions on Pattern Analysis and Machine Intelligence，2016，38（1）：142-158.
[12] NAJIBI M，SAMANGOUEI P，CHELLAPPA R，et al.SSH：single stage headless face detector[C]//Proceedings of the 2017 IEEE International Conference on Computer Vision，Oct 22-29，2017：4885-4894.
[13] DENG J，GUO J，VERVERAS E，et al.Retinaface：single-shot multi-level face localisation in the wild[C]//Proceedings of the 2020 IEEE/CVF Conference on Computer Vision and Pattern Recognition，June 13-19，2020：5202-5211.
[14] LAW H，DENG J.CornerNet：detecting objects as paired keypoints[J].International Journal of Computer Vision，2020，128（3）：642-656.
[15] ZHOU X，ZHUO J，KRAHENBUHL P.Bottom-up object detection by grouping extreme and center points[C]//Proceedings of the 32nd IEEE/CVF Conference on Computer Vision and Pattern Recognition，Long Beach，CA，June 16-20，2019：850-859.
[16] ZHANG K，ZHANG Z，LI Z，et al.Joint face detection and alignment using multitask cascaded convolutional networks[J].IEEE Signal Processing Letters，2016，23（10）：1499-1503.
[17] SIFRE L，MALLAT S.Rigid-motion scattering for texture classification[J].arXiv：1403.1687，2014.
[18] HU J，SHEN L，ALBANIE S，et al.Squeeze-and-excitation networks[J].IEEE Transactions on Pattern Analysis and Machine Intelligence，2020，42（8）：2011-2023.
[19] LIN T Y，DOLLAR P，GIRSHICK R，et al.Feature pyra-mid networks for object detection[C]//30th IEEE Conference on Computer Vision and Pattern Recognition，New York，2017：936-944.
[20] LIN T Y，GOYAL P，GIRSHICK R，et al.Focal loss for dense object detection[C]//IEEE International Conference on Computer Vision，New York，2017：2999-3007.
[21] REZATOFIGHI H，TSOI N，GWAK J，et al.Generalized intersection over union：a metric and a loss for bounding box regression[C]//Proceedings of the 2019 IEEE/CVF Conference on Computer Vision and Pattern Recognition（CVPR），June 15-20，2019：658-666.
[22] YANG S，LUO P，LOY C C，et al.WIDER FACE：a face detection benchmark[C]//Proceedings of the 29th IEEE Conference on Computer Vision and Pattern Recognition，Las Vegas，June 26-July 1，2016：5525-5533.
[23] YANG S，LUO P，LOY C C，et al.From facial parts responses to face detection：a deep learning approach[C]//Proceedings of the 15th IEEE International Conference on Computer Vision，Santiago，December 11-18，2015：3676-3684.
[24] OHN-BAR E，TRIVEDI M M.To boost or not to boost? on the limits of boosted trees for object detection[C]//Proceedings of the 23rd International Conference on Pattern Recognition，Cancun，December 4-8，2016：3350-3355.
[25] YANG S，XIONG Y，LOY C C，et al.Face detection through scale-friendly deep convolutional networks[J].arXiv：1706.02863，2017.
[26] 李静，降爱莲.复杂场景下基于R-FCN的小人脸检测研究[J].计算机工程与应用，2020，56（1）：203-208.
LI J，JIANG A L.Research on small face detection based on R-FCN in complex scenes[J].Computer Engineering and Applications，2020，56（1）：203-208.