Cross-Domain Face in Vivo Detection of Unilateral Adversarial Network Algorithm

doi:10.3778/j.issn.1002-8331.2210-0134

Abstract

Abstract: In the existing cross-domain face detection algorithms, the feature extraction process is prone to overfitting and lack of feature aggregation, resulting in insufficient generalization. To solve this problem, this paper proposes a unilateral adversarial network algorithm for cross-domain face in vivo detection. Firstly, grouping convolution and improved reciprocal residual structure are fused to replace ordinary convolution to reduce network parameters and enhance the expression ability of face fine-grained features, and an adaptive feature normalization module is introduced, emphasizing the face in vivo information region fade irrelevant background region in the image. Effectively it avoids the overfitting merging of live face information and enhances the ability of face detection from different source domains. Secondly, based on NetVLAD, the channel attention mechanism module is introduced. As a branch of feature aggregation network, the channel attention mechanism module learns the semantic information of local features in different source domains, effectively enhancing the generalization ability of face live information classification in different source domains. Finally, a two-module fusion network is designed to improve the accuracy of cross-domain face detection in unknown scenes. Experimental results on OULU-NPU, CASIA-FASD, MSU-MFSD, and Idiap Replay-Attack data sets show that, the proposes algorithm has good performance in cross-data set tests of O&C&M to I, O&C&I to M, I&C&M to O, and O&M&I to C. Among them, the performance evaluation indexes of O&C&I to M and O&M&I to C have improved the accuracy by 0.99 percentage points and 0.5 percentage points respectively.

Key words: domain generalization, generative adversarial networks, face liveness detection, adaptive normalization, attention mechanism

摘要： 现有跨域人脸活体检测算法，其特征提取过程容易发生过拟合和缺乏特征聚合所导致的泛化性不足问题。针对该问题，提出了跨域人脸活体检测的单边对抗网络算法，将分组卷积与改进的倒残差结构融合替换普通卷积，降低网络参数同时加强人脸细粒度特征的表达能力，并引入自适应特征归一化模块，强调图像中人脸活体信息区域淡化无关背景区域，有效避免人脸活体信息的过拟合并加强来自不同源域的人脸活体检测能力。基于NetVLAD引入通道注意力机制模块，通道注意力机制模块作为特征聚合网络的分支，学习不同源域中人脸局部特征的语义信息，有效增强对不同源域的人脸活体信息分类的泛化能力。设计两模块融合网络以提高未知场景下跨域人脸活体检测精度。在OULU-NPU、CASIA-FASD、MSU-MFSD和Idiap Replay-Attack数据集上的实验结果表明，该算法在跨数据集测试O&C&M to I、O&C&I to M、I&C&M to O、O&M&I to C均有不错的表现，其中，在O&C&I to M及O&M&I to C性能评估指标分别提升了0.99个百分点和0.5个百分点的精度。

关键词: 域泛化, 生成对抗网络, 人脸活体检测, 自适应归一化, 注意力机制

ZENG Fanzhi, WU Chutao, ZHOU Yan. Cross-Domain Face in Vivo Detection of Unilateral Adversarial Network Algorithm[J]. Computer Engineering and Applications, 2024, 60(5): 103-111.

曾凡智, 吴楚涛, 周燕. 跨域人脸活体检测的单边对抗网络算法[J]. 计算机工程与应用, 2024, 60(5): 103-111.

References

[1] MASI I, WU Y, HASSNER T, et al. Deep face recognition: a survey[C]//2018 31st SIBGRAPI Conference on Graphics, Patterns and Images (SIBGRAPI), 2018: 471-478.
[2] YU Z, QIN Y, LI X, et al. Deep learning for face anti-spoofing: a survey[J]. arXiv:2106.14948,2021.
[3] M??TT? J, HADID A, PIETIK?INEN M. Face spoofing detection from single images using micro-texture analysis[C]//2011 International Joint Conference on Biometrics (IJCB), 2011: 1-7.
[4] BOULKENAFET Z, KOMULAINEN J, HADID A. Face antispoofing using speeded-up robust features and fisher vector encoding[J]. IEEE Signal Processing Letters, 2016, 24(2): 141-145.
[5] PATEL K, HAN H, JAIN A K. Secure face unlock: spoof detection on smartphones[J]. IEEE Transactions on Information Forensics and Security, 2016, 11(10): 2268-2283.
[6] YANG J, LEI Z, LI S Z. Learn convolutional neural network for face anti-spoofing[J]. arXiv:1408.5601,2014.
[7] ATOUM Y, LIU Y, JOURABLOO A, et al. Face anti-spoofing using patch and depth-based CNNs[C]//2017 IEEE International Joint Conference on Biometrics (IJCB), 2017: 319-328.
[8] LIU Y, JOURABLOO A, LIU X. Learning deep models for face anti-spoofing: binary or auxiliary supervision[C]//Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition, 2018: 389-398.
[9] YU Z, ZHAO C, WANG Z, et al. Searching central difference convolutional networks for face anti-spoofing[C]//Proceedings of the IEEE/CVF Conference on Computer Vision and Pattern Recognition, 2020: 5295-5305.
[10] LI S, ZHU X, FENG G, et al. Diffusing the liveness cues for face anti-spoofing[C]//Proceedings of the 29th ACM International Conference on Multimedia, 2021: 1636-1644.
[11] YU Z, QIN Y, ZHAO H, et al. Dual-cross central difference network for face anti-spoofing[J]. arXiv:2105.01290,2021.
[12] 沈超, 何希平. 基于纹理特征增强和轻量级网络的人脸防伪算法[J]. 计算机科学, 2022, 49(1): 390-396.
SHEN C, HE X P. Face anti-spoofing algorithm based on texture feature enhancement and light Neural network[J]. Computer Science, 2022, 49(1): 390-396.
[13] 王宏飞, 程鑫, 赵祥模, 等. 光流与纹理特征融合的人脸活体检测算法[J]. 计算机工程与应用, 2022, 58(6): 170-176.
WANG H F, CHENG X, ZHAO X M, et al. Face liveness detection based on fusional optical flow and texture features[J]. Computer Engineering and Applications, 2022, 58(6): 170-176.
[14] WANG J, LAN C, LIU C, et al. Generalizing to unseen domains: a survey on domain generalization[J]. IEEE Transactions on Knowledge and Data Engineering, 2023, 35(8): 8052-8072.
[15] SHAO R, LAN X, LI J, et al. Multi-adversarial discriminative deep domain generalization for face presentation attack detection[C]//Proceedings of the IEEE/CVF Conference on Computer Vision and Pattern Recognition, 2019: 10023-10031.
[16] JIA Y, ZHANG J, SHAN S, et al. Single-side domain generalization for face anti-spoofing[C]//Proceedings of the IEEE/CVF Conference on Computer Vision and Pattern Recognition, 2020: 8484-8493.
[17] WANG J, ZHAO Z, JIN W, et al. VLAD-VSA: cross-domain face presentation attack detection with vocabulary separation and adaptation[C]//Proceedings of the 29th ACM International Conference on Multimedia, 2021: 1497-1506.
[18] LIU S, ZHANG K Y, YAO T, et al. Adaptive normalized re-
presentation learning for generalizable face anti-spoofing[C]//Proceedings of the 29th ACM International Conference on Multimedia, 2021: 1469-1477.
[19] 蔡体健, 尘福春, 刘文鑫. 基于条件对抗域泛化的人脸活体检测方法[J]. 计算机应用研究, 2022, 39(8): 2538-2544.
CAI T J, CHEN F C, LIU W X. Face anti-spoofing method based on conditional adversarial domain generalization[J]. Application Research of Computers, 2022, 39(8): 2538-2544.
[20] WANG Z, WANG Z, YU Z, et al. Domain generalization via shuffled style assembly for face anti-spoofing[C]//Proceedings of the IEEE/CVF Conference on Computer Vision and Pattern Recognition, 2022: 4123-4133.
[21] BOULKENAFET Z, KOMULAINEN J, LI L, et al. OULU-NPU: a mobile face presentation attack database with real-world variations[C]//2017 12th IEEE International Conference on Automatic Face & Gesture Recognition (FG 2017), 2017: 612-618.
[22] ZHANG Z, YAN J, LIU S, et al. A face antispoofing database with diverse attacks[C]//2012 5th IAPR International Conference on Biometrics (ICB), 2012: 26-31.
[23] CHINGOVSKA I, ANJOS A, MARCEL S. On the effectiveness of local binary patterns in face anti-spoofing[C]//Proceedings of the International Conference of Biometrics Special Interest Group, 2012: 1-7.
[24] WEN D, HAN H, JAIN A K. Face spoof detection with image distortion analysis[J]. IEEE Transactions on Information Forensics and Security, 2015, 10(4): 746-761.
[25] SANDLER M, HOWARD A, ZHU M, et al. Mobilenetv2: inverted residuals and linear bottlenecks[C]//Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition, 2018: 4510-4520.
[26] HOWARD A G, ZHU M, CHEN B, et al. Mobilenets: efficient convolutional neural networks for mobile vision applications[J]. arXiv:1704.04861,2017.
[27] IOANNOU Y, ROBERTSON D, CIPOLLA R, et al. Deep roots: improving CNN efficiency with hierarchical filter groups[C]//Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition, 2017: 1231-1240.
[28] LIU Z, MAO H, WU C Y, et al. A convnet for the 2020s[C]//Proceedings of the IEEE/CVF Conference on Computer Vision and Pattern Recognition, 2022: 11976-11986.
[29] HU J, SHEN L, SUN G. Squeeze-and-excitation networks[C]//Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition, 2018: 7132-7141.
[30] WOO S, PARK J, LEE J Y, et al. CBAM: convolutional block attention module[C]//Proceedings of the European Conference on Computer Vision , 2018: 3-19.
[31] ARANDJELOVIC R, GRONAT P, TORII A, et al. NetVLAD: CNN architecture for weakly supervised place recognition[C]//Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition, 2016: 5297-5307.
[32] HUANG G, LIU Z, Van Der Maaten L, et al. Densely connected convolutional networks[C]//Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition, 2017: 4700-4708.
[33] HE K, ZHANG X, REN S, et al. Deep residual learning for image recognition[C]//Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition, 2016: 770-778.
[34] WEN D, HAN H, Jain A K. Face spoof detection with image distortion analysis[J]. IEEE Transactions on Information Forensics and Security, 2015, 10(4): 746-761.
[35] BOULKENAFET Z, KOMULAINEN J, HADID A. Face spoofing detection using colour texture analysis[J]. IEEE Transactions on Information Forensics and Security, 2016, 11(8): 1818-1830.
[36] FREITAS PEREIRA T, KOMULAINEN J, ANJOS A, et al. Face liveness detection using dynamic texture[J]. EURASIP Journal on Image and video Processing, 2014, 2014(1): 1-15.