FaceEncAuth：Face Recognition Privacy Security Scheme Based on FaceNet and SM Algorithms

doi:10.3778/j.issn.1002-8331.2112-0517

Abstract

Abstract: In face recognition, as one of the basic biometrics, facial features are unique and irrevocable. The attack, leakage or the tampering with facial features will pose a great threat to user privacy and security. To solve this problem, a face recognition privacy security scheme based on deep learning and encryption algorithms is proposed. In this scheme, the FaceNet deep learning algorithm is used to efficiently extract facial features, coordinate the ambiguity of biometrics and the accuracy of the cryptographic system, and use the CKKS fully homomorphic encryption algorithm for face recognition ciphertext field operations. Besides, the national secret SM4 algorithm is adopted to enhance facial feature ciphertext’s ability to resist malicious attacks, in which symmetric cipher property is utilized to take into account both security and operation efficiency, while the SM9 asymmetric cipher algorithm is used for the management of the symmetric key of the SM4 algorithm. Experimental results and analysis show that the scheme improves the security of data transmission, storage, and comparison without affecting the accuracy and efficiency of face recognition.

Key words: face recognition, biometrics, deep learning, homomorphic encryption, SM4, SM9

摘要： 人脸识别中，人脸特征作为生物特征的一种，具有唯一性、不可撤销性，一旦遭到攻击、篡改或泄露，用户隐私安全将面临巨大威胁。针对这一问题，提出一种基于深度学习和加密算法的人脸识别隐私安全方案。该方案中，利用FaceNet深度学习算法来高效提取人脸特征，协调生物特征模糊性与密码系统的精确性，采用CKKS全同态加密算法进行人脸识别密文域的运算，通过国密SM4算法增强人脸特征密文抵抗恶意攻击的能力，利用其对称密码的性质兼顾了安全性和运算效率，而SM9非对称密码算法则用于SM4算法对称密钥的管理。实验结果及分析表明，该方案在不影响人脸识别准确率、效率的前提下提高了数据传输、存储和比对的安全性。

关键词: 人脸识别, 生物特征, 深度学习, 同态加密, SM4, SM9

WU Junqing, PENG Changgen, TAN Weijie, WU Zhenqiang. FaceEncAuth：Face Recognition Privacy Security Scheme Based on FaceNet and SM Algorithms[J]. Computer Engineering and Applications, 2022, 58(11): 93-99.

吴俊青, 彭长根, 谭伟杰, 吴振强. FaceEncAuth：基于FaceNet和国密算法的人脸识别隐私安全方案[J]. 计算机工程与应用, 2022, 58(11): 93-99.

References

[1] 欧卫华，陈龙保.基于人脸视频的心率检测研究综述[J].贵州师范大学学报（自然科学版），2021，39（4）：10-20.
OU W H，CHEN L B.Survey of heart rate estimation based on facial video[J].Journal of Guizhou Normal University（Natural Sciences），2021，39（4）：10-20.
[2] WANG X，XUE H Y，LIU X F，et al.A privacy-preserving edge computation-based face verification system for user authentication[J].IEEE Access，2019，7：14186-14197.
[3] SUN Y，WANG X G，TANG X O.Deep learning face representation from predicting 10，000 classes[C]//IEEE Conference on Computer Vision & Pattern Recognition，2014.
[4] WANG Y，NAKACHI T.A privacy-preserving learning framework for face recognition in edge and cloud networks[J].IEEE Access，2020，8：136056-136070.
[5] EL-SHAFAI W，MOHAMED F A H E，ELKAMCHOUCHI H M A，et al.Efficient and secure cancelable biometric authentication framework based on genetic encryption algorithm[J].IEEE Access，2021，9：77675-77692.
[6] BOUZERNA N，SIRDEY R，STAN O，et al.An architecture for practical confidentiality-strengthened face authentication embedding homomorphic cryptography[C]//IEEE International Conference on Cloud Computing Technology & Science，2017.
[7] JIN X，HAN Q，LI X D，et al.Efficient blind face recognition in the cloud[J].Multimedia Tools and Applications，2020，79（17/18）：12533-12550.
[8] KUMAR S，SINGH S K，SINGH A K，et al.Privacy preserving security using biometrics in cloud computing[J].Multimedia Tools and Applications，2018，77（12）：1-23.
[9] IM J H，JEON S Y，LEE M K.Practical privacy-preserving face authentication for smartphones secure against malicious clients[J].IEEE Transactions on Information Forensics and Security，2020，15：2386-2401.
[10] TRONCOSO-PASTORIZA J R，GONZALEZ-JIMENEZ D.Fully private noninteractive face verification[J].IEEE Transactions on Information Forensics and Security，2013，8（7）：1101-1114.
[11] VISHNU N B.Secure face matching using fully homomorphic encryption[C]//2018 IEEE 9th International Conference on Biometrics Theory，Applications and Systems（BTAS），2018.
[12] JINDAL A K，SHAIK I，VASUDHA V，et al.Secure and privacy preserving method for biometric template protection using fully homomorphic encryption[C]//2020 IEEE 19th International Conference on Trust，Security and Privacy in Computing and Communications（TrustCom），2020.
[13] CHEON J H，HAM K，KIM A，et al.Bootstrapping for approximate homomorphic encryption[C]//Advances in Cryptology-EUROCRYPT 2018.Cham：Springer，2018：360-384.
[14] ZHANG K P，ZHANG Z P，LI Z F.Joint face detection and alignment using multitask cascaded convolutional networks[J].IEEE Signal Processing Letters，2016，23（10）：1499-1503.
[15] SCHROFF F，KALENICHENKO D，PHILBIN J.FaceNet：a unified embedding for face recognition and clustering[C]//2015 IEEE Conference on Computer Vision and Pattern Recognition（CVPR），2015.
[16] 国家标准化管理委员会.信息安全技术SM4分组密码算法[S].2016.
Standardization Administration.Information security technology—SM4 block cipher algorithm[S].2016.
[17] 国家标准化管理委员会.信息安全技术SM9标识密码算法[S].2016.
Standardization Administration.Information security technology—SM9 identity cipher algorithm[S].2016.
[18] ZHANG J，WU W L，ZHENG Y F.Security of SM4 against（related-key） differential cryptanalysis[C]//International Conference on Information Security Practice and Experience.Cham：Springer，2016：65-78.
[19] CHEN J J，YOU F C.An image encryption algorithm based on SM4 and Base64[J].Journal of Physics：Conference Series，2021，1812：012041.
[20] CHENG Z H.The SM9 cryptographic schemes[Z].IACR Cryptol ePrint Arch，2017.
[21] 赖建昌，黄欣沂，何德彪.一种基于商密SM9的高效标识广播加密方案[J].计算机学报，2021，44（5）：897-907.
LAI J C，HUANG X Y，HE D B.An efficient identity-based broadcast encryption scheme based on SM9[J].Chinese Journal of Computers，2021，44（5）：897-907.
[22] ZHOU E J，CAO Z M，YIN Q.Naive-deep face recognition：touching the limit of LFW benchmark or not?[J].arXiv：1501.04690，2015.
[23] LIU J T，DENG Y F，BAI T，et al.Targeting ultimate accuracy：face recognition via deep embedding[J].arXiv：1506.07310，2015.
[24] LIU W Y，WEN Y D，YU Z D，et al.SphereFace：deep hypersphere embedding for face recognition[C]//2017 IEEE Conference on Computer Vision and Pattern Recognition（CVPR），2017.
[25] DENG J K，GUO J，XUE N N，et al.ArcFace：additive angular margin loss for deep face recognition[C]//2019 IEEE/CVF Conference on Computer Vision and Pattern Recognition（CVPR），2019.