Advances of Age Progression Based Cross-Age Face Recognition

doi:10.3778/j.issn.1002-8331.2107-0043

Abstract

Abstract:

Cross-age face recognition is one of the most difficult problems in face recognition at present. Face features will change with age, resulting in a decrease in recognition accuracy. The face recognition based on the generated aging images obtained from aging models is a popular solution for this problem. With the widespread application of computer technology and deep learning, the authenticity, aging effect, and algorithm efficiency of face aging have been significantly improved. This paper systematically reviews the current research status of cross-age face recognition based on aging models. The aging methods are sorted out in detail, the method evolution of aging models and the advantages and disadvantages of various methods are systematically introduced, and the existing model evaluation methods are summarized. In addition, the existing datasets that can be used for cross-age face recognition are introduced in detail, and a comparative analysis is made in terms of data volume, age span, age accuracy, and use of the data set. For the purpose of practical applications, the problems to be solved in cross-age face recognition based on the aging model are analyzed and discussed. Moreover, the future research directions are predicted and prospected.

Key words: face aging, cross-age, deep learning, face recognition

摘要：

跨年龄人脸识别是目前人脸识别中的一大难点问题，人脸特征会随着年龄的增长发生变化，导致识别准确率降低，利用老化模型生成老化图像后进行人脸识别为该问题提供了一种解决方案。随着计算机技术和深度学习的广泛应用，人脸老化的真实性、老化效果、算法效率都得到了明显的提升，系统综述了基于老化模型的跨年龄人脸识别的研究现状，对人脸老化方法进行了详细地梳理，系统介绍了老化模型的方法演变和各类方法的优缺点，并对现有的模型评价方法进行了总结归纳。对现有的可用于跨年龄人脸识别的数据集进行了详细介绍，从数据量、年龄跨度、年龄准确性、数据集使用情况等方面进行了对比分析。结合实际应用对基于老化模型的跨年龄人脸识别中待解决的问题进行了分析和讨论，并对未来研究方向做出预测和展望。

关键词: 人脸老化, 跨年龄, 深度学习, 人脸识别

LI Junyao, LI Zhihui, XIE Lanchi, HOU Xinyu, YE Dong. Advances of Age Progression Based Cross-Age Face Recognition[J]. Computer Engineering and Applications, 2021, 57(24): 27-38.

李俊瑶，黎智辉，谢兰迟，侯欣雨，叶东. 基于老化模型的跨年龄人脸识别研究进展[J]. 计算机工程与应用, 2021, 57(24): 27-38.

References

[1] HE K，ZHANG X，REN S，et al.Deep residual learning for image recognition[C]//Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition，2016：770-778.
[2] HUANG G，LIU Z，VAN DER MAATEN L，et al.Densely connected convolutional networks[C]//Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition，2017：4700-4708.
[3] BOUSSAAD L，BOUCETTA A.Deep-learning based descriptors in application to aging problem in face recognition-ScienceDirect[J].Journal of King Saud University-Computer and Information Sciences，2020，32（8）.
[4] FU Y，GUO G，HUANG T S.Age synthesis and estimation via faces：a survey[J].IEEE Transactions on Pattern Analysis and Machine Intelligence，2010，32（11）：1955-1976.
[5] SHU X，XIE G S，LI Z，et al.Age progression：current technologies and applications[J].Neurocomputing，2016，208：249-261.
[6] BURT D M，PERRETT D I.Perception of age in adult Caucasian male faces：computer graphic manipulation of shape and colour information[J].Proceedings of the Royal Society B：Biological Sciences，1995，259（1355）：137-143.
[7] TIDDEMAN B，BURT M D，PERRETT D.Prototyping and transforming facial textures for perception research[J].IEEE Computer Graphics & Applications，2001，21（5）：42-50.
[8] 王章野，曹玫璇，李理，等.基于个性化原型的人脸衰老图像合成[J].电子学报，2009，37（z1）：118-124.
WANG Z Y，CAO M X，LI L，et al.Individual prototyping based facial aging image synthesis[J].Acta Electronica Sinica，2009，37（z1）：118-124.
[9] KEMELMACHER-SHLIZERMAN I，SUWAJANAKORN S，SEITZ S M.Illumination-aware age progression[C]//2014 IEEE Conference on Computer Vision and Pattern Recognition，2014.
[10] SHU X B，TANG J H，LAI H J，et al.Kinship-guided age progression[J].Journal of the Pattern Recognition，2016，59：156-167.
[11] WANG W，CUI Z，YAN Y，et al.Recurrent face aging[C]//IEEE Conference on Computer Vision and Pattern Recognition，2016.
[12] PARKE F I.A parametric model for human faces[D].University of Utah，1974.
[13] KEITH W.A muscle model for animating three-dimensional facial expression[J].Computer Graphics，1987，21（4）：17-24.
[14] MAGNENAT-THALMANN N，PRIMEAU E，THALMANN D.Abstract muscle action procedures for human face animation[J].Visual Computer，1988，3（5）：290-297.
[15] PLATT S M，BADLER N I.Animating facial expressions[J].Computer Graphics，1981，15（3）：245-252.
[16] MILLER G S P.The motion dynamics of snakes and worms[J].Computer Graphics，1988，22（4）：169-173.
[17] VIAUD M L，YAHIA H.Facial animation with wrinkles[C]//Third Workshop on Animation Eurographics，2009.
[18] COOTES T F，EDWARDS G J，TAYLOR C J.Active appearance models[C]//Proceedings of the 5th European Conference on Computer Vision-Volume II.Berlin，Heidelberg：Springer，1998.
[19] WU Y，KALRA P，MOCCOZET L，et al.Simulating wrinkles and skin aging[J].Visual Computer，1999，15（4）：183-198.
[20] TODD J T，MARK L S，SHAW R E，et al.Perception of human growth[J].Scientific American，1980（2）：132-144.
[21] RAMANATHAN N，CHELLAPPA R.Modeling age progression in young faces[C]//2006 IEEE Computer Society Conference on Computer Vision and Pattern Recognition，2006.
[22] RAMANATHAN N，CHELLAPPA R.Modeling shape and textural variations in aging faces[C]//Proceedings of IEEE International Conference on Automatic Face & Gesture Recognition，2008.
[23] LIN S D，TU C H，CHUANG C Y，et al.Aging simulation using facial muscle model[C]//International Conference on Machine Learning & Cybernetics，2012.
[24] COOTES T，EDWARDS G，TAYLOR C.Active appearance models[J].IEEE Transactions on Pattern Analysis and Machine Intelligence，2001，23（6）：681-685.
[25] LANITIS A，TAYLOR C J，COOTES T F.Toward automatic simulation of aging effects on face images[J].IEEE Transactions on Pattern Analysis & Machine Intelligence，2002，24（4）：442-455.
[26] PATTERSON E，SETHURAM A，ALBERT M，et al.Aspects of age variation in facial morphology affecting biometrics[C]//First IEEE International Biometrics：Theory，Applications，and Systems，2007.
[27] PATTERSON E K，SETHURAM A，RICANEK K，et al.Improvements in active appearance model based synthetic age progression for adult aging[C]//IEEE 3rd International Conference on Biometrics：Theory，Applications，and Systems，2009.
[28] WANG Y，ZHANG Z，LI W，et al.Combining tensor space analysis and active appearance models for aging effect simulation on face images[J].IEEE Transactions on Systems，Man，and Cybernetics，Part B，2012，42（4）：1107-1118.
[29] LI W，ZHANG Z，WANG Y，et al.Super-resolution in tensor space and active appearance model based simulation of adult aging effects on face images[C]//2010 Chinese Conference on Pattern Recognition（CCPR），2010：1-5.
[30] JIANG F，WANG Y.Facial aging simulation based on super-resolution in tensor space[C]//15th IEEE International Conference on Image Processing，2008：1648-1651.
[31] DU J X，ZHAI C M，YE Y Q.Face aging simulation and recognition based on NMF algorithm with sparseness constraints[J].Neurocomputing，2013，116：250-259.
[32] SUO J L，FENG M，SONG C Z，et al.A multi-resolution dynamic model for face aging simulation[C]//IEEE Conference on Computer Vision & Pattern Recognition，2007.
[33] SUO J，ZHU S，SHAN S.A compositional and dynamic model for face aging[J].IEEE Transactions on Pattern Analysis and Machine Intelligence，2010，32（3）：385-401.
[34] GOODFELLOW I J，POUGET-ABADIE J，MIRZA M，et al.Generative adversarial nets[C]//28th Annual Conference on Neural Information Processing Systems，2014.
[35] ANTIPOV G，BACCOUCHE M，DUGELAY J.Face aging with conditional generative adversarial networks[C]//2017 IEEE International Conference on Image Processing（ICIP），2017：2089-2093.
[36] Liu S，Sun Y，Zhu D，et al.Face aging with contextual generative adversarial nets[C]//Proceedings of the 25th ACM International Conference on Multimedia，New York，2018.
[37] WANG Z，TANG X，LUO W，et al.Face aging with identity-preserved conditional generative adversarial networks[C]//proceedings of the IEEE Computer Society Conference on Computer Vision and Pattern Recognition，2018：7939-7947.
[38] YANG H，HUANG D，WANG Y，et al.Learning face age progression：a pyramid architecture of GANs[C]//2018 IEEE/CVF Conference on Computer Vision and Pattern Recognition，2018.
[39] PARKHI O M，VEDALDI A，ZISSERMAN A.Deep face recognition[C]//British Machine Vision Conference，2015.
[40] YANG H，HUANG D，WANG Y，et al.Learning continuous face age progression：a pyramid of GANs[J].IEEE Transactions on Pattern Analysis and Machine Intelligence，2021，43（2）：499-515.
[41] ZENG J，MA X，ZHOU K.Photo-realistic face age progression/regression using a single generative adversarial network[J].Neurocomputing，2019，366（13）：295-304.
[42] BAO J，CHEN D，WEN F，et al.CVAE-GAN：fine-grained image generation through asymmetric training[C]//Proceedings of the IEEE International Conference on Computer Vision，2017：2764-2773.
[43] SHI C，ZHANG J，YAO Y，et al.CAN-GAN：conditioned-attention normalized GAN for face age synthesis[J].Pattern Recognition Letters，2020，138：520-526.
[44] PALSSON S，AGUSTSSON E，TIMOFTE R，et al.Genera-
tive adversarial style transfer networks for face aging[C]//2018 IEEE/CVF Conference on Computer Vision and Pattern Recognition Workshops（CVPRW），2018.
[45] YANG C，LV Z.Gender based face aging with cycle-consistent adversarial networks[J].Image & Vision Computing，2020，100：103945.
[46] LIU L，YU H，WANG S，et al.Learning shape and texture progression for young child face aging[J].Signal Processing Image Communication，2021，93（11）：116-127.
[47] FANG H，DENG W，ZHONG Y，et al.Triple-GAN：progressive face aging with triple translation loss[C]//2020 IEEE/CVF Conference on Computer Vision and Pattern Recognition Workshops（CVPRW），2020.
[48] CHANDALIYA P K，NAIN N.Child face age progression and regression using self-attention multi-scale patch GAN[C]//2021 IEEE International Joint Conference on Biometrics（IJCB），2021：1-8.
[49] ZHANG H，GOODFELLOW I，METAXAS D A.Odena，self-attention generative adversarial networks[C]//36th International Conference on Machine Learning，2019：12744-12753.
[50] LARSEN A，SNDERBY S K，LAROCHELLE H，et al.Autoencoding beyond pixels using a learned similarity metric[J].arXiv：1512.09300，2015.
[51] LIU Z，ZHANG Z，SHAN Y.Image-based surface detail transfer[J].IEEE Computer Graphics and Applications，2004，24（3）：30-35.
[52] ZHANG Z，SONG Y，QI H.Age progression/regression by conditional adversarial autoencoder[C]//2017 IEEE Conference on Computer Vision and Pattern Recognition（CVPR），2017.
[53] XIAO Y，ZHAO Y J.Preserving gender and identity in face age progression of infants and toddlers[C]//2021 IEEE International Joint Conference on Biometrics（IJCB），2021.
[54] SIMONYAN K，ZISSERMAN A.Very deep convolutional networks for large-scale image recognition[J].arXiv：1409.
1556，2014.
[55] HUANG Z，CHEN S，ZHANG J，et al.PFA-GAN：progressive face aging with generative adversarial network[J].arXiv：2012.03459，2020.
[56] LI P，HU Y，HE R，et al.Global and local consistent wavelet-domain age synthesis[J].IEEE Transactions on Information Forensics and Security，2019（14）：2943-2957.
[57] LI P，HU Y，LI Q，et al.Global and local consistent age generative adversarial networks[C]//2018 24th International Conference on Pattern Recognition（ICPR），2018.
[58] RICANEK K，TESAFAYE T.MORPH：a longitudinal image database of normal adult age-progression[C]//International Conference on Automatic Face & Gesture Recognition，2006.
[59] SU Y，YUN F，QI T，et al.Cross-database age estimation based on transfer learning[C]//2010 IEEE International Conference on Acoustics Speech and Signal Processing（ICASSP），2010.
[60] LIU T J，LIU K H，LIU H H，et al.Age estimation via fusion of multiple binary age grouping systems[C]//IEEE International Conference on Image Processing，2016：609-613.
[61] CHEN B C，CHEN C S，HSU W H.Face recognition and retrieval using cross-age reference coding with cross-age celebrity dataset[J].IEEE Transactions on Multimedia，2015，17（6）：804-815.
[62] HU Z，WEN Y，WANG J，et al.Facial age estimation with age difference[J].IEEE Transactions on Image Process，2017，26（7）：3087-3097.
[63] CHANG K Y，CHEN C S，HUNG Y P.Ordinal hyperplanes ranker with cost sensitivities for age estimation[C]//IEEE Conference on Computer Visionand Pattern Recognition，2011.
[64] IQBAL M T B，SHOYAIB M，RYU B，et al.Directional age-primitive pattern（DAPP） for human age group recognition and age estimation[J].IEEE Transactions on Information Forensics and Security，2017，12（11）：2505-2517.
[65] ROTHE R，TIMOFTE R，GOOL L V.DEX：deep expectation of apparent age from a single image[C]//IEEE International Conference on Computer Vision Workshop，2016：252-257.
[66] LEE S H，HOSSEINI S，KWON H J，et al.Age and gender estimation using deep residual learning network[C]//International Workshop on Advanced Image Technology（IWAIT），2018：1-3.
[67] ZHANG K.Age group and gender estimation in the wild with deep RoR architecture[J].IEEE Access，2017，5：22492-22503.
[68] FARIZA A，MU’ARIFIN，ARIFIN A Z.Age estimation system using deep residual network classification method[C]//2019 International Electronics Symposium（IES），2019：607-611.
[69] KRISHNAN A，ALMADAN A，RATTANI A.Understanding fairness of gender classification algorithms across gender-race groups[C]//2020 19th IEEE International Conference on Machine Learning and Applications（ICMLA），2020：1028-1035.
[70] 罗汉武，李文震，潘富城，等.基于渐进对抗学习的弱监督目标定位[J].计算机工程与应用，2021，57（14）：187-193.
LUO H W，LI W Z，PAN F C，et al.Progressive adversarial learning for weakly supervised object localization[J].Computer Engineering and Applications，2021，57（14）：187-193.
[71] ZHANG C L，CAO Y H，WU J.Rethinking the route towards weakly supervised object localization[C]//Proceedings of the IEEE/CVF Conference on Computer Vision and Pattern Recognition，2020：13460-13469.
[72] 韩派，李雅琴，阮冰.一种基于图像变换预测的自监督GAN模型[J].武汉轻工大学学报，2021，40（2）：51-58.
HAN P，LI Y J，RUAN B.A self-supervised GAN model based on image transformation prediction[J].Journal of Wuhan Polytechnic University，2021，40（2）：51-58.
[73] JING L，TIAN Y.Self-supervised visual feature learning with deep neural networks：a survey[J].IEEE Annals of the History of Computing，2020（1）：1-11.
[74] 费建伟，夏志华，余佩鹏，等.人脸合成技术综述[J].计算机科学与探索，2021，15（11）：2025-2047.
FEI J W，XIA Z H，YU P P，et al.Survey of face synthesis[J].Journal of Frontiers of Computer Science and Technology，2021，15（11）：2025-2047.
[75] EMAMI H，ALIABADI M M，DONG M，et al.SPA-GAN：spatial attention GAN for image-to-image translation[J].IEEE Transactions on Multimedia，2021，23：391-401.
[76] CHANG K T，BOWYER K W，FLYNN P J.An evalution of multimodal 2D+3D face biometrics[J].IEEE Transactions on Pattern Analysis & Machine Intelligence，2005，27（4）：619-624.
[77] WILES O，KOEPKE A，ZISSERMAN A.X2face：a network for controlling face generation using images，audio，and pose codes[C]//Proceedings of the European Conference on Computer Vision（ECCV），2018：670-686.
[78] SIAROHIN A，LATHUILIERE S，TULYAKOV S，et al.Animating arbitrary objects via deep motion transfer[C]//Proceedings of the IEEE/CVF Conference on Computer Vision and Pattern Recognition，2019：2377-2386.