计算机工程与应用 ›› 2023, Vol. 59 ›› Issue (17): 1-21.DOI: 10.3778/j.issn.1002-8331.2210-0041

• 热点与综述 • 上一篇    下一篇

单张图像三维人脸重建方法综述

王静婷,李慧斌   

  1. 西安交通大学 数学与统计学院,西安 710049
  • 出版日期:2023-09-01 发布日期:2023-09-01

Review of Single-Image 3D Face Reconstruction Methods

WANG Jingting, LI Huibin   

  1. School of Mathematics and Statistics, Xi’an Jiaotong University, Xi’an 710049, China
  • Online:2023-09-01 Published:2023-09-01

摘要: 近年来,三维人脸重建任务作为“数字人”技术的重要组成部分,受到了学术界和工业界的广泛关注。基于单张图像的三维人脸重建任务在充分结合传统相机模型、光照模型、三维人脸统计形变模型与深度卷积网络、深度生成模型等方面技术之后取得了长足的进步。聚焦单张图像三维人脸重建问题,将现有研究工作分为基于隐空间编码和基于显空间回归两类。第一类研究工作对基础三维人脸统计模型的基系数求解、损失函数设计等进行优化,提升重建效果,在人脸拓扑结构变化方面具备鲁棒性优势,但缺乏细节特征。第二类工作以显空间多种数据形式表示三维人脸并直接通过深度网络进行回归,通常可获得更加个性化的三维人脸细节特征且对光照、遮挡等干扰因素具有较好的鲁棒性。进一步,基于常用数据集和评价指标,充分探讨并比较了两类方法中一些典型方法的优缺点。最后对全文进行总结,并给出了单张图像三维人脸重建任务面临的主要挑战及未来发展趋势。

关键词: 三维人脸重建, 单张图像, 显空间回归, 隐空间编码

Abstract: In recent years, 3D face reconstruction task, as an important part of “digital human” technology, has received great attention from both academia and industry. In particular, 3D face reconstruction task based on a single image has made great progress by fully combining traditional camera model, illumination model, 3D face statistical deformation model with the deep convolutional neural network and deep generative models. This paper focuses on the single-image 3D face reconstruction problem, and divides the existing research works into two categories based on implicit space coding and explicit space regression. The first type of research works optimize the basis coefficient solution and loss function design of the basic 3D face statistical model to improve the reconstruction effect, which has the advantage of robustness in face topology change but lacks detailed features. The second type of research works represent 3D faces in the forms of multiple data in explicit space and regress them directly by deep networks, which can usually obtain more personalized 3D face detail features and have better robustness to interference factors such as illumination and occlusion. Furthermore, based on the commonly used datasets and evaluation metrics, this paper fully explores and compares the advantages and disadvantages of some typical methods of both categories. Finally, it summarizes the whole paper and points out the main challenges and future development trends of the single-image based 3D face reconstruction task.

Key words: 3D face reconstruction, single-image, explicit space regression, implicit space coding