计算机工程与应用 ›› 2023, Vol. 59 ›› Issue (15): 17-26.DOI: 10.3778/j.issn.1002-8331.2209-0454

• 热点与综述 • 上一篇    下一篇

二维图像虚拟试衣技术综述

谭泽霖,白静   

  1. 1.中央民族大学 中国少数民族语言文学学院,北京 100081
    2.北方民族大学 计算机科学与工程学院,银川 750021  
    3.国家民委图像图形智能处理实验室,银川 750021
  • 出版日期:2023-08-01 发布日期:2023-08-01

Survey of Two-Dimensional Image Virtual Try-On Technology

TAN Zelin, BAI Jing   

  1. 1.School of Chinese Ethnic Minority Languages and Literatures, Minzu University of China, Beijing 100081, China
    2.School of Computer Science and Engineering, North Minzu University, Yinchuan 750021, China
    3.The Key Laboratory of Images & Graphics Intelligent Processing of State Ethnic Affairs Commission, North Minzu University, Yinchuan 750021, China
  • Online:2023-08-01 Published:2023-08-01

摘要: 虚拟试衣技术作为近年来深度学习研究中的热点课题,旨在使用户能直观方便查看自己试穿心仪服装的效果,为网购提供更多便利,且在服装设计、游戏、动画等领域也有着重要的应用。其中基于二维图像的虚拟试衣技术可以摒弃三维虚拟试衣所需昂贵的如三维扫描仪等设备的成本和时间代价,以其简单经济的特点受到研究者们更多关注。该文聚焦于二维虚拟试衣技术,从以下几方面进行总结:第一,阐述二维虚拟试衣技术的基本原理与流程;第二,在技术改进方面,以时间顺序和改进方向两者统一对二维虚拟试衣技术进行总结;第三,对二维虚拟试衣技术常用数据集、评价指标和损失函数进行总结,并提出二维虚拟试衣技术的不足和未来在高质量、多样化、多模态、集成化等方向的发展趋势。

关键词: 虚拟试衣, 网络结构, 人体特征, 服装变形, U-Net

Abstract: As a hot topic in deep learning research in recent years, virtual try-on technology enables users to intuitively and conveniently check the effect of trying on their favorite clothes, provides more convenience for online shopping, and also has important applications in clothing design, games, animation and other fields. In the virtual try-on technology, the 2D images-based virtual try-on methods can abandon the expensive hardware cost like 3D scanner and time cost of 3D virtual try-on methods, has received more attention from researchers because of its simple and economical characteristics. This paper focuses on the two-dimensional virtual try-on technology, and summarizes it from the following aspects:firstly, the basic principle and process of the two-dimensional virtual try-on technology; the two types of 2D virtual try-on technologies are summarized in a unified way; thirdly, the commonly used data sets, evaluation indicators and loss functions of 2D virtual try-on technology are summarized, and this paper proposes the shortcomings of two-dimensional virtual try-on technologies and the future development trend in the direction of high quality, diversification, multimodality, and integration.

Key words: virtual try-on, network structure, human features, clothing deformation, U-Net