Computer Engineering and Applications ›› 2022, Vol. 58 ›› Issue (6): 219-226.DOI: 10.3778/j.issn.1002-8331.2009-0394

• Graphics and Image Processing • Previous Articles     Next Articles

Attribute Editable Person Image Synthesis Based on Spatial Transformation

WEI Chengfeng, DONG Hongwei, XU Xiaochun   

  1. School of Artificial Intelligence and Computer Science, Jiangnan University, Wuxi, Jiangsu 214122, China
  • Online:2022-03-15 Published:2022-03-15

基于空间变换的属性可编辑的人体图像合成

魏程峰,董洪伟,徐小春   

  1. 江南大学 人工智能与计算机学院,江苏 无锡 214122

Abstract: Aiming at the problem that the existing pose-guided human body image synthesis methods cannot flexibly edit the appearance attributes of the human body, the appearance attributes of different parts can be obtained by semantic segmentation of the input human image, and the purpose of simultaneously editing the posture and appearance attributes of human body can be achieved by replacing these attributes. In order to solve the problem that the pattern on the clothes can not be generated well by the purely convolutional structure of the generative adversarial networks, a new spatial transformation algorithm is proposed to transform the multi-source feature map, so that the pattern on the clothes can be preserved. Experimental results show that the proposed method achieves the purpose of controlling human body attributes and has better visual effects than the previous methods.

Key words: generative adversarial networks, spatial transformation, person image synthesis

摘要: 针对现有姿态引导的人体图像合成方法无法灵活地编辑人体外观属性的问题,通过对输入的人体图像进行语义分割得到不同部位的外观属性,替换这些属性即可达到同时编辑人体姿态与外观属性的目的。针对纯卷积结构的生成对抗网络无法很好地生成衣服上的图案的问题,提出了新的空间变换算法对多个源属性的特征图进行空间变换,使衣服上的图案得到了保留。实验结果表明,所提出的方法实现了控制人体属性的目的,并且相比于之前的方法具有更好的视觉效果。

关键词: 生成对抗网络, 空间变换, 人体图像合成