计算机工程与应用 ›› 2020, Vol. 56 ›› Issue (24): 207-213.DOI: 10.3778/j.issn.1002-8331.1910-0238

• 图形图像处理 • 上一篇    下一篇

基于语义分割的图像风格迁移技术研究

李美丽,杨传颖,石宝   

  1. 内蒙古工业大学 信息工程学院,呼和浩特 010100
  • 出版日期:2020-12-15 发布日期:2020-12-15

Research on Image Style Transfer Technology Based on Semantic Segmentation

LI Meili, YANG Chuanying, SHI Bao   

  1. School of Information Engineering, Inner Mongol University of Technology, Hohhot 010100, China
  • Online:2020-12-15 Published:2020-12-15

摘要:

随着民族服装文化的碰撞与融合,对图像风格迁移技术进行了研究,阐述了当前风格迁移的研究现状,将蒙古族服饰风格与汉族风格进行融合,继承和弘扬了民族文化。针对蒙古服饰元素多样、颜色差异大、花纹不规则性等特征而引起的风格提取难度大的问题,采用[K]均值与封闭式自然抠图算法相结合的方法进行图像分割,基于神经网络提取图像的风格和内容,利用图像重建技术合成结果图,实现蒙汉服饰图像风格迁移;针对输出图像伪影严重的问题,采取一种改进的图像风格迁移算法,将输入图像到输出图像的变换约束在色彩空间的局部仿射变换中,将这个约束表示成一个完全可微的参数项,有效抑制图像扭曲,针对真实照片风格迁移过程中存在的空间不一致问题,进行平滑处理确保风格处理后空间风格一致,该方法大大加快了运算速度。

关键词: 服饰特征提取, 封闭式自然图像抠图算法, [K]均值算法, 图像分割, 图像风格迁移

Abstract:

With the collision and fusion of national costume culture, this paper studies the image style transfer technology, expounds the current research status of style transfer, integrates Mongolian costume style with Han style, and inherits and promotes the national culture. For large difference of Mongolian costume elements variety, color, decorative pattern characteristics and cause of style such as irregularity extraction is difficult problem, it uses the algorithm of [K]-means and closed natural cutout combination method for image segmentation, extracts the image of style and content based on neural network, uses image reconstruction technology to synthesize results, implements the image style transfer of Mongolian and Han clothing. According to the serious output image artifact, it adopts the migration algorithm, an improved image style will constrain the transform of the input image to the output image in the local affine transformation of color space, the constraints are represented as a differentiable parameter completely, it effectively restrains image distortion, at the same time in real style photos do not match the space problems in the process of migration, it treatments smoothly to ensure the space style is consistent, this method greatly accelerates the speed.

Key words: garment feature extraction, closed form natural image matting algorithm, [K]-means algorithm, image segmentation, image style transfer