关键词: 视频编码, 纹理合成, 视觉显著度

Abstract: To solve the problem of disability to extract texture regions in an automatic manner for video coding based on texture analysis and synthesis, video coding with texture synthesis and visual saliency is proposed. In the novel method, texture macroblock for removing is defined as the one with its information contained in the neighboring macroblocks, with the purpose of bringing capability of reconstructing the removed macroblocks from the neighboring ones. Meanwhile, to maintain visual quality of synthesized video, visual saliency model is introduced in texture macroblock extraction process to avoid removing visually salient image regions. In decoder side, the combination of global motion compensation and texture optimization is applied to synthesize the removed texture macroblocks, aiming to ensure good spatial and temporal consistency between consecutive frames. Compared with H.264/AVC, a rate-saving of 5%~20% can be achieved at the same subjective quality. This method can also outperform the method proposed by Njiki-Nya Patrick by two times at the side of low rate.

Key words: video coding, texture synthesis, visual saliency