双模态驱动的汉语语音与口型匹配控制模型

计算机工程与应用 ›› 2015, Vol. 51 ›› Issue (3): 202-207.

双模态驱动的汉语语音与口型匹配控制模型

曾洪鑫1，胡东波1，胡志刚2

1.东莞理工学院，广东东莞 523808
2.河南科技大学，河南洛阳 471023

出版日期:2015-02-01 发布日期:2015-01-28

On scheme of bimodal-drive matching between Chinese speech and mouth shape

ZENG Hongxin1, HU Dongbo1, HU Zhigang2

1.Dongguan University of Technology, Dongguan, Guangdong 523808, China
2.Henan University of Science and Technology, Luoyang, Henan 471023, China

Online:2015-02-01 Published:2015-01-28

摘要/Abstract

摘要： 构建一种基于文本和朗读语音共同驱动的双模态语音与口型匹配控制模型，充分利用文本拼音提供正确的口型视位，利用朗读语音为口型视位提供正确的时序，在此基础上对口型几何参数和时间参数进行离散化，根据汉语语音发音机理，合理控制语音的口型动作过程。

关键词: 语音口型匹配, 汉语语音, 口型视位

Abstract: A bimodal-drive matching scheme between Chinese speech and mouth shape is proposed, which is jointly driven by text and read speech. During the disposal of matching, the accurate mouth viseme is calculated with the spelling of text, and the correct time sequence of mouth viseme is given by read speech. Thereafter, the geometrical parameter and the time parameter of mouth motion are discretized. Then, according to the pronunciation mechanism of Chinese speech, the mouth motion of speech is controlled suitably and correctly.

Key words: matching between speech and mouth shape, Chinese speech, mouth viseme

曾洪鑫1，胡东波1，胡志刚2. 双模态驱动的汉语语音与口型匹配控制模型[J]. 计算机工程与应用, 2015, 51(3): 202-207.

ZENG Hongxin1, HU Dongbo1, HU Zhigang2. On scheme of bimodal-drive matching between Chinese speech and mouth shape[J]. Computer Engineering and Applications, 2015, 51(3): 202-207.

[1]	李兵虎，黄浩. 新疆非母语汉语语音识别中的字典自适应技术[J]. 计算机工程与应用, 2011, 47(21): 141-144.
[2]	黄浩¹，哈力旦². 汉语语音识别中基频特征的直接声学建模方法[J]. 计算机工程与应用, 2009, 45(30): 132-134.
[3]	黄浩^1,2,朱杰¹,哈力旦³. 汉语语音识别中的区分性声调建模方法[J]. 计算机工程与应用, 2009, 45(11): 178-182.