基于PAD三维情绪模型的情感语音韵律转换

计算机工程与应用 ›› 2013, Vol. 49 ›› Issue (5): 230-235.

基于PAD三维情绪模型的情感语音韵律转换

鲁小勇1，杨鸿武2，郭威彤2，裴东2

1.西北师范大学计算机科学与工程学院，兰州 730070
2.西北师范大学物理与电子工程学院，兰州 730070

出版日期:2013-03-01 发布日期:2013-03-14

Prosody conversion of emotional speech based on PAD three dimensional emotion model

LU Xiaoyong1, YANG Hongwu2, GUO Weitong2, PEI Dong2

1.College of Computer Science and Engineering, Northwest Normal University, Lanzhou 730070, China
2.College of Physics and Electronic Engineering, Northwest Normal University, Lanzhou 730070, China

Online:2013-03-01 Published:2013-03-14

摘要/Abstract

摘要： 提出了一种基于PAD三维情绪模型的情感语音韵律转换方法。选取了11种典型情感，设计了文本语料，录制了语音语料，利用心理学的方法标注了语音语料的PAD值，利用五度字调模型对情感语音音节的基频曲线建模。在此基础上，利用广义回归神经网络（Generalized Regression?Neural?Network，GRNN）构建了一个情感语音韵律转换模型，根据情感的PAD值和语句的语境参数预测情感语音的韵律特征，并采用STRAIGHT算法实现了情感语音的转换。主观评测结果表明，提出的方法转换得到的11种情感语音，其平均EMOS（Emotional Mean Opinion Score）得分为3.6，能够表现出相应的情感。

关键词: PAD情绪模型, 五度字调模型, 广义回归神经网络（GRNN）, STRAIGHT算法, 韵律转换

Abstract: This paper proposes a framework for prosody conversion of emotional speech based on PAD three dimensional emotion model. It designs an emotional speech corpus including 11 kinds of emotional utterances. Each utterance is labelled the emotional information with PAD value. A five-scale tone model is employed to model the pitch contour of emotional speech at the syllable level. It builds a Generalized Regression Neural Network（GRNN） based prosody conversion model to realize the transformation of pitch contour, duration and pause duration of emotional speech according to the PAD values of emotion and context information of text. Speech is then re-synthesized with the STRAIGHT algorithm by modifying pitch contour, duration and pause duration. Experimental results on Emotional Mean Opining Score（EMOS） demonstrate that the modified speeches achieve 3.6 of average Emotional Mean Opining Score（EMOS）.

Key words: PAD emotion model, five degree tone model, Generalized Regression Neural Network（GRNN）, STRAIGHT algorithm, prosody conversion

鲁小勇1，杨鸿武2，郭威彤2，裴东2. 基于PAD三维情绪模型的情感语音韵律转换[J]. 计算机工程与应用, 2013, 49(5): 230-235.

LU Xiaoyong1, YANG Hongwu2, GUO Weitong2, PEI Dong2. Prosody conversion of emotional speech based on PAD three dimensional emotion model[J]. Computer Engineering and Applications, 2013, 49(5): 230-235.