计算机工程与应用 ›› 2020, Vol. 56 ›› Issue (20): 111-117.DOI: 10.3778/j.issn.1002-8331.1906-0395

• 模式识别与人工智能 • 上一篇    下一篇

基于3DC-BGRU的脑电情感识别

胡章芳,刘鹏飞,蒋勤,罗飞,王明丽   

  1. 1.重庆邮电大学 光电工程学院,重庆 400065
    2.重庆邮电大学 计算机科学与技术学院,重庆 400065
  • 出版日期:2020-10-15 发布日期:2020-10-13

EEG Emotion Recognition Based on 3DC-BGRU

HU Zhangfang, LIU Pengfei, JIANG Qin, LUO Fei, WANG Mingli   

  1. 1.School of Optoelectronic Engineering, Chongqing University of Posts and Telecommunications, Chongqing 400065, China
    2.School of Computer Science and Technology, Chongqing University of Posts and Telecommunications, Chongqing  400065, China
  • Online:2020-10-15 Published:2020-10-13

摘要:

针对脑电信号情感识别率偏低的问题,提出了一种基于3DC-BGRU的脑电情感识别方法。对单通道脑电信号进行短时傅里叶变换(STFT),提取相关频带的时频信息构成二维时频图,并将多个通道的时频图构成一种全新的时间、频率和通道的三维数据形式,通过三维卷积的方式设计了一种新颖的卷积神经网络(CNN)模型对三维数据进行深层特征提取,设计双向门控循环单元(BGRU)对深层特征的序列信息进行处理并配合Softmax进行分类。实验结果表明该方法分类识别率得到提高。

关键词: 情感识别, 短时傅里叶变换(STFT), 三维数据, 卷积神经网络(CNN), 双向门控循环单元(BGRU)

Abstract:

To solve the problem of low emotional recognition rate of EEG signals, this paper proposes an EEG emotion recognition method based on 3DC-BGRU. Firstly, the Short-Time Fourier Transform(STFT) is performed on the single-channel EEG signal, and the time-frequency information of the relevant frequency band is extracted to form a two-dimensional time-frequency map, the time-frequency map of multiple channels constitutes a new three-dimensional data form of time, frequency and channels. Then, a novel Convolutional Neural Network(CNN) model is designed to extract deep features of 3D data by 3D convolution. Finally, the Bidirectional Gated Recurrent Unit(BGRU) is designed to process the sequence information of deep features and classify them with Softmax. The experimental results show that the classification recognition rate of the method is improved.

Key words: emotion recognition, Short-Time Fourier Transform(STFT), three-dimensional data, Convolutional Neural Network(CNN), Bidirectional Gated Recurrent Unit(BGRU)