Computer Engineering and Applications ›› 2023, Vol. 59 ›› Issue (13): 171-177.DOI: 10.3778/j.issn.1002-8331.2204-0158

• Pattern Recognition and Artificial Intelligence • Previous Articles     Next Articles

EEG Emotion Recognition Combined with Attention Mechanism and Feature Fusion 1DCNN

YAN Chao, ZHANG Xueying, ZHANG Jing, CHEN Guijun, HUANG Lixia   

  1. College of Information and Computer, Taiyuan University of Technology, Taiyuan 030024, China
  • Online:2023-07-01 Published:2023-07-01

结合注意力机制和特征融合1DCNN的脑电情感识别

闫超,张雪英,张静,陈桂军,黄丽霞   

  1. 太原理工大学 信息与计算机学院,太原 030024

Abstract: In the EEG emotion recognition field, when processing one-dimensional data into two-dimensional or three-dimensional data, and then using the 2DCNN or 3DCNN model for processing and recognition, there is a large number of parameters and the parameter optimization method is time-consuming and laborious. A 1D convolutional neural network(1DCNN) model based on the attention mechanism of frequency bands and brain regions is proposed. Firstly, it extracts features from EEG signals and uses t test to select optimal features; then a new 1DCNN emotion recognition model is designed according to the structure of the extracted features, which provides an interpretable model for parameter selection and convolution operations. Finally, according to the difference in the ability of the left and right brain regions to reflect emotions, a brain region attention mechanism is proposed, and combined with the frequency band attention mechanism, it can better pay attention to the brain regions and frequency bands related to emotion. The average recognition rate of the FBA-1DCNN model proposed in the valence dimension and arousal dimension two-classification experiments of the DEAP EEG emotional database reaches 94.01% and 93.55%, and the average recognition rate in valence-arousal dimension four-classification experiment reaches 89.38%, which is 2.96, 3.31 and 7.69 percentage points higher than the existing 1DCNN model.

Key words: EEG emotion recognition, t test, deep learning, 1D convolutional neural network(1DCNN), attention mechanism

摘要: 针对脑电情感识别领域中处理一维数据时将其映射为二维或三维数据,然后利用2DCNN或3DCNN模型进行处理和识别时,存在参数量大且参数寻优方法费时费力的问题,提出一种基于频段和脑区注意力机制的1DCNN模型。对脑电信号提取特征并采用t检验进行最优特征选择;根据提取特征的结构设计了一种新型的1DCNN情感识别模型,为模型的参数选择和卷积操作提供可解释性;最后根据左、右脑区对情感反应能力的不同,提出一种脑区注意力机制,并与频段注意力机制相结合更好地关注与情感相关的脑区与频段。提出的FBA-1DCNN模型在DEAP脑电情感数据库的效价维和唤醒维二分类实验上的平均识别率分别达到了94.01%和93.55%,在效价-唤醒维四分类实验上的平均识别率达到了89.38%,比现有的1DCNN模型分别提升了2.96、3.31和7.69个百分点。

关键词: 脑电情感识别, t检验, 深度学习, 一维卷积神经网络(1DCNN), 注意力机制