基于图表征和双重注意力机制的跨被试ERP检测

doi:10.3778/j.issn.1002-8331.2202-0311

摘要/Abstract

摘要： 针对事件相关电位（event-related potential，ERP）在跨被试场景下检测精度不高的问题，提出了一种基于图表征和双重注意力机制的卷积循环神经网络模型。该模型采用不依赖于被试和任务的图来表征脑电信号中的空间信息，并级联卷积神经网络（convolutional neural network，CNN）和长短期记忆网络（long short-term memory network，LSTM）形成CNN-LSTM基础框架，同时嵌入双重注意力机制（即选择性内核卷积和自注意力机制）以充分提取不同被试脑电信号的时空特征，从而提高跨被试场景下的ERP检测精度。在基于快速序列视觉呈现范式的大规模基准数据集上的实验结果表明，与现有的7种ERP检测方法相比，所提方法在跨被试场景下具有显著的优越性。

Abstract: In order to improve the detection accuracy of event-related potential（ERP） in subject-independent scenarios, a convolutional recurrent neural network model based on graph embedding and dual attention mechanisms is proposed. The model uses a graph to represent the spatial information in electroencephalogram（EEG） signals, and uses the cascade framework of convolutional neural network（CNN） and long short-term memory network（LSTM） as the basic framework. By embedding dual attention mechanisms（i.e., selective kernel convolution and self-attention mechanism）, it can fully extract the temporal and spatial features of EEG signals of different subjects, so as to improve the ERP detection accuracy in subject-independent scenarios. A large number of experiments carried out on the benchmark dataset based on rapid serial visual presentation paradigm demonstrate that the proposed method has significant superiority over 7 existing ERP detection methods in subject-independent scenarios.

Key words: electroencephalogram（EEG）, event-related potential（ERP） detection, graph, attention mechanism, convolution recurrent model

相晓嘉, 兰珍, 闫超, 李子杏, 唐邓清, 周晗. 基于图表征和双重注意力机制的跨被试ERP检测[J]. 计算机工程与应用, 2023, 59(11): 160-167.

XIANG Xiaojia, LAN Zhen, YAN Chao, LI Zixing, TANG Dengqing, ZHOU Han. Cross-Subject ERP Detection Based on Graph and Dual Attention Mechanism[J]. Computer Engineering and Applications, 2023, 59(11): 160-167.

参考文献

[1] RAMADAN R A，VASILAKOS A V.Brain computer interface：control signals review[J].Neurocomputing，2017，223：26-44.
[2] 杜秀丽，马振倩，邱少明，等.基于卷积注意力机制的运动想象脑电信号识别[J].计算机工程与应用，2021，57（18）：181-185.
DU X L，MA Z Q，QIU S M，et al.Recognition of motor imaging EEG signals based on convolution attention mecha-nism[J].Computer Engineering and Applications，2021，57（18）：181-185.
[3] HOLZ E M，H?HNE J，STAIGER-S?LZER P.Brain-computer interface controlled gaming：evaluation of usability by severely motor restricted end-users[J].Artificial Intelligence in Medicine，2013，59（2）：111-120.
[4] KUTAS M，MCCARTHY G，DONCHIN E.Augmenting mental chronometry：the P300 as a measure of stimulus evaluation time[J].Science，1977，197（4305）：792-795.
[5] 杨默涵，陈万忠，李明阳.基于总体经验模态分解的多类特征的运动想象脑电识别方法研究[J].自动化学报，2017，43（5）：743-752.
YANG M H，CHEN W Z，LI M Y.Multiple feature extraction based on ensemble empiricalmode decomposition for motor imagery EEG recognition tasks[J].Acta Automatica Sinica，2017，43（5）：743-752.
[6] 李子杏，兰珍，唐邓清，等.基于ERP信号的目标检测研究综述[J].计算机工程与应用，2021，57（23）：37-49.
LI Z X，LAN Z，TANG D Q，et al.Survey on ERP-based target detection[J].Computer Engineering and Applications，2021，57（23）：37-49.
[7] MARATHE A R，RIES A J，MCDOWELL K.A novel method for single-trial classification in the face of temporal variability[C]//International Conference on Augmented Cognition，2013：345-352.
[8] XIAO X L，XU M P，JIN J，et al.Discriminative canonical pattern matching for single-trial classification of ERP components[J].IEEE Transactions on Biomedical Engineering，2019，67（8）：2266-2275.
[9] DíAZ C F B，OLAYA A F R.A novel method based on regularized logistic regression and CCA for P300 detection using a reduced number of EEG trials[J].IEEE Latin America Transactions，2020，18（12）：2147-2154.
[10] CECOTTI H，GRASER A.Convolutional neural networks for P300 detection with application to brain-computer interfaces[J].IEEE Transactions on Pattern Analysis and Machine Intelligence，2010，33（3）：433-445.
[11] SCHIRRMEISTER R T，SPRINGENBERG J T，FIEDERER L D J，et al.Deep learning with convolutional neural networks for EEG decoding and visualization[J].Human Brain Mapping，2017，38（11）：5391-5420.
[12] LAWHERN V J，SOLON A J，WAYTOWICH N R，et al.EEGNet：a compact convolutional neural network for EEG-based brain-computer interfaces[J].Journal of Neural Engineering，2018，15（5）：056013.
[13] ZHANG D L，YAO L N，ZHANG X，et al.Cascade and parallel convolutional recurrent neural networks on EEG-based intention recognition for brain computer interface[C]//Proceedings of the AAAI Conference on Artificial Intelligence，2018.
[14] 郑伟龙，石振锋，吕宝粮.用异质迁移学习构建跨被试脑电情感模型[J].计算机学报，2020，43（2）：177-189.
ZHENG W L，SHI Z F，LV B L.Building cross-subject EEG-based affective models using heterogeneous transfer learning[J].Chinese Journal of Computers，2020，43（2）：177-189.
[15] BAHDANAU D，CHO K，BENGIO Y.Neural machine translation by jointly learning to align and translate[J].arXiv：1409.0473，2014.
[16] SUN M，YUAN Y C，ZHOU F，et al.Multi-attention multi-class constraint for fine-grained image recognition[C]//Proceedings of the European Conference on Computer Vision（ECCV），2018：805-821.
[17] ZHANG D L，YAO L N，CHEN K X，et al.A convolutional recurrent attention model for subject-independent eeg signal analysis[J].IEEE Signal Processing Letters，2019，26（5）：715-719.
[18] TAO W，LI C，SONG R C，et al.EEG-based emotion recognition via channel-wise attention and self attention[J].IEEE Transactions on Affective Computing，2023，14（1）：382-393.
[19] LAN Z，YAN C，LI Z X，et al.MACRO：multi-attention convolutional recurrent model for subject-independent ERP detection[J].IEEE Signal Processing Letters，2021，28：1505-1509.
[20] SONG T F，ZHENG W M，SONG P，et al.EEG emotion recognition using dynamical graph convolutional neural networks[J].IEEE Transactions on Affective Computing，2018，11（3）：532-541.
[21] ZHANG D L，CHEN K X，JIAN D B，et al.Motor imagery classification via temporal attention cues of graph embedded EEG signals[J].IEEE Journal of Biomedical and Health Informatics，2020，24（9）：2570-2579.
[22] ZHANG S G，WANG Y J，ZHANG L J，et al.A benchmark dataset for RSVP-based brain-computer interfaces[J].Frontiers in Neuroscience，2020，1042：568000.
[23] SHIGEHALLI V S，SHETTAR V M.Spectral techniques using normalized adjacency matrices for graph matching[J].International Journal of Computational Science and Mathematics，2011，3（4）：371-378.
[24] LI X，WANG W H，HU X L，et al.Selective kernel networks[C]//Proceedings of the IEEE/CVF Conference on Computer Vision and Pattern Recognition，2019：510-519.
[25] IOFFE S，SZEGEDY C.Batch normalization：accelerating deep network training by reducing internal covariate shift[C]//International Conference on Machine Learning，2015：448-456.
[26] HU D C.An introductory survey on attention mechanisms in NLP problems[J].Intelligent Systems and Applications，2020，1038：432-448.
[27] KINGMA D P，BA J.Adam：a method for stochastic optimization[J].arXiv：1412.6980，2014.
[28] FAWCETT T.An introduction to ROC analysis[J].Pattern Recognition Letters，2006，27（8）：861-874.