计算机工程与应用 ›› 2023, Vol. 59 ›› Issue (15): 38-54.DOI: 10.3778/j.issn.1002-8331.2209-0429
秦天鹏,生慧,岳路,金卫
出版日期:
2023-08-01
发布日期:
2023-08-01
QIN Tianpeng, SHENG Hui, YUE Lu, JIN Wei
Online:
2023-08-01
Published:
2023-08-01
摘要: 通过面部表情、语音语调以及脑电等生理信号对人的情绪状态进行识别分类,即情绪识别,其在医疗、交通以及教育等领域有广泛应用。脑电信号由于其真实可靠,在情绪识别领域日益得到广泛关注。总结了近年来脑电情绪识别研究所取得的进展,主要介绍基于深度学习和迁移学习进行的脑电情绪识别研究。介绍了脑电情绪识别基础理论、常用公开数据集、信号的采集和预处理,介绍特征提取与选择,重点介绍了深度学习和迁移学习在脑电情绪识别上的应用。指出该领域目前面临的挑战和前景。
秦天鹏, 生慧, 岳路, 金卫. 脑电信号情绪识别研究综述[J]. 计算机工程与应用, 2023, 59(15): 38-54.
QIN Tianpeng, SHENG Hui, YUE Lu, JIN Wei. Review of Research on Emotion Recognition Based on EEG Signals[J]. Computer Engineering and Applications, 2023, 59(15): 38-54.
[1] ZHANG J,YIN Z,CHEN P,et al.Emotion recognition using multi-modal data and machine learning techniques:a tutorial and review[J].Information Fusion,2020,59:103-126. [2] ANDERSON K,MCOWAN P W.A real-time automated system for the recognition of human facial expressions[J].IEEE Transactions on Systems,Man,and Cybernetics,2006,36(1):96-105. [3] KESSOUS L,CASTELLANO G,CARIDAKIS G.Multimodal emotion recognition in speech-based interaction using facial expression,body gesture and acoustic analysis[J].Journal on Multimodal User Interfaces,2009,3(1/2):33-48. [4] YIN Z,ZHAO M,WANG Y,et al.Recognition of emotions using multimodal physiological signals and an ensemble deep learning model[J].Computer Methods and Programs in Biomedicine,2017,140:93-110. [5] GAO Z,LI Y,YANG Y,et al.A GPSO-optimized convolutional neural networks for EEG-based emotion recognition[J].Neurocomputing,2020,380:225-235. [6] CHEN G,ZHANG X,SUN Y,et al.Emotion feature analysis and recognition based on reconstructed EEG sources[J].IEEE Access,2020,8:11907-11916. [7] TORRES P E,TORRES E A,HERNANDEZ-ALVAREZ M,et al.EEG-based BCI emotion recognition:a survey[J].Sensors(Basel),2020,20(18). [8] HUANG H Y,XIE Q Y,PAN J H,et al.An EEG-based brain computer interface for emotion recognition and its application in patients with disorder of consciousness[J].IEEE Transactions on Affective Computing,2021,12(4):832-842. [9] CRAIK A,HE Y T,CONTRERAS-VIDAL J L.Deep learning for electroencephalogram(EEG) classification tasks:a review[J].Journal of Neural Engineering,2019,16(3). [10] WU D,XU Y,LU B L.Transfer learning for EEG-based brain-computer interfaces:a review of progress made since 2016[J].IEEE Transactions on Cognitive and Developmental Systems,2020,14(1):4-19. [11] MAUSS I B,ROBINSON M D.Measures of emotion:a review[J].Cognition & Emotion,2009,23(2):209-237. [12] 吕宝粮,张亚倩,郑伟龙.情感脑机接口研究综述[J].智能科学与技术学报,2021,3(1):36-48. LU B L,ZHANG Y Q,ZHENG W L.A survey of affective brain-computer interface[J].Chinese Journal of Intelligent Science and Technology,2021,3(1):36-48. [13] 赵国朕,宋金晶,葛燕,等.基于生理大数据的情绪识别研究进展[J].计算机研究与发展,2016,53(1):80-92. ZHAO G Z,SONG J J,GE Y,et al.Advances in emotion recognition based on physiological big data[J].Journal of Computer Research and Development,2016,53(1):80-92. [14] VAN DEN BROEK E L.Ubiquitous emotion-aware computing[J].Personal and Ubiquitous Computing,2013,17(1):53-67. [15] SLAMA M.Emotions and life:perspectives from psychology,biology,and evolution[J].Psychology & Marketing,2005,22. [16] PLUTCHIK R,KELLERMAN H.Theories of emotion[M].[S.l.]:Academic Press,2013. [17] PARROTT W G.Emotions in social psychology:essential readings[M].Philadelphla:Psychology Press,2001. [18] 王忠民,赵玉鹏,郑镕林,等.脑电信号情绪识别研究综述[J].计算机科学与探索,2022,16(4):760-774. WANG Z M,ZHAO Y P,ZHENG R L,et al.Survey of research on EEG signal emotion recognition[J].Journal of Frontiers of Computer Science and Technology,2022,16(4):760-774. [19] RUSSELL J A.A circumplex model of affect[J].Journal of Personality and Social Psychology,1980,39(6):1161-1178. [20] MEHRABIAN A.Pleasure arousal dominance:a general framework for describing and measuring individual differences in temperament[J].Current Psychology,1996,14(4):261-292. [21] POSNER J,RUSSELL J A,PETERSON B S.The circumplex model of affect:an integrative approach to affective neuroscience,cognitive development,and psychopathology[J].Development and Psychopathology,2005,17(3):715-734. [22] PICARD R W,VYZAS E,HEALEY J.Toward machine emotional intelligence:analysis of affective physiological state[J].IEEE Transactions on Pattern Analysis and Machine Intelligence,2001,23(10):1175-1191. [23] GRECO A,VALENZA G,CITI L,et al.Arousal and valence recognition of affective sounds based on electrodermal activity[J].IEEE Sensors Journal,2016,17(3):716-725. [24] CONSTANTINESCU A C,WOLTERS M,MOORE A,et al.A cluster-based approach to selecting representative stimuli from the international affective picture system(IAPS) database[J].Behavior Research Methods,2017,49(3):896-912. [25] ZHANG W,SHU L,XU X,et al.Affective virtual reality system(AVRS):design and ratings of affective VR scenes[C]//Proceedings of the 2017 International Conference on Virtual Reality and Visualization(ICVRV),2017. [26] ZHENG W L,LU B L.Investigating critical frequency bands and channels for EEG-based emotion recognition with deep neural networks[J].IEEE Transactions on Autonomous Mental Development,2015,7(3):162-175. [27] 权学良,曾志刚,蒋建华,等.基于生理信号的情感计算研究综述[J].自动化学报,2021,47(8):1769-1784. QUAN X L,ZENG Z G,JIANG J H,et al.Physiological signals based affective computing:a systematic review[J].Acta Automatica Sinica,2021,47(8):1769-1784. [28] KOELSTRA S,MUHL C,SOLEYMANI M,et al.DEAP:a database for emotion analysis using physiological signals[J].IEEE Transactions on Affective Computing,2012,3(1):18-31. [29] ZHENG W L,LIU W,LU Y F,et al.Emotion meter:a multimodal framework for recognizing human emotions[J].IEEE Transactions on Cybernetics,2019,49(3):1110-1122. [30] SOLEYMANI M,LICHTENAUER J,PUN T,et al.A multimodal database for affect recognition and implicit tagging[J].IEEE Transactions on Affective Computing,2012,3(1):42-55. [31] SONG T,ZHENG W,LU C,et al.MPED:a multi-modal physiological emotion database for discrete emotion recognition[J].IEEE Access,2019,7:12177-12191. [32] KATSIGIANNIS S,RAMZAN N.DREAMER:a database for emotion recognition through EEG and ECG signals from wireless low?cost off?the?shelf devices[J].IEEE Journal of Biomedical and Health Informatics,2018,22(1):98-107. [33] WANG J,WANG M.Review of the emotional feature extraction and classification using EEG signals[J].Cognitive Robotics,2021,1:29-40. [34] SENHADJI L,KACHENOURA A,ALBERA L,et al.On the use of independent component analysis techniques in the field of brain computer interface[J].Intermediate Range Ballistic Missile,2009,30(5/6):211-217. [35] OFNER P,MULLER-PUTZ G R.Movement target decoding from EEG and the corresponding discriminative sources:a preliminary study[C]//Proceedings of the 37th Annual International Conference of the IEEE-Engineering-in-Medicine-and-Biology-Society(EMBC),Milan,Italy,Aug 25-29,2015. [36] TSUCHIMOTO S,SHIBUSAWA S,IWAMA S,et al.Use of common average reference and large-Laplacian spatial-filters enhances EEG signal-to-noise ratios in intrinsic sensorimotor activity[J].Journal of Neuroscience Methods,2021,353. [37] LI X,FAN H,WANG H,et al.Common spatial patterns combined with phase synchronization information for classification of EEG signals[J].Biomedical Signal Processing and Control,2019,52:248-256. [38] PETRANTONAKIS P C,HADJILEONTIADIS L J.Emotion recognition from EEG using higher order crossings[J].IEEE Transactions on Information Technology in Biomedicine,2010,14(2):186-197. [39] PETRANTONAKIS P C,HADJILEONTIADIS L J.Emotion recognition from brain signals using hybrid adaptive filtering and higher order crossings analysis[J].IEEE Transactions on Affective Computing,2010,1(2):81-97. [40] LIU Y S,SOURINA O.EEG-based subject-dependent emotion recognition algorithm using fractal dimension[C]//Proceedings of the IEEE International Conference on Systems,Man,and Cybernetics(SMC),San Diego,CA,Oct 05-08,2014. [41] ATKINSON J,CAMPOS D.Improving BCI-based emotion recognition by combining EEG feature selection and kernel classifiers[J].Expert Systems with Applications,2016,47:35-41. [42] YUEN CT S S W,SEONG T C,RIZON M.Classification of human emotions from EEG signals using statistical features and neural network[J].International Journal of Integrated Engineering,2009,1(3). [43] KASHIHARA K.A brain-computer interface for potential non-verbal facial communication based on EEG signals related to specific emotions[J].Frontiers in Neuroscience,2014,8. [44] ZHANG Q,LEE M.A hierarchical positive and negative emotion understanding system based on integrated analysis of visual and brain signals[J].Neurocomputing,2010,73(16/18):3264-3272. [45] ZHU Y S,ZHONG Q H.Differential entropy feature signal extraction based on activation mode and its recognition in convolutional gated recurrent unit network[J].Frontiers in Physics,2021,8. [46] SUBASI A.EEG signal classification using wavelet feature extraction and a mixture of expert model[J].Expert Systems with Applications,2007,32(4):1084-1093. [47] YI L,FAN Y L,LI G,et al.Sleep stage classification based on EEG hilbert-huang transform[C]//Proceedings of the 4th IEEE Conference on Industrial Electronics and Applications,May 25-27,2009. [48] OLAMAT A,OZEL P,ATASEVER S.Deep learning methods for multi-channel EEG-based emotion recognition[J].International Journal of Neural Systems,2022,32(5):2250021. [49] ASGHAR M A,KHAN M J,RIZWAN M,et al.AI inspired EEG-based spatial feature selection method using multivariate empirical mode decomposition for emotion classification[J].Multimedia Systems,2022,28(4):1275-1288. [50] GUPTA V,CHOPDA M D,PACHORI R B.Cross-subject emotion recognition using flexible analytic wavelet transform from EEG signals[J].IEEE Sensors Journal,2019,19(6):2266-2274. [51] GUIDO R C.A tutorial review on entropy-based handcrafted feature extraction for information fusion[J].Information Fusion,2018,41:161-175. [52] VIJITH V S,JACOB J E,IYPE T,et al.Epileptic seizure detection using non linear analysis of EEG[C]//Proceedings of the IEEE International Conference on Inventive Computation Technologies(ICICT),Coimbatore,India,Aug 26-27,2016. [53] ZHANG C,WANG H,FU R.Automated detection of driver fatigue based on entropy and complexity measures[J].IEEE Transactions on Intelligent Transportation Systems,2014,15(1):168-177. [54] NICOLAOU N,GEORGIOU J.Detection of epileptic electroencephalogram based on permutation entropy and support vector machines[J].Expert Systems with Applications,2012,39(1):202-209. [55] ZHANG A,YANG B,HUANG L.Feature extraction of EEG signals using power spectral entropy[C]//2008 International Conference on BioMedical Engineering and Informatics,2008:435-439. [56] DUAN R N,ZHU J Y,LU B L.Differential entropy feature for EEG-based emotion classification[C]//2013 6th International IEEE/EMBS Conference on Neural Engineering(NER),2013:81-84. [57] 张悦,胡春燕.基于有记忆递归神经网络的脑电特征情感识别研究[J].电子科技,2020,33(11):67-72. ZHANG Y,HU C Y.Research on emotion recognition of EEG features based on the long short-term memory neural network[J].Electronic Science and Technology,2020,33(11):67-72. [58] DOMA V,PIROUZ M.A comparative analysis of machine learning methods for emotion recognition using EEG and peripheral physiological signals[J].Journal of Big Data,2020,7(1):18. [59] LECUN Y,MATAN O,BOSER B E,et al.Handwritten zip code recognition with multilayer networks[C]//Proceedings 10th International Conference on Pattern Recognition,1990:35-40. [60] HUANG W K,XUE Y H,HU L K,et al.S-EEGNet:electroencephalogram signal classification based on a separable convolution neural network with bilinear interpolation[J].IEEE Access,2020,8:131636-131646. [61] ZHENG X W,YU X M,YIN Y Q,et al.Three-dimensional feature maps and convolutional neural network-based emotion recognition[J].International Journal of Intelligent Systems,2021,36(11):6312-6336. [62] GAO Z K,LI R M,MA C,et al.Core-brain-network-based multilayer convolutional neural network for emotion recognition[J].IEEE Transactions on Instrumentation and Measurement,2021,70. [63] WU Y H,XIA M,NIE L,et al.Simultaneously exploring multi-scale and asymmetric EEG features for emotion recognition[J].Computers in Biology and Medicine,2022,149. [64] CUI H,LIU A,ZHANG X,et al.EEG-based emotion recognition using an end-to-end regional-asymmetric convolutional neural network[J].Knowledge-Based Systems,2020,205:106243. [65] CHENG W X,GAO R B,SUGANTHAN P N,et al.EEG-based emotion recognition using random convolutional neural networks[J].Engineering Applications of Artificial Intelligence,2022,116. [66] KIM S,KIM T S,LEE W H.Accelerating 3D convolutional neural network with channel bottleneck module for EEG-based emotion recognition[J].Sensors,2022,22(18). [67] SU Y,ZHANG Z X,LI X,et al.The multiscale 3D convolutional network for emotion recognition based on electroencephalogram[J].Frontiers in Neuroscience,2022,16. [68] HINTON G E,OSINDERO S,TEH Y W.A fast learning algorithm for deep belief nets[J].Neural Computation,2006,18:1527-1554. [69] THAMMASAN N,FUKUI K I,NUMAO M.Application of deep belief networks in eeg-based dynamic music-emotion recognition[C]//2016 International Joint Conference on Neural Networks(IJCNN),2016:881-888. [70] 罗映雪,贾博,裘旭益,等.基于Gamma深度信念网络的飞行员脑疲劳状态识别[J].电子学报,2020,48(6):1062-1070. LUO Y X,JIA B,QIU X Y,et al.Pilots’brain fatigue state inference based on Gamma deep belief network[J].Acta Electronica Sinica,2020,48(6):1062-1670. [71] 杨豪,张俊然,蒋小梅,等.基于深度信念网络脑电信号表征情绪状态的识别研究[J].生物医学工程学杂志,2018,35(2):182-190. YANG H,ZHANG J R,JIANG X M,et al.Research of electroencephalography representational emotion recognition based on deep belief networks[J].Journal of Biomedical Engineering,2018,35(2):182-190. [72] CHEN J X,JIANG D M,ZHANG N.A hierarchical bidirectional GRU model with attention for EEG-based emotion classification[J].IEEE Access,2019,7:118530-118540. [73] WEI C,CHEN L,SONG Z Z,et al.EEG-based emotion recognition using simple recurrent units network and ensemble learning[J].Biomed Signal Process Control,2020,58:101756. [74] 刘鹏,乔晓艳.基于深度自编码和LSTM循环网络的脑电情感识别[J].测试技术学报,2022,36(2):129-134. LIU P,QIAO X Y.EEG emotion recognition based on deep auto-encoder LSTM[J].Journal of Test and Measurement Technology,2022,36(2):129-134. [75] ALGARNI M,SAEED F,HADHRAMI T A,et al.Deep learning-based approach for emotion recognition using electroencephalography(EEG) signals using bi-directional long short-term memory(Bi-LSTM)[J].Sensors(Basel,Switzerland),2022,22. [76] LI Y,WANG L,ZHENG W,et al.A novel bi-hemispheric discrepancy model for EEG emotion recognition[J].IEEE Transactions on Cognitive and Developmental Systems,2021,13:354-367. [77] ZHANG T,ZHENG W,CUI Z,et al.Spatial-temporal recurrent neural network for emotion recognition[J].IEEE Transactions on Cybernetics,2019,49:839-847. [78] LI Y,ZHENG W,WANG L,et al.From regional to global brain:a novel hierarchical spatial-temporal neural network model for EEG emotion recognition[J].IEEE Transactions on Affective Computing,2022,13:568-578. [79] SABOUR S,FROSST N,HINTON G E.Dynamic routing between capsules[J].arXiv:1710.09829,2017. [80] LIU Y,DING Y,LI C,et al.Multi-channel EEG-based emotion recognition via a multi-level features guided capsule network[J].Computers in Biology and Medicine,2020,123:103927. [81] 杨巨成,韩书杰,毛磊,等.胶囊网络模型综述[J].山东大学学报(工学版),2019,49(6):1-10. YANG J C,HAN S J,MAO L,et al.Review of capsule network[J].Journal of Shandong University(Engineering Science),2019,49(6):1-10. [82] CHAO H,DONG L,LIU Y,et al.Emotion recognition from multiband EEG signals using CapsNet[J].Sensors(Basel,Switzerland),2019,19. [83] DENG L,WANG X,JIANG F,et al.EEG-based emotion recognition via capsule network with channel-wise attention and LSTM models[J].CCF Transactions on Pervasive Computing and Interaction,2021,3(4):425-435. [84] LI C,WANG B,ZHANG S,et al.Emotion recognition from EEG based on multi-task learning with capsule network and attention mechanism[J].Computers in Biology and Medicine,2022,143:105303. [85] 谌鈫,陈兰岚,江润强.集成胶囊网络的脑电情绪识别[J].计算机工程与应用,2022,58(8):175-184. CHEN Q,CHEN L L,JIANG R Q.Emotion recognition of EEG based on ensemble CapsNet[J].Computer Engineering and Applications,2022,58(8):175-184. [86] JANA G C,SABATH A,AGRAWAL A.Capsule neural networks on spatio-temporal EEG frames for cross-subject emotion recognition[J].Biomedical Signal Processing and Control,2022,72:103361. [87] KIPF T,WELLING M.Semi-supervised classification with graph convolutional networks[J].arXiv:1609.02907v4,2017. [88] SUCH F P,SAH S,DOMíNGUEZ M,et al.Robust spatial filtering with graph convolutional neural networks[J].IEEE Journal of Selected Topics in Signal Processing,2017,11:884-896. [89] WANG M,EL-FIQI H,HU J,et al.Convolutional neural networks using dynamic functional connectivity for EEG-based person identification in diverse human states[J].IEEE Transactions on Information Forensics and Security,2019,14:3259-3272. [90] SONG T,ZHENG W,SONG P,et al.EEG emotion recognition using dynamical graph convolutional neural networks[J].IEEE Transactions on Affective Computing,2020,11:532-541. [91] 高越,傅湘玲,欧阳天雄,等.基于时空自适应图卷积神经网络的脑电信号情绪识别[J].计算机科学,2022,49(4):30-36. GAO Y,FU X L,OUYANG T X,et al.EEG emotion recognition based on spatiotemporal self-adaptive graph convolutional neural network[J].Computer Science,2022,49(4):30-36. [92] YIN Y,ZHENG X,HU B,et al.EEG emotion recognition using fusion model of graph convolutional neural networks and LSTM[J].Applied Soft Computing,2021,100:106954. [93] LI Y,HUANG J,ZHOU H,et al.Human emotion recognition with electroencephalographic multidimensional features by hybrid deep neural networks[J].Applied Sciences,2017,7:1060. [94] YANG Y,GAO Z,WANG X,et al.A recurrence quantification analysis-based channel-frequency convolutional neural network for emotion recognition from EEG[J].Chaos,2018,28(8):085724. [95] LI X,ZHANG Y,TIWARI P,et al.EEG based emotion recognition:a tutorial and review[J].ACM Computing Surveys,2022,55:1-57. [96] LI J,ZHANG Z,HE H.Hierarchical convolutional neural networks for EEG-based emotion recognition[J].Cognitive Computation,2017,10:368-380. [97] 毛小玲,向往,欧阳明昆,等.基于改进卷积神经网络的脑电信号焦虑情绪量化识别[J].广西科学,2022,29(2):269-276. MAO X L,XIANG W,OUYANG M K,et al.Recognition of anxiety in EEG based on modified convolutional neural network[J].Guangxi Sciences,2022,29(2):269-276. [98] 张学军,陈都,孙知信.基于卷积神经网络的脑电信号情绪分类方法[J].电子测量技术,2022,45(1):1-7. ZHANG X J,CHEN D,SUN Z X.Emotion classification method of EEG signals based on convolutional neural networks[J].Electronic Measurement Technology,2022,45(1):1-7. [99] 李玉花,柳倩,韦新,等.基于卷积神经网络的脑电信号分类[J].科学技术与工程,2020,20(15):6135-6140. LI Y H,LIU Q,WEI X,et al.Classification of EEG signals based on convolutional neural networks[J].Science Technology and Engineering,2020,20(15):6135-6140. [100] JOSE J M.Frame work for EEG based emotion recognition based on hybrid neural network[C]//2021 Seventh International Conference on Bio Signals,Images,and Instrumentation(ICBSII),2021:1-7. [101] LIU J,WU G,LUO Y,et al.EEG-based emotion classification using a deep neural network and sparse autoencoder[J].Frontiers in Systems Neuroscience,2020,14. [102] 张静,张雪英,陈桂军,等.结合3D-CNN和频-空注意力机制的EEG情感识别[J].西安电子科技大学学报,2022,49(3):191-198. ZHANG J,ZHANG X Y,CHEN G J,et al.EEG emotion recognition based on the 3D-CNN and spatial-frequency attention mechanism[J].Journal of Xidian University,2022,49(3):191-198. [103] XING X,LI Z,XU T,et al.SAE+LSTM:a new framework for emotion recognition from multi-channel EEG[J].Frontiers in Neurorobotics,2019,13. [104] MA J X,TANG H,ZHENG W L,et al.Emotion recognition using multimodal residual LSTM network[C]//Proceedings of the 27th ACM International Conference on Multimedia,2019. [105] LI Q,LIU Y Q,SHANG Y J,et al.Deep sparse autoencoder and recursive neural network for EEG emotion recognition[J].Entropy,2022,24(9). [106] ZHANG D,YAO L,ZHANG X,et al.Cascade and parallel convolutional recurrent neural networks on EEG-based intention recognition for brain computer interface[C]//Proceedings of the AAAI,2018. [107] LAWHERN V J,SOLON A J,WAYTOWICH N R,et al.EEGNet:a compact convolutional neural network for EEG-based brain-computer interfaces[J].Journal of Neural Engineering,2018,15. [108] ZHANG T,CUI Z,XU C,et al.Variational pathway reasoning for EEG emotion recognition[C]//Proceedings of the AAAI,2020. [109] LEW W C L,WANG D,SHYLOUSKAYA K,et al.EEG-based emotion recognition using spatial-temporal representation via Bi-GRU[C]//2020 42nd Annual International Conference of the IEEE Engineering in Medicine & Biology Society(EMBC),2020:116-119. [110] PAN S J,YANG Q.A survey on transfer learning[J].IEEE Transactions on Knowledge and Data Engineering,2010,22(10):1345-1359. [111] CHAI X,WANG Q S,ZHAO Y P,et al.A fast,efficient domain adaptation technique for cross-domain electroencephalography(EEG)-based emotion recognition[J].Sensors,2017,17(5):1014. [112] LI J P,QIU S,DU C D,et al.Domain adaptation for EEG emotion recognition based on latent representation similarity[J].IEEE Transactions on Cognitive and Developmental Systems,2020,12(2):344-353. [113] LUO J H,WU M,WANG Z Y,et al.Progressive low-rank subspace alignment based on semi-supervised joint domain adaption for personalized emotion recognition[J].Neurocomputing,2021,456:312-326. [114] ZHU L,DING W P,ZHU J P,et al.Multisource wasserstein adaptation coding network for EEG emotion recognition[J].Biomedical Signal Processing and Control,2022,76. [115] BAO G C,ZHUANG N,TONG L,et al.Two-level domain adaptation neural network for EEG-based emotion recognition[J].Frontiers in Human Neuroscience,2021,14. [116] HE Z Y,ZHUANG N,BAO G C,et al.Cross-day EEG-based emotion recognition using transfer component analysis[J].Electronics,2022,11(4). [117] DONG Y D,REN F J.Multi-reservoirs EEG signal feature sensing and recognition method based on generative adversarial networks[J].Computer Communications,2020,164:177-184. [118] GU X,CAI W,GAO M,et al.Multi-source domain transfer discriminative dictionary learning modeling for electroencephalogram-based emotion recognition[J].IEEE Transactions on Computational Social Systems,2022,9:1604-1612. [119] LI J Y,HUA H Q,XU Z H,et al.Cross-subject EEG emotion recognition combined with connectivity features and meta-transfer learning[J].Computers in Biology and Medicine,2022,145. [120] WANG F,ZHANG W W,XU Z F,et al.A deep multi-source adaptation transfer network for cross-subject electroencephalogram emotion recognition[J].Neural Computing & Applications,2021,33(15):9061-9073. [121] TANG H Y,JIANG G S,WANG Q D.Deep neural network for emotion recognition based on meta-transfer learning[J].IEEE Access,2022,10:78114-78122. [122] LIN Y P.Constructing a personalized cross-day EEG-based emotion-classification model using transfer learning[J].IEEE Journal of Biomedical and Health Informatics,2020,24(5):1255-1264. [123] WANG Y X,QIU S,MA X L,et al.A prototype-based SPD matrix network for domain adaptation EEG emotion recognition[J].Pattern Recognition,2021,110. [124] WANG F,WU S C,ZHANG W W,et al.Emotion recognition with convolutional neural network and EEG-based EFDMs[J].Neuropsychologia,2020,146. [125] HE Z P,ZHONG Y S,PAN J H.An adversarial discriminative temporal convolutional network for EEG-based cross-domain emotion recognition[J].Computers in Biology and Medicine,2022,141. [126] LAN Z R,SOURINA O,WANG L P,et al.Domain adaptation techniques for EEG-based emotion recognition:a comparative study on two public datasets[J].IEEE Transactions on Cognitive and Developmental Systems,2019,11(1):85-94. [127] ZHANG X,LIANG W,DING T,et al.Individual similarity guided transfer modeling for EEG-based emotion recognition[C]//Proceedings of the 2019 IEEE International Conference on Bioinformatics and Biomedicine(BIBM),2019. [128] RAINA R,BATTLE A,LEE H,et al.Self-taught learning:transfer learning from unlabeled data[C]//Proceedings of the 24th International Conference on Machine learning,2007. [129] PAN S J,TSANG I W,KWOK J T,et al.Domain adaptation via transfer component analysis[J].IEEE Transactions on Neural Networks,2010,22(2):199-210. [130] GONG B,SHI Y,SHA F,et al.Geodesic flow kernel for unsupervised domain adaptation[C]//Proceedings of the 2012 IEEE Conference on Computer Vision and Pattern Recognition,2012. [131] LONG M,WANG J,DING G,et al.Transfer feature learning with joint distribution adaptation[C]//Proceedings of the IEEE International Conference on Computer Vision,2013. [132] ZHENG W L,ZHANG Y Q,ZHU J Y,et al.Transfer components between subjects for EEG-based emotion recognition[C]//Proceedings of the 2015 International Conference on Affective Computing and Intelligent Interaction(ACII),2015. [133] LIN Y P,JUNG T P.Improving EEG-based emotion classification using conditional transfer learning[J].Frontiers in Human Neuroscience,2017,11. [134] LONG M,CAO Y,WANG J,et al.Learning transferable features with deep adaptation networks[C]//Proceedings of the International Conference on Machine Learning,2015. [135] SUN B,SAENKO K.Deep coral:correlation alignment for deep domain adaptation[C]//Proceedings of the European Conference on Computer Vision,2016. [136] CHEN J X,MIN C D,WANG C H,et al.Electroencephalograph-based emotion recognition using brain connectivity feature and domain adaptive residual convolution model[J].Frontiers in Neuroscience,2022,16. [137] CHAI X,WANG Q,ZHAO Y,et al.Unsupervised domain adaptation techniques based on auto-encoder for non-stationary EEG-based emotion recognition[J].Computers in Biology and Medicine,2016,79:205-214. [138] MENG M,HU J H,GAO Y Y,et al.A deep subdomain associate adaptation network for cross-session and cross-subject EEG emotion recognition[J].Biomedical Signal Processing and Control,2022,78. [139] GONZALEZ H A,YOO J,ELFADEL I M.EEG-based emotion detection using unsupervised transfer learning[C]//proceedings of the 2019 41st Annual International Conference of the IEEE Engineering in Medicine and Biology Society(EMBC),2019. [140] LUO Y,ZHANG S Y,ZHENG W L,et al.WGAN domain adaptation for EEG-based emotion recognition[C]//Proceedings of the International Conference on Neural Information Processing,2018. [141] LI J,QIU S,SHEN Y Y,et al.Multisource transfer learning for cross-subject EEG emotion recognition[J].IEEE Transactions on Cybernetics,2019,50(7):3281-3293. [142] YOSINSKI J,CLUNE J,BENGIO Y,et al.How transferable are features in deep neural networks?[C]//Proceedings of the 27th International Conference on Advances in Neural Information Processing Systems,2014:3320-3328. [143] TAJBAKHSH N,SHIN J Y,GURUDU S R,et al.Convolutional neural networks for medical image analysis:full training or fine tuning?[J].IEEE Transactions on Medical Imaging,2016,35(5):1299-1312. [144] TZENG E,HOFFMAN J,SAENKO K,et al.Adversarial discriminative domain adaptation[C]//Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition,2017. [145] GANIN Y,USTINOVA E,AJAKAN H,et al.Domain-adversarial training of neural networks[J].The Journal of Machine Learning Research,2016,17(1):2096-2030. |
[1] | 陈吉尚, 哈里旦木·阿布都克里木, 梁蕴泽, 阿布都克力木·阿布力孜, 米克拉依·艾山, 郭文强. 深度学习在符号音乐生成中的应用研究综述[J]. 计算机工程与应用, 2023, 59(9): 27-45. |
[2] | 姜秋香, 郭伟鹏, 王子龙, 欧阳兴涛, 隆睿睿. Python语言在水文水资源领域中的应用与展望[J]. 计算机工程与应用, 2023, 59(9): 46-58. |
[3] | 罗会兰, 陈翰. 时空卷积注意力网络用于动作识别[J]. 计算机工程与应用, 2023, 59(9): 150-158. |
[4] | 岱超, 刘萍, 史俊才, 任鸿杰. 利用U型网络的遥感影像建筑物规则化提取[J]. 计算机工程与应用, 2023, 59(8): 105-116. |
[5] | 徐志京, 刘霞. 基于级联双通道分阶段融合的双模态情感识别[J]. 计算机工程与应用, 2023, 59(8): 127-137. |
[6] | 刘华玲, 皮常鹏, 赵晨宇, 乔梁. 基于深度域适应的跨域目标检测算法综述[J]. 计算机工程与应用, 2023, 59(8): 1-12. |
[7] | 何家峰, 陈宏伟, 骆德汉. 深度学习实时语义分割算法研究综述[J]. 计算机工程与应用, 2023, 59(8): 13-27. |
[8] | 张艳青, 马建红, 韩颖, 曹仰杰, 李颉, 杨聪. 真实场景下图像超分辨率重建研究综述[J]. 计算机工程与应用, 2023, 59(8): 28-40. |
[9] | 韦健, 赵旭, 李连鹏. 融合位置信息注意力的孪生弱目标跟踪算法[J]. 计算机工程与应用, 2023, 59(7): 198-206. |
[10] | 赵宏伟, 郑嘉俊, 赵鑫欣, 王胜春, 李浥东. 基于双模态深度学习的钢轨表面缺陷检测方法[J]. 计算机工程与应用, 2023, 59(7): 285-293. |
[11] | 孙庆港, 王呈. 改进LSTM-AE算法的电梯知识库故障征兆预测[J]. 计算机工程与应用, 2023, 59(7): 311-318. |
[12] | 王静, 金玉楚, 郭苹, 胡少毅. 基于深度学习的相机位姿估计方法综述[J]. 计算机工程与应用, 2023, 59(7): 1-14. |
[13] | 蒋玉英, 陈心雨, 李广明, 王飞, 葛宏义. 图神经网络及其在图像处理领域的研究进展[J]. 计算机工程与应用, 2023, 59(7): 15-30. |
[14] | 周玉蓉, 张巧灵, 于广增, 徐伟强. 基于声信号的工业设备故障诊断研究综述[J]. 计算机工程与应用, 2023, 59(7): 51-63. |
[15] | 吕晓玲, 杨胜月, 张明路, 梁明, 王俊超. 改进YOLOv5网络的鱼眼图像目标检测算法[J]. 计算机工程与应用, 2023, 59(6): 241-250. |
阅读次数 | ||||||
全文 |
|
|||||
摘要 |
|
|||||