Research on Personality Identification Method by Fusing BERT and Syntactic Dependency

doi:10.3778/j.issn.1002-8331.2210-0497

Abstract

Abstract: To solve the technical challenge that how to effectively fuse the deep semantics of the text and the psychological cues, a personality identification model fusing BERT and syntactic dependency is proposed. Firstly, it uses BERT to extract the deep semantic information contained in the text, and obtains psychological cues with personality characteristics through syntax analysis, secondly, it designs a conditional fusion function to dynamically embed the mined knowledge as an external condition into the text representation vector, capturing the dynamic semantic interaction between these informations, finally, it uses the fully connected network to perform deep feature extraction and dimensionality reduction, so as to identify the personality. Experiments on the firstly constructed dataset for Chinese movie reviews have verified the efficacy of the proposed method. Compared with traditional neural networks and single BERT models, the model obtains a significant improvement in personality identification.

Key words: BERT model, dynamic semantic interaction, personality detection

摘要： 针对现有性格识别方法难以有效融合文本深层语义与心理学特征的技术挑战，提出了融合BERT与句法依存的性格识别模型。采用BERT提取文本蕴含的深层语义信息，通过词法与句法分析获得具有性格特征的心理学词汇，设计条件融合函数将该词汇作为外部条件动态嵌入到文本表示向量中，捕获文本深层语义与性格线索间动态的语义交互，基于融合后的特征向量使用全连接网络进行更深层的特征提取并降维，以此对性格进行识别。在首次构建的面向中文电影评论的性格数据集上的实验验证了该方法的有效性，该模型相较传统神经网络和单一BERT模型在性格识别准确性上有明显提升。

关键词: BERT模型, 动态语义交互, 性格识别

ZHANG Zhonglin, YUAN Chenyu, CHEN Liping, WU Yilin. Research on Personality Identification Method by Fusing BERT and Syntactic Dependency[J]. Computer Engineering and Applications, 2023, 59(18): 98-104.

张忠林, 袁晨予, 陈丽萍, 吴奕霖. 融合BERT与句法依存的性格识别方法研究[J]. 计算机工程与应用, 2023, 59(18): 98-104.

References

[1] DHELIM S，AUNG N，BOURAS M A，et al.A survey on personality-aware recommendation systems[J].Artificial Intelligence Review，2022，55（3）：2409-2454.
[2] 冯媛媛，刘克剑，李伟豪.基于BiLSTM+Self-Attention的多性格微博情感分类[J].西华大学学报（自然科学版），2022，41（1）：67-76.
FENG Y Y，LIU K J，LI W H.Research on multi-personality microblog sentiment classification based on BilSTM+Self-Attention[J].Journal of?Xihua?University（Natural?Science?Edition），2022，41（1）：67-76.
[3] 崔京月，董柔纯，李伟卿，等.网易云音乐不同人格用户的网络行为及歌词偏好特征分析[J].心理科学，2021，44（6）：1403-1410.
CUI J Y，DONG R C，LI W Q，et al.Research on personality of netease cloud music users：based on internet behavior and lyrics data[J].Journal of Psychological Science，2021，44（6）：1403-1410.
[4] PENNEBAKER J W，KING L A.Linguistic styles：language use as an individual difference[J].Journal of Personality and Socialpsychology，1999，77（6）：1296.
[5] PENNEBAKER J W，FRANCIS M E，BOOTH R J.Linguistic inquiry and word count：LIWC 2001[Z].Mahway：Lawrence Erlbaum Associates，2001.
[6] BOOT P，ZIJLSTRA H，GEENEN R.The dutch translation of the linguistic inquiry and word count （liwc） 2007 dictionary[J].Dutch Journal of Applied Linguistics，2017，6（1）：65-76.
[7] PENNEBAKER J W，BOYD R L，JORDAN K，et al.The development and psychometric properties of liwc2015[EB/OL].（2015-09-15）[2022-09-10].https：//www.liwc.app/help/psychometrics-manuals.
[8] MAJUMDER N，PORIA S，GELBUKH A，et al.Deep learning-based document modeling for personality detection from text[J].IEEE Intelligent Systems，2017，32（2）：74-79.
[9] REN Z，SHEN Q，DIAO X，et al.A sentiment-aware deep learning approach for personality detection from text[J].Information Processing & Management，2021，58（3）：102532.
[10] DARLIANSYAH A，NAEEM M A，MIRZA F，et al.Sentipede：a smart system for sentiment-based personality detection from short texts[J].Journal of Universal Computer Science，2019，25（10）：1323-1352.
[11] GOLBECK J.Predicting personality from social media text[J].AIS Transactions on Replication Research，2016，2（1）：1-10.
[12] PENNINGTON J，SOCHER R，MANNING C D.Glove：global vectors for word representation[C]//Proceedings of the 2014 Conference on Empirical Methods in Natural Language Processing（EMNLP），Doha，Qatar，October 25-29，2014：1532-1543.
[13] XUE X，FENG J，SUN X.Semantic-enhanced sequential modeling for personality trait recognition from texts[J].Applied Intelligence，2021，51（11）：7705-7717.
[14] VASWANI A，SHAZEER N，PARMAR N，et al.Attention is all you need[C]//Advances in Neural Information Processing Systems，2017：5998-6008.
[15] DEVLIN J，CHANG M W，LEE K，et al.Bert：pre-training of deep bidirectional transformers for language understanding[J].arXiv：1810.04805，2018.
[16] YANG F，QUAN X，YANG Y，et al.Multi-document transformer for personality detection[C]//Proceedings of the AAAI Conference on Artificial Intelligence，2021：14221-14229.
[17] 胡任远，刘建华，卜冠南，等.融合BERT的多层次语义协同模型情感分析研究[J].计算机工程与应用，2021，57（13）：176-184.
HU R Y，LIU J H，BU G N，et al.Research on sentiment analysis of multi-level semantic collaboration model fused with BERT[J].Computer Engineering and Applications，2021，57（13）：176-184.
[18] PORIA S，GELBUKH A，AGARWAL B，et al.Common sense knowledge based per-sonality recognition from text.[C]//Mexican International Conference on Artificial Intelligence，Mexico，November 24-30，2013：484-496.
[19] LIN J J，MAO W J，ZENG D D.Personality-based refinement for sentiment classification in microblog[J].Knowledge-Based Systems，2017，132（9）：204-214．
[20] 林俊杰.面向社交媒体的个性化情感分析与立场挖掘方法研究[D].北京：中国科学院大学，2018.
LIN J J.Studies on the approaches to personalized sentiment analysis and standpoint mining in social media[D].Beijing：University of Chinese Academy of Sciences，2018.
[21] 唐万，胡俊，张晖，等.Kappa系数：一种衡量评估者间一致性的常用方法（英文）[J].上海精神医学，2015，27（1）：62-67.
TANG W，HU J，ZHANG H，et al.Kappa coefficient：a popular measure of rater agreement[J].Shanghai Archives of Psychiatry，2015，27（1）：62-67.
[22] KIM Y.Convolutional neural networks for sentence classification.[C]//Proceedings of the 2014 Conference on Empirical Methods in Natural Language Processing（EMNLP），Doha，Qatar，October 25-29，2014：1746-1751.
[23] FEIZI-DERAKHSHI A R，FEIZI-DERAKHSHI M R，RAMEZANI M，et al.Text-based automatic personality prediction：a bibliographic review[J].Journal of Computational Social Science，2022：1-39.
[24] JIAO Z Y，SUN S Q，SUN K.Chinese lexical analysis with deep Bi-GRU-CRF network[J].arXiv：1807.01882，2018.