Aspect-Level Cross-Domain Sentiment Analysis Based on CNN

doi:10.3778/j.issn.1002-8331.2101-0316

Abstract

Abstract: In recent years, more and more researchers focus on the aspect-level sentiment analysis field. However, for aspect-level cross-domain sentiment analysis problems, no labeled data may lead to difficulty to obtain good classification results. This paper constructs a sentiment classification model based on convolutional neural networks and gated units by merging the contextual features and aspect features, and then uses a small amount of target domain data to fine-tune the model, carry out transfer learning, and analyze aspect-level sentiment of target domain, which effectively alleviates the problems of insufficient training samples and low accuracy of results. Chinese and English corpora suitable for the cross-domain aspect sentiment analysis are manually annotated. The optimal F1 value of the proposed method for Chinese data set achieves 92.19% and the optimal F1 value for the English data set achieves 86.18%. The experimental results show that the cross-domain aspect sentiment analysis model based on CNN can effectively improve the accuracy of sentiment classification in the target domain.

Key words: aspect-level sentiment analysis, transfer learning, cross-domain, convolutional neural network

摘要： 近年来，方面级情感分析吸引了越来越多学者的关注，但方面级跨领域情感分析存在没有标注数据，难以获得好的分类结果的问题。将上下文特征与方面特征进行融合，构建基于卷积神经网络和门控单元的情感分类模型，并利用少量目标领域数据集对模型进行微调来实现迁移学习，再用迁移学习后的模型对目标领域的数据进行方面级情感分析，有效解决了训练样本不足、准确率低的问题。人工标注了适用于方面级跨领域情感分析的中、英文语料，所提出的方法在中文数据集最优的F1值达到92.19%，英文数据集最优的F1值达到了86.18%，实验结果表明基于卷积神经网络的方面级跨领域情感分析方法有效提高了目标领域的情感分类准确性。

关键词: 方面级情感分析, 迁移学习, 跨领域, 卷积神经网络

MENG Jiana, LYU Pin, YU Yuhai, ZHENG Zhikun. Aspect-Level Cross-Domain Sentiment Analysis Based on CNN[J]. Computer Engineering and Applications, 2022, 58(16): 175-183.

孟佳娜, 吕品, 于玉海, 郑志坤. 基于CNN的方面级跨领域情感分析研究[J]. 计算机工程与应用, 2022, 58(16): 175-183.

References

[1] PANG B，LEE L.Opinion mining and sentiment analysis[J].Foundations and Trends in Information Retrieval，2008，2（1/2）：1-135.
[2] LI X，BING L，ZHANG W，et al.Exploiting BERT for end-to-end aspect-based sentiment analysis[J].arXiv：1910.00883，
2019.
[3] ISHAQ A，ASGHAR S，GILLANI S A.Aspect-based sentiment analysis using a hybridized approach based on CNN and GA[J].IEEE Access，2020，8：135499-135512.
[4] LU Q，ZHU Z，ZHANG D，et al.Interactive rule attention network for aspect-level sentiment analysis[J].IEEE Access，2020，8：52505-52516.
[5] KIRITCHENKO S，ZHU X，CHERRY C，et al.NRC-Canada-2014：detecting aspects and sentiment in customer reviews[C]//Proceedings of the 8th International Workshop on Semantic Evaluation，2014：437-442.
[6] TANG D，QIN B，FENG X，et al.Effective LSTMs for target-dependent sentiment classification[J].arXiv：1512.01100，2015.
[7] TAI K S，SOCHER R，MANNING C D.Improved semantic representations from tree-structured long short-term memory networks[J].arXiv：1503.00075，2015.
[8] MA Y，PENG H，CAMBRIA E.Targeted aspect-based sentiment analysis via embedding commonsense knowledge into an attentive LSTM[C]//Proceedings of the 32nd AAAI Conference on Artificial Intelligence，the 30th Innovative Applications of Artificial Intelligence，and the 8th AAAI Symposium on Educational Advances in Artificial Intelligence，2018：5876-5883.
[9] MA D，LI S，ZHANG X，et al.Interactive attention networks for aspect-level sentiment classification[J].arXiv：1709.00893，
2017.
[10] WESTON J，CHOPRA S，BORDES A.Memory networks[J].arXiv：1410.3916，2014.
[11] TANG D，QIN B，LIU T.Aspect level sentiment classification with deep memory network[J].arXiv：1605.08900，2016.
[12] CHEN P，SUN Z，BING L，et al.Recurrent attention network on memory for aspect sentiment analysis[C]//Proceedings of the 2017 Conference on Empirical Methods in Natural Language Processing，2017：452-461.
[13] LI X，BING L，LAM W，et al.Transformation networks for target-oriented sentiment classification[J].arXiv：1805.01086，
2018.
[14] XUE W，LI T.Aspect based sentiment analysis with gated convolutional networks[J].arXiv：1805.07043，2018.
[15] AKDEMIR A.Research on task discovery for transfer learning in deep neural networks[C]//Proceedings of the 58th Annual Meeting of the Association for Computational Linguistics：Student Research Workshop，2020：33-41.
[16] BLITZER J，DREDZE M，PEREIRA F.Biographies，Bollywood，boom-boxes and blenders：domain adaptation for sentiment classification[C]//Proceedings of the 45th Annual Meeting of the Association of Computational Linguistics，2007：440-447.
[17] PAN S J，NI X，SUN J T，et al.Cross-domain sentiment classification via spectral feature alignment[C]//Proceedings of the 19th International Conference on World Wide Web，2010：751-760.
[18] GLOROT X，BORDES A，BENGIO Y.Domain adaptation for large-scale sentiment classification：a deep learning approach[C]//Proceedings of the 28th International Conference on Machine Learning，2011：513-520.
[19] CHEN M，XU Z，WEINBERGER K，et al.Marginalized denoising autoencoders for domain adaptation[J].arXiv：1206.4683，2012.
[20] YOSINSKI J，CLUNE J，BENGIO Y，et al.How transferable are features in deep neural networks?[C]//Advances in Neural Information Processing Systems，2014：3320-3328.
[21] LONG M，CAO Y，WANG J，et al.Learning transferable features with deep adaptation networks[C]//Proceedings of the 32nd International Conference on Machine Learning，2015：97-105.
[22] 李伟.面向迁移学习的文本特征提取[D].天津：天津大学，2012.
LI W.Text feature extraction for transfer learning[D].Tianjin：Tianjin University，2012.
[23] LATIF S，RANA R，YOUNIS S，et al.Transfer learning for improving speech emotion classification accuracy[J].arXiv：1801.06353，2018.
[24] GAO J，LING H，HU W，et al.Transfer learning based visual tracking with Gaussian processes regression[C]//Proceedings of the 13th European Conference on Computer Vision，2014：188-203.
[25] WEISS K，KHOSHGOFTAAR T M，WANG D D.A survey of transfer learning[J].Journal of Big Data，2016，3（1）：9.
[26] WU Q，TAN S.A two-stage framework for cross-domain sentiment classification[J].Expert Systems with Applications，2011，38（11）：14269-14275.
[27] SHARMA R，BHATTACHARYYA P，DANDAPAT S，et al.Identifying transferable information across domains for cross-domain sentiment classification[C]//Proceedings of the 56th Annual Meeting of the Association for Computational Linguistics（Volume 1：Long Papers），2018：968-978.
[28] GANIN Y，USTINOVA E，AJAKAN H，et al.Domain-adversarial training of neural networks[J].The Journal of Machine Learning Research，2016，17（1）：59.