面向方面级情感分析的多视图表示模型

doi:10.3778/j.issn.1002-8331.2210-0231

摘要/Abstract

摘要： 面向特定方面的用户评论细粒度情感分析是当前自然语言处理领域一个热门的研究话题，针对评论语句在内容表达和句法结构上的灵活性，综合运用词性、句法、语义等知识增强评论语句的特征表示是当前一种主要的研究思路。基于此，提出一种多视图融合表示的图卷积网络模型。该模型通过自注意力和特定方面注意力，学习得到评论语句基于上下文的增强表示；分别利用句法依赖信息和词共现信息，通过图卷积操作得到评论语句基于句法和基于语义的两种不同表示；在获得三种不同视图表示的基础上设计了一种分层融合方式，通过对三种表示的不同组合与卷积操作实现不同视图表示间的信息共享与互补。五个公开数据集上的实验结果表明该模型较现有模型取得了更好的性能。

关键词: 方面级情感分析, 图卷积网络, 注意力机制, 多视图表示

Abstract: The fine-grained sentiment analysis of user comments for specific aspects is a popular research topic in the field of natural language processing. For the flexibility of comment statements in content expression and syntactic structure, the integrated use of lexical, syntactic and semantic knowledge to enhance the feature representation of comment statements is a major research idea at present. Based on this, a graph convolutional network model for multi-view fusion representation is proposed in this paper. First, the model learns to obtain context-based enhanced representations of comment statements through self-attention and aspect-specific attention. Second, two different representations of comment utterances based on syntax and semantics are obtained through graph convolution operations using syntactic dependency information and word co-occurrence information, respectively. Finally, a hierarchical fusion approach is designed based on obtaining three different view representations to achieve information sharing and complementarity among different view representations by combining and convolving the three representations. Experimental results on five publicly available datasets show that the model achieves better performance than existing models.

Key words: aspect-level sentiment analysis, graph convolution network, attention mechanism, multiview representation

徐学锋, 韩虎. 面向方面级情感分析的多视图表示模型[J]. 计算机工程与应用, 2024, 60(5): 112-121.

XU Xuefeng, HAN Hu. Multi-View Representation Model for Aspect-Level Sentiment Analysis[J]. Computer Engineering and Applications, 2024, 60(5): 112-121.

参考文献

[1] XIN W, LIU Y, SUN C, et al. Predicting polarities of tweets by composing word embeddings with long short-term memory[C]//Proceedings of the 53rd Annual Meeting of the Association for Computational Linguistics and the 7th International Joint Conference on Natural Language Processing, Beijing, China, July 26-31, 2015. Stroudsburg: ACL, 2015: 1343-1353.
[2] HUANG B, CARLEY K. Parameterized convolutional neural networks for aspect level sentiment classification[C]//Proceedings of the 2018 Conference on Empirical Methods in Natural Language Processing, Brussels, Belgium, October 31-November 4, 2018. Stroudsburg: ACL, 2018: 1091-1096.
[3] XIN L, BING L, LAM W, et al. Transformation networks for target-oriented sentiment classification[C]//Proceedings of the 56th Annual Meeting of the Association for Computational Linguistics, Melbourne, Australia, July 15-20, 2018. Stroudsburg: ACL, 2018: 946-956.
[4] TANG D, QIN B, LIU T. Aspect level sentiment classification with deep memory network[C]//Proceedings of the 2016 Conference on Empirical Methods in Natural Language Processing, Austin, Texas, USA, November 1-4, 2016. Stroudsburg: ACL, 2016: 214-224.
[5] HUANG B X, CARLEY K M. Syntax-aware aspect level sentiment classification with graph attention networks[C]//Proceedings of the 2019 Conference on Empirical Methods in Natural Language Processing and the 9th International Joint Conference on Natural Language Processing, Hong Kong, China, November 3-7, 2019. Stroudsburg: ACL, 2019: 5468-5476.
[6] SUN K, ZHANG R, Mensah S, et al. Aspect-level sentiment analysis via convolution over dependency tree[C]//Proceedings of the 2019 Conference on Empirical Methods in Natural Language Processing and the 9th International Joint Conference on Natural Language Processing, Hong Kong, China, November 3-7, 2019. Stroudsburg: ACL, 2019: 5679-5688.
[7] TANG D, QIN B, FENG X, et al. Target-dependent sentiment classification with long short term memory[C]//Proceedings of the 26th International Conference on Computational Linguistics: Technical Papers, Osaka, Japan, December 11-16, 2016. Stroudsburg: ACL, 2016: 3298-3307.
[8] WANG Y, HUANG M, ZHU X, et al. Attention-based LSTM for aspect-level sentiment classification[C]//Proceedings of the 2016 Conference on Empirical Methods in Natural Language Processing, Austin, Texas, USA, November 1-4, 2016. Stroudsburg: ACL, 2016: 606-615.
[9] MA D, LI S, ZHANG X, et al. Interactive attention networks for aspect-level sentiment classification[C]//Proceedings of the Twenty-Sixth International Joint Conference on Artificial Intelligence, Melbourne, Australia, August 19-25, 2017. San Francisco: Margan Kaufmann, 2017: 4068-4074.
[10] ZHANG C, LI Q, SONG D. Aspect-based sentiment classification with aspect-specific graph convolutional networks[C]//Proceedings of the 2019 Conference on Empirical Methods in Natural Language Processing and the 9th International Joint Conference on Natural Language Processing, Hong Kong, China, November 3-7, 2019. Stroudsburg: ACL, 2019: 4568-4578.
[11] HOU X, HUANG J, WANG G, et al. Selective attention based graph convolutional networks for aspect-level sentiment classification[C]//Proceedings of the Fifteenth Workshop on Graph-Based Methods for Natural Language Processing, 2021.
[12] LIANG B, YIN R, GUI L, et al. Jointly learning aspect-focused and inter-aspect relations with graph convolutional networks for aspect sentiment analysis[C]//Proceedings of the 28th International Conference on Computational Linguistics, 2020: 150-161.
[13] ZHANG M, QIAN T. Convolution over hierarchical syntactic and lexical graphs for aspect level sentiment analysis[C]//Proceedings of the 2020 Conference on Empirical Methods in Natural Language Processing, 2020: 3540-3549.
[14] WANG K, SHEN W, YANG Y, et al. Relational graph attention network for aspect-based sentiment analysis[C]//Proceedings of the 58th Annual Meeting of the Association for Computational Linguistics, 2020: 3229-3238.
[15] VASWANI A, SHAZEER N, PARMAR N, et al. Attention is all you need[C]//Proceedings of the 31th International Conference on Neural Information Processing Systems, 2017.
[16] LIU H, DOU Q. Neighborhood network for aspect-based sentiment analysis[C]//International Conference on Intelligent Information Processing, 2022: 216-227.
[17] ZHANG Z, ZHOU Z L, WANG Y N. SSEGCN: syntactic and semantic enhanced graph convolutional network for aspect-based sentiment analysis[C]//Proceedings of the 2022 Conference of the North American Chapter of the Association for Computational Linguistics: Human Language Technologies, 2022: 4916-4925.
[18] TANG H, YIN Q, CHANG L, et al. Enhancing aspect-based sentiment classification with local semantic information[C]//Proceedings of the International Conference on Bio-Inspired Computing: Theories and Applications, 2022: 118-131.
[19] WU H, ZHANG Z, SONG H, et al. Phrase dependency relational graph attention network for aspect-based Sentiment Analysis[J]. Knowledge-Based Systems, 2022, 236: 107736.
[20] 施荣华, 金鑫, 胡超. 基于图注意力网络的方面级别文本情感分析[J]. 计算机工程, 2022, 48(2): 34-39.
SHI R H, JIN X, HU C. Aspect-level text emotion analysis based on graph attention network[J]. Computer Engineering, 2022, 48(2): 34-39.
[21] PENNINGTON J, SOCHER R, MANNING C. Glove: global vectors for word representation[C]//Proceedings of the 2014 Conference on Empirical Methods in Natural Language Processing, Doha, Qatar, October 25-29, 2014. Stroudsburg: ACL, 2014: 1532-1543.
[22] MIKOLOV T, CHEN K, CORRADO G, et al. Efficient estimation of word representations in vector space[C]//International Conference on Learning Representations, 2013.
[23] DAI A, HU X, NIE J, et al. Learning from word semantics to sentence syntax by graph convolutional networks for aspect-based sentiment analysis[J]. International Journal of Data Science and Analytics, 2022, 14(1): 17-26.
[24] DEVLIN J, CHANG M W, LEE K, et al. BERT: pre-training of deep bidirectional transformers for language understanding[C]//Proceedings of the 2019 Conference of the North American Chapter of the Association for Computational Linguistics: Human Language Technologies, 2019.
[25] LI R, CHEN H, FENG F, et al. Dual graph convolutional networks for aspect-based sentiment analysis[C]//Proceedings of the 59th Annual Meeting of the Association for Computational Linguistics and the 11th International Joint Conference on Natural Language Processing, 2021: 6319-6329.
[26] LI D, WEI F, TAN C, et al. Adaptive recursive neural network for target-dependent twitter sentiment classification[C]//Proceedings of the 52nd Annual Meeting of the Association for Computational Linguistics, Baltimore, Maryland, USA, June 22-27, 2014. Stroudsburg: ACL, 2014: 49-54.
[27] PONTIKI M, GALANIS D, PAVLOPOULOS J, et al. Semeval-2014 task 4: aspect based sentiment analysis[C]//Proceedings of the 8th International Workshop on Semantic Evaluation, Dublin, Ireland, August 23-24, 2014. Stroudsburg: ACL, 2014: 27-35.
[28] PONTIKI M, GALANIS D, PAPAGEORGIOU H, et al. Semeval-2015 task 12: aspect based sentiment analysis[C]//Proceedings of the 9th International Workshop on Semantic Evaluation, Denver, Colorado, USA, June 4-5, 2015. Stroudsburg: ACL, 2015: 486-495.
[29] PONTIKI M, GALANIS D, PAPAGEORGIOU H, et al. Semeval-2016 task 5: aspect based sentiment analysis[C]//Proceedings of the 10th International Workshop on Semantic Evaluation, San Diego, California, June 16-17, 2016. Stroudsburg: ACL, 2016: 19-30.
[30] TAY Y, TUAN L A, HUI S C. Learning to attend via word-aspect associative fusion for aspect-based sentiment analysis[C]//Proceedings of the Thirty-Second AAAI Conference on Artificial Intelligence, New Orleans, Louisiana, USA, February 2-7, 2018. Menlo Park: AAAI, 2018: 5956-5963.
[31] 王汝言, 陶中原, 赵容剑, 等. 多交互图卷积网络用于方面情感分析[J]. 电子与信息学报, 2022, 44(3): 1111-1118.
WANG R Y, TAO Z Y, ZHAO R J, et al. Multi-interaction graph convolutional networks for aspect-level sentiment analysis[J]. Journal of Electronics and Information Technology, 2022, 44(3): 1111-1118.
[32] ZHOU J, HUANG J X, HU Q V, et al. SK-GCN: modeling syntax and knowledge via graph convolutional network for aspect-level sentiment classification[J]. Knowledge-Based Systems, 2020, 205(3): 106292.
[33] TANG H, JI D, LI C, et al. Dependency graph enhanced dual-transformer structure for aspect-based sentiment classification[C]//Proceedings of the 58th Annual Meeting of the Association for Computational Linguistics, 2020: 6578-6588.