Aspect Level Sentiment Classification Model Based on AWI and GCN

doi:10.3778/j.issn.1002-8331.2108-0215

Abstract

Abstract: At present, in most studies of aspect-level sentiment classification, the modeling of aspect words and their interactions with context are ignored, and it is difficult to reflect the importance of context words which are directly related to aspect words grammatically. To address the problem above, based on aspect word interaction（AWI） and graph convolutional network（GCN）, this paper puts forward a model for the classification—AWI-GCN. Bi-directional long short-term memory（Bi-LSTM） is used to extract aspect words and context features respectively. GCN is adapted to further extract emotional context features directly related to aspect words on the basis of the dependency syntax tree. Attention-Mechanism is applied to learn the interactive information between aspect words and context, and at the same time to extract the emotional features of context that make important contributions to the emotion classification of aspect words. The simulation results on three open data sets show that the AWI-GCN model achieves better sentiment classification performance than the current representative one.

Key words: aspect sentiment classification, aspect word interaction, graph convolutional network, attention mechanism, syntactic dependency tree

摘要： 目前大多数方面级情感分类研究都忽略了方面词的建模，以及方面词与上下文之间的交互信息，并且难以体现语法上与方面词有直接联系上下文单词的重要程度。针对上述问题，提出基于方面词交互（aspect word interaction，AWI）和图卷积网络（graph convolutional network，GCN）的方面级情感分类模型（AWI-GCN）。使用双向长短期记忆网络（bi-directional long short-term memory，Bi-LSTM）分别提取方面词和上下文的特征；采用GCN根据句法依存树进一步提取与方面词有直接语法联系的上下文情感特征；利用注意力机制学习方面词与上下文的交互信息，同时提取上下文中为方面词情感分类做出重要贡献的情感特征。针对3个公开数据集上的仿真实验结果表明，AWI-GCN模型相比当前代表模型取得了更好的情感分类效果。

关键词: 方面级情感分类, 方面词交互, 图卷积网络, 注意力机制, 句法依存树

WANG Ze, KONG Weiwei, XUE Jiawei, PING Wen, LI Long. Aspect Level Sentiment Classification Model Based on AWI and GCN[J]. Computer Engineering and Applications, 2023, 59(3): 135-142.

王泽, 孔韦韦, 薛佳伟, 平稳, 李龙. 基于AWI和GCN的方面级情感分类模型[J]. 计算机工程与应用, 2023, 59(3): 135-142.

References

[1] ZHANG L，WANG S，LIU B.Deep learning for sentiment analysis：a survey[J].Wiley Interdisciplinary Reviews：Data Mining and Knowledge Discovery，2018，8（4）：e1253.
[2] ZHOU J，HUANG J X，CHEN Q，et al.Deep learning for aspect-level sentiment classification：survey，vision and challenges[J].IEEE Access，2019，7：78454-78483.
[3] 刘全，梁斌，徐进，等.一种用于基于方面情感分析的深度分层网络模型[J].计算机学报，2018，41（12）：2637-2652.
LIU Q，LIANG B，XU J，et al.A deep hierarchical neural network model for aspect-based sentiment analysis[J].Chinese Journal of Computers，2018，42（12）：2637-2652.
[4] MANEK A S，SHENOY P D，MOHAN M C，et al.Aspect term extraction for sentiment analysis in large movie reviews using Gini Index feature selection method and SVM classifier[J].World Wide Web，2017，20（2）：135-154.
[5] KAJI N，KITSUREGAWA M.Building lexicon for sentiment analysis from massive collection of html documents[C]//Proceedings of the 2007 Joint Conference on Empirical Methods in Natural Language Processing and Computational Natural Language Learning（EMNLP-CoNLL），2007：1075-1083.
[6] YOUNG T，HAZARIKA D，PORIA S，et al.Recent trends in deep learning based natural language processing[J].IEEE Computational Intelligence Magazine，2017，13（3）：55-75.
[7] TANG D，QIN B，FENG X，et al.Effective LSTMS for target-dependent sentiment classification[C]//Proceedings of COLING 2016，the 26th International Conference on Computational Linguistics：Technical Papers，2016：3298-3307.
[8] HOCHREITER S，SCHMIDHUBER J.Long short-term memory[J].Neural Computation，1997，9（8）：1735-1780.
[9] WANG Y，HUANG M，ZHU X，et al.Attention-based LSTM for aspect-level sentiment classification[C]//Proceedings of the Conference on Empirical Methods in Natural Language Processing（EMNLP），2016：606-615.
[10] VASWANI A，SHAZEER N，PARMAR N，et al.Attention is all you need[C]//Advances in Neural Information Processing Systems，2017：5998-6008.
[11] MA D，LI S，ZHANG X，et al.Interactive attention networks for aspect-level sentiment classification[C]//Twenty-Sixth International Joint Conference on Artificial Intelligence，2017：4067-4074.
[12] FAN Z，WU Z，DAI X，et al.Target-oriented opinion words extraction with target-fused neural sequence labeling[C]//Proceedings of the 2019 Conference of the North American Chapter of the Association for Computational Linguistics：Human Language Technologies，Volume 1（Long and Short Papers），2019：2509-2518.
[13] LI X，BING L，LAM W，et al.Transformation networks for target-oriented sentiment classification[C]//Proceedings of the 56th Annual Meeting of the Association for Computational Linguistics，2018：946-956.
[14] WEI X，TAO L.Aspect based sentiment analysis with gated convolutional networks[C]//Proceedings of the 56th Annual Meeting of the Association for Computational Linguistics（Volume 1：Long Papers），2018：2514-2523.
[15] CHEN Z，QIAN T Y.Transfer capsule network for aspect level sentiment classification[C]//Proceedings of the 57th Annual Meeting of the Association for Computational Linguistics，2019：547-556.
[16] ZHANG C，LI Q，SONG D.Aspect-based sentiment classification with aspect-specific graph convolutional networks[C]//Proceedings of the 2019 Conference on Empirical Methods in Natural Language Processing and the 9th International Joint Conference on Natural Language Processing（EMNLP-IJCNLP），2019：4560-4570.
[17] ZHENG Y W，ZHANG R H，MENSAH S，et al.Replicate，walk，and stop on syntax：an effective neural network model for aspect-level sentiment classification[C]//Proceedings of the AAAI Conference on Artificial Intelligence，2020：9685-9692.
[18] LU T L，CHEN L.End-to-end multi-hop memory network for aspect-level sentiment analysis[J].Application Research of Computers，2021，38（5）：1409-1415.
[19] ZHANG M，QIAN T Y.Convolution over hierarchical syntactic and lexical graphs for aspect level sentiment analysis[C]//Proceedings of the 2020 Conference on Empirical Methods in Natural Language Processing（EMNLP），2020：3540-3549.
[20] CHEN C H，TENG Z Y，ZHANG Y.Inducing target-specific latent structures for aspect sentiment classification[C]//Proceedings of the 2020 Conference on Empirical Methods in Natural Language Processing（EMNLP），2020：5596-5607.
[21] BENGIO Y，DUCHARME R，VINCENT P，et al.A neural probabilistic language model[J].Journal of Machine Learning Research，2003：1137-1155.
[22] KIPF T N，WELLING M.Semi-supervised classification with graph convolutional networks[J].arXiv：1609.02907，2016.
[23] KIM Y.Convolutional neural networks for sentence classification[C]//Proceedings of the Conference on Empirical Methods in Natural Language Processing（EMNLP），2014：1746-1751.
[24] SUN K，ZHANG R C，MENSAH，et al.Aspect-level sentiment analysis via convolution over dependency tree[C]//Proceedings of the 2019 Conference on Empirical Methods in Natural Language Processing and the 9th International Joint Conference on Natural Language Processing（EMNLP-IJCNLP），2019：5683-5692.