Knowledge Enhanced Dual-Channel Multi-Head Graph Convolutional Networks for Aspect-Based Sentiment Analysis

doi:10.3778/j.issn.1002-8331.2306-0126

Abstract

Abstract: Aspect-based sentiment analysis (ABSA) is an important task in the field of natural language processing, and its goal is to classify the sentiment polarity of a given aspect word in a sentence. The current state-of-the-art ABSA model uses a graph neural network to process the semantic information and syntactic structure of sentences. However, these methods make insufficient use of syntactic dependency tree implication information, lack of mining of external knowledge, and ignore the removal of contextual noise introduced by the model. To address these issues, a knowledge enhanced dual-channel multi-head graph convolutional neural network is proposed. This model builds a semantic-based multi-head graph convolutional network and a syntax-based multi-head graph convolutional network. Using external emotional knowledge and syntactic dependency distance to reconstruct the syntactic dependency tree, so that the model can fully integrate external knowledge. A self-attention mechanism is used to construct a dynamic semantic map and filter the introduced noise, so as to pay more attention to aspect words. The accuracy of the model on the three public benchmark datasets Rest14, Lap14, and Twitter reaches 87.57%, 82.34%, and 77.75%, respectively, which is significantly better than the baseline model.

Key words: aspect-based sentiment analysis, external knowledge, multi-head graph convolution, self-attention mechanism, syntax-dependent distance

摘要： 方面级情感分析（aspect based sentiment analysis，ABSA）是自然语言处理领域的一个重要任务，其目标是对句子中给定的方面词进行情感极性的判断。目前，最先进的ABSA模型采用图神经网络处理句子的语义信息和句法结构。然而，这些方法对句法依赖树蕴含的信息使用不足，不仅缺少对外部知识的挖掘，而且忽略了对模型引入上下文噪声的消除。针对这些问题，提出了一种知识增强的双通道多头图卷积神经网络。该模型建立了基于语义的多头图卷积网络和基于句法的多头图卷积网络，利用外部情感知识以及句法依赖距离重构句法依赖树，使模型充分融入外部知识。同时采用自注意力机制构建动态语义图并过滤引入噪声，从而更多地关注方面词。模型在3个公开基准数据集Rest14、Lap14、Twitter上的准确率分别达到了87.57%、82.34%、77.75%，显著优于基线模型。

关键词: 方面级情感分析, 外部知识, 多头图卷积, 自注意力, 句法依赖距离

XIE Ze, CHEN Qingfeng, MO Shaocong, LIU chunyu, QIU Junlai. Knowledge Enhanced Dual-Channel Multi-Head Graph Convolutional Networks for Aspect-Based Sentiment Analysis[J]. Computer Engineering and Applications, 204, 60(17): 98-106.

谢泽, 陈庆锋, 莫少聪, 刘春雨, 邱俊铼. 知识增强的双通道多头GCN用于方面级情感分析[J]. 计算机工程与应用, 204, 60(17): 98-106.

References

[1] PONTIKI M, GALANIS D, PAPAGEORGIOU H, et al. SemEval-2016 task 5: aspect based sentiment analysis[C]//Proceedings of the 10th International Workshop on Semantic Evaluation, 2016: 19-30.
[2] SCHOUTEN K, FRASINCAR F. Survey on aspect-level sentiment analysis[J]. IEEE Transactions on Knowledge and Data Engineering, 2015, 28(3): 813-830.
[3] HU M, LIU B. Mining and summarizing customer reviews[C]//Proceedings of the 10th ACM SIGKDD International Conference on Knowledge Discovery and Data Mining, 2004: 168-177.
[4] KIRITCHENKO S, ZHU X, CHERRY C, et al. NRC-Canada-2014: detecting aspects and sentiment in customer reviews[C]//Proceedings of the 8th International Workshop on Semantic Evaluation , 2014: 437-442.
[5] XIE X, GE S, HU F, et al. An improved algorithm for sentiment analysis based on maximum entropy[J]. Soft Computing, 2019, 23(2): 599-611.
[6] XUE W, LI T. Aspect based sentiment analysis with gated convolutional networks[C]//Proceedings of the 56th Annual Meeting of the Association for Computational Linguistics, 2018: 2514-2523.
[7] WANG Y, HUANG M, ZHU X, et al. Attention-based LSTM for aspect-level sentiment classification[C]//Proceedings of the 2016 Conference on Empirical Methods in Natural Language Processing, 2016: 606-615.
[8] MA D, LI S, ZHANG X, et al. Interactive attention networks for aspect-level sentiment classification[C]//Proceedings of the 26th International Joint Conference on Artificial Intelligence, 2017: 4068-4074.
[9] SONG Y, WANG J, JIANG T, et al. Targeted sentiment classification with attentional encoder network[C]//Proceedings of the Artificial Neural Networks and Machine Learning-ICANN 2019: Text and Time Series, 2019: 93-103.
[10] SONG W, WEN Z, XIAO Z, et al. Semantics perception and refinement network for aspect-based sentiment analysis[J]. Knowledge-Based Systems, 2021, 214: 106755.
[11] WU C, XIONG Q, YANG Z, et al. Residual attention and other aspects module for aspect-based sentiment analysis[J]. Neurocomputing, 2021, 435: 42-52.
[12] ZHANG C, LI Q, SONG D. Aspect-based sentiment classification with aspect-specific graph convolutional networks[C]//Proceedings of the 2019 Conference on Empirical Methods in Natural Language Processing and the 9th International Joint Conference on Natural Language Processing, 2019: 4568-4578.
[13] ZHAO P, HOU L, WU O. Modeling sentiment dependencies with graph convolutional networks for aspect-level sentiment classification[J]. Knowledge-Based Systems, 2020, 193: 105443.
[14] WANG X, ZHU M, BO D, et al. AM-GCN: adaptive multichannel graph convolutional networks[C]//Proceedings of the 26th ACM SIGKDD International Conference on Knowledge Discovery & Data Mining, 2020: 1243-1253.
[15] KIM Y. Convolutional neural networks for sentence classification[C]//Proceedings of the 2014 Conference on Empirical Methods in Natural Language Processing, 2014: 1746-1751.
[16] TANG D, QIN B, FENG X, et al. Effective LSTMs for target-dependent sentiment classification[J]. arXiv: 1512.01100, 2015.
[17] ZHANG M, QIAN T. Convolution over hierarchical syntactic and lexical graphs for aspect level sentiment analysis[C]//Proceedings of the 2020 Conference on Empirical Methods in Natural Language Processing, 2020: 3540-3549.
[18] LI R, CHEN H, FENG F, et al. Dual graph convolutional networks for aspect-based sentiment analysis[C]//Proceedings of the 59th Annual Meeting of the Association for Computational Linguistics and the 11th International Joint Conference on Natural Language Processing, 2021: 6319-6329.
[19] ZHANG Z, ZHOU Z, WANG Y. SSEGCN: syntactic and semantic enhanced graph convolutional network for aspect-based sentiment analysis[C]//Proceedings of the 2022 Conference of the North American Chapter of the Association for Computational Linguistics: Human Language Technologies, 2022: 4916-4925.
[20] BIE Y, YANG Y, ZHANG Y. Fusing syntactic structure information and lexical semantic information for end-to-end aspect-based sentiment analysis[J]. Tsinghua Science and Technology, 2022, 28(2): 230-243.
[21] LINMEI H, YANG T, SHI C, et al. Heterogeneous graph attention networks for semi-supervised short text classification[C]//Proceedings of the 2019 Conference on Empirical Methods in Natural Language Processing and the 9th International Joint Conference on Natural Language Processing, 2019: 4821-4830.
[22] LIU W, ZHOU P, ZHAO Z, et al. K-BERT: enabling language representation with knowledge graph[C]//Proceedings of the AAAI Conference on Artificial Intelligence, 2020: 2901-2908.
[23] BIAN X, FENG C, AHMAD A, et al. Targeted sentiment classification with knowledge powered attention network[C]//Proceedings of the 2019 IEEE 31st International Conference on Tools with Artificial Intelligence, 2019: 1073-1080.
[24] ZHOU J, HUANG J X, HU Q V, et al. SK-GCN: modeling syntax and knowledge via graph convolutional network for aspect-level sentiment classification[J]. Knowledge-Based Systems, 2020, 205(3): 214-223.
[25] ZHAO A, YU Y. Knowledge-enabled BERT for aspect-based sentiment analysis[J]. Knowledge-Based Systems, 2021, 227: 107220.
[26] LIANG B, SU H, GUI L, et al. Aspect-based sentiment analysis via affective knowledge enhanced graph convolutional networks[J]. Knowledge-Based Systems, 2022, 235: 107643.
[27] DEVLIN J, CHANG M W, LEE K, et al. BERT: pre-training of deep bidirectional transformers for language understanding[C]//Proceedings of Annual Conference of the North American Chapter of the Association for Computational Linguistics: Human Language Technologies, 2019: 4171-4186.
[28] PONTIKI M, GALANIS D, PAVLOPOULOS J, et al. Semeval-2014 task 4: aspect based sentiment analysis[C]//Proceedings of the 8th International Workshop on Semantic Evaluation, 2014: 27-35.
[29] LI D, WEI F, TAN C, et al. Adaptive recursive neural network for target-dependent twitter sentiment classification[C]//Proceedings of the 52nd Annual Meeting of the Association for Computational Linguistics, 2014: 49-54.
[30] CHEN P, SUN Z, BING L, et al. Recurrent attention network on memory for aspect sentiment analysis[C]//Proceedings of the 2017 Conference on Empirical Methods in Natural Language Processing, 2017: 452-461.
[31] WANG K, SHEN W, YANG Y, et al. Relational graph attention network for aspect-based sentiment analysis[C]//Proceedings of the 58th Annual Meeting of the Association for Computational Linguistic, 2020: 3229-3238.
[32] TIAN Y, CHEN G, SONG Y. Aspect-based sentiment analysis with type-aware graph convolutional networks and layer ensemble[C]//Proceedings of the 2021 Conference of the North American Chapter of the Association for Computational Linguistics: Human Language Technologies, 2021: 2910-2922.
[33] SUN K, ZHANG R, MENSAH S, et al. Aspect-level sentiment analysis via convolution over dependency tree[C]//Proceedings of the 2019 Conference on Empirical Methods in Natural Language Processing and the 9th International Joint Conference on Natural Language Processing, 2019: 5679-5688.