Sequential Three-Way Sentiment Classification Combined with Ensemble Learning

doi:10.3778/j.issn.1002-8331.2006-0324

Abstract

Abstract:

Sentiment classification has always been an important research hotspot in natural language processing tasks, and is widely used in many scenarios such as e-commerce reviews, hotspot forums and public opinion. How to improve the performance of sentiment classification model is still a key research problem in the field of sentiment analysis. Ensemble learning is an effective method to improve the overall performance of the model by combining several classifiers. Based on the ideas of granular computing and three-way decisions, as well as the advantages of ensemble learning, this paper constructs a multi-granularity sequential three-way decision model combined with ensemble learning. Firstly, it builds a text multi-granularity structure through the N-gram language model to form the basis of sequential three-way sentiment classification. Secondly, three classification algorithms are designed to improve the classification performance at each granularity. Finally, it verifies the model through four datasets. The results demonstrate the proposed method can not only improve the overall classification performance, but also reduce the classification cost.

Key words: sentiment classification, sequential three-way decisions, multi-granularity, ensemble learning

摘要：

情感分类一直是自然语言处理任务中重要的研究热点，并在电子商务评论、热点论坛、公共舆论等众多场景中广泛应用。如何提高情感分类模型性能仍是情感分析领域的重点研究问题。集成学习是通过联合若干分类器达到提高模型总体效果的有效方法。基于粒计算和三支决策思想，并结合集成学习的优势，构建了结合集成学习的多粒度序贯三支决策模型。通过N-gram语言模型构建文本多粒度结构，形成序贯三支情感分类基础；在每一粒度下，集成三个分类算法以提高在该粒度下的分类效果；通过4个数据集对所提出方法进行了实验验证。结果证明，该方法不仅可以提高整体分类效果，还可以降低分类成本。

关键词: 情感分类, 序贯三支决策, 多粒度, 集成学习

WANG Qin, LIU Dun. Sequential Three-Way Sentiment Classification Combined with Ensemble Learning[J]. Computer Engineering and Applications, 2021, 57(23): 211-218.

王琴，刘盾. 结合集成学习的序贯三支情感分类方法研究[J]. 计算机工程与应用, 2021, 57(23): 211-218.

References

[1] PANG B，LEE L，VAITHYANATHAN S.Thumbs up? Sentiment classification using machine learning techniques[C]//Proceedings of 2002 Empirical Methods in Natural Language Processing，2002：79-86.
[2] PANG B，LEE L.Opinion mining and sentiment analysis[J].Foundations & Trends in Information Retrieval，2008，2（1/2）：1-135.
[3] HU Minqing，LIU Bing.Mining and summarizing customer reviews[C]//Proceedings of 10th ACM SIGKDD International Conference on Knowledge Discovery & Data Mining，2004：168-177.
[4] VIVEK K，MOUSUMI M，GHANSHYAM K.Combining collaborative filtering and sentiment classification for improved movie recommendations[C]//Proceedings of the 5th International Conference on Multi-Disciplinary Trends in Artificial Intelligence，2011：38-50.
[5] FANG Xing，ZHAN Justin.Sentiment analysis using pro-duct review data[J].Journal of Big Data，2015，2（5）：1-14.
[6] KIM Y.Convolutional neural networks for sentence classification[C]//Proceedings of Conference on Empirical Methods in Natural Language Processing，2014：1746-1751.
[7] 刘盾，姚一豫，李天瑞.三枝决策粗糙集[J].计算机科学，2011，38（1）：246-250.
LIU Dun，YAO Yiyu，LI Tianrui.Three-way decisions-theoretic rough sets[J].Computer Science，2011，38（1）：246-250.
[8] 周喆，商琳.一种基于动态词典和三支决策的情感分析方法[J].山东大学学报（工学版），2015，45（1）：19-23.
ZHOU Zhe，SHANG Lin.A sentiment analysis method based on dynamic lexicon and three-way decision[J].Journal of Shandong University（Engineering Science），2015，45（1）：19-23.
[9] 王磊，黄河笑，吴兵，等.基于主题与三支决策的文本情感分析[J].计算机科学，2015，42（6）：93-96.
WANG Lei，HUANG Hexiao，WU Bing，et al.Emotion analysis of text based on topics and three-way decisions[J].Computer Science，2015，42（6）：93-96.
[10] ZHANG Zhifei，WANG Ruizhi.Applying three-way decisions to sentiment classification with sentiment uncertainty[C]//Proceedings of International Conference on Rough Sets and Knowledge Technology，2014：720-731.
[11] YAO Yiyu，DENG Xiaofei.Sequential three-way decisions with probabilistic rough sets[C]//Proceedings of the 10th IEEE International Conference on Cognitive Informatics and Cognitive Computing，2011：120-125.
[12] 张刚强，刘群，纪良浩.基于序贯三支决策的多粒度情感分类方法[J].计算机科学，2018，45（12）：153-159.
ZHANG Gangqiang，LIU Qun，JI Lianghao.Multi-granularity sentiment classification method based on sequential three-way decisions[J].Computer Science，2018，45（12）：153-159.
[13] XIA Rui，ZONG Chengqing，LI Shoushan.Ensemble of feature sets and classification algorithms for sentiment classification[J].Information Sciences，2011，181：1138-1152.
[14] WINDEAT T，ARDESHIR，G.Decision tree simplification for classifier ensembles[J].International Journal of Pattern Recognition and Artificial Intelligence，2004，18（5）：749-776.
[15] YU Shixin.Feature selection and classifier ensembles：a study on hyper spectral remote sensing data[D].Antwerp，Belgium：University of Antwerp，2003.
[16] YAO Yiyu.Three-way decision：an interpretation of rules in rough set theory[C]//Proceedings of 4th International Conference on Rough Sets and Knowledge Technology，2009：642-649.
[17] YAO Yiyu.Granular computing and sequential three-way decisions[C]//Proceedings of 8th International Conference on Rough Sets and Knowledge Technology，2013：16-27.
[18] YAO Yiyu.Granular computing：past，present and future[C]//Proceedings of IEEE International Conference on Granular Computing，2008：80-85.
[19] YANG Xin，LI Tianrui，FUJITA H，et al.A unified model of sequential three-way decisions and multilevel incremental processing[J].Knowledge-Based Systems，2017，134：172-188.
[20] QIAN Jin，DANG Chuangyin，YUE Xiaodong，et al.Attribute reduction for sequential three-way decisions under dynamic granulation[J].International Journal of Approximate Reasoning，2017，85：196-216.
[21] LI Huaxiong，ZHANG Libo，HUANG Bing，et al.Sequential three-way decision and granulation for cost-sensitive face recognition[J].Knowledge-Based Systems，2016，91：241-251.