Computer Engineering and Applications ›› 2015, Vol. 51 ›› Issue (9): 129-134.
Previous Articles Next Articles
SHI Wenjuan, LONG Shun, YUN Fei
Online:
Published:
石文娟,龙 舜,云 飞
Abstract: The exponential growth of text-based information on Internet has boosted a growing demand for automatic text classification techniques. Various algorithms have been proposed after decades of research. However, distinction of ambiguous phrases at text preprocessing phase is considered of vital importance for accuracy in automatic text classification, which remains to be solved comprehensively and convincingly. This paper presents a background-based iterative framework integrated with the mutual information theory. When applied to text preprocessing, it improves the traditional Naive Bayesian model based text classification algorithms. Experimental results based on data from various Sina categories show that this proposed framework is both feasible and effective.
Key words: background knowledge, iteration, mutual information, Naive Bayesian, text categorization, disambiguation
摘要: 随着网络文本数据呈指数级增长,信息的人工分类和管理逐渐被计算机自动分类所替代,相关领域经过多年的研究和发展已经开发出一些相对成熟的算法。研究分析发现:在文本预处理阶段歧义语段的划分始终是影响分类准确率的一个重要因素,至今仍未完全解决。结合互信息度理论,提出一种基于背景学习的迭代式框架,在此基础上通过对分词数据预处理来改进传统的基于朴素贝叶斯模型的文本分类算法,并使用新浪网不同类别数据对提出的迭代式框架进行实验评估,实验结果表明提出的基于背景学习的迭代式文本分类框架可行有效。
关键词: 背景知识, 迭代, 互信息度, 朴素贝叶斯, 文本分类, 歧义消除
SHI Wenjuan, LONG Shun, YUN Fei. Iterative?text?classification?framework based?on?background learning[J]. Computer Engineering and Applications, 2015, 51(9): 129-134.
石文娟,龙 舜,云 飞. 基于背景学习的迭代式文本分类框架[J]. 计算机工程与应用, 2015, 51(9): 129-134.
0 / Recommend
Add to citation manager EndNote|Ris|BibTeX
URL: http://cea.ceaj.org/EN/
http://cea.ceaj.org/EN/Y2015/V51/I9/129