计算机工程与应用 ›› 2011, Vol. 47 ›› Issue (24): 129-131.

• 数据库、信号与信息处理 • 上一篇    下一篇

一种基于粗糙集文本自动分类的改进算法

张保富,施化吉   

  1. 江苏大学 计算机科学与通信工程学院,江苏 镇江 212013
  • 收稿日期:1900-01-01 修回日期:1900-01-01 出版日期:2011-08-21 发布日期:2011-08-21

Improved algorithm of automatic classification based on rough set

ZHANG Baofu,SHI Huaji   

  1. Department of Computer Science and Telecommunication Engineering,Jiangsu University,Zhenjiang,Jiangsu 212013,China
  • Received:1900-01-01 Revised:1900-01-01 Online:2011-08-21 Published:2011-08-21

摘要: 自动文本分类的效果在很大程度上依赖于属性特征的选择。针对传统基于频率阈值过滤的特征选择方法会导致有效信息丢失,影响分类精度的不足,提出了一种基于粗糙集的文本自动分类算法。该方法对加权后的特征属性进行离散化,建立一个决策表;根据基于依赖度的属性重要度对决策表中条件属性进行适当的筛选;采用基于条件信息熵的启发式算法实现文本属性特征的约简。实验结果表明,该方法能约简大量冗余的特征属性,在不降低分类精度的同时,提高文本分类的运行效率。

关键词: 粗糙集, 属性约简, 文本分类

Abstract: The affect of automatic text categorization mostly relies on the selection of attribute feature.Aiming at the problem that the traditional feature selection method which filters features using frequency threshold would result in information loss and reduce the classification precision,a novel automatic text categorization method based on rough set is proposed.In the proposed method,the weighted attribute features discretization is carried out to form a decision table;selection of conditional attributes at the decision table is carried out on the basis of attribute significance which is based on dependency degree;the reduction of text attribute features is performed by heuristic algorithm which is based on conditional information entropy.Experimental results show that the proposed method removes large number of redundant attribute features,and improves the performance of text categorization without reducing classification precision.

Key words: rough set, attribute reduction, text classification