Computer Engineering and Applications ›› 2010, Vol. 46 ›› Issue (16): 160-162.DOI: 10.3778/j.issn.1002-8331.2010.16.047

• 数据库、信号与信息处理 • Previous Articles     Next Articles

Feature selection using feature distinguishability and discernibility object pair set

WU Hong-li1,2,ZHU Hao-dong2,ZHOU Rui-qiong1   

  1. 1.College of Information Science and Technology,Hainan Normal University,Haikou 571158,China
    2.Chengdu Institute of Computer Application,Chinese Academy of Sciences,Chengdu 610041,China
  • Received:2009-10-12 Revised:2009-12-02 Online:2010-06-01 Published:2010-06-01
  • Contact: WU Hong-li

使用特征分辨率和差别对象对集的特征选择

吴洪丽1,2,朱颢东2,周瑞琼1   

  1. 1.海南师范大学 信息科学技术学院,海口 571158
    2.中国科学院 成都计算机应用研究所,成都 610041
  • 通讯作者: 吴洪丽

Abstract: Feature selection is one of the key steps in text categorization.The selected feature subset directly influences results of text categorization.Firstly,several classic feature selection methods are analyzed simply and their deficiencies are summarized.And then,the concept of feature distinguishability is presented.Next,an attribute reduction algorithm based on discernibility object pair set is provided.Finally,combining the attribute reduction algorithm with feature distinguishability,a new feature selection method is proposed.The new method firstly uses feature distinguishability to select feature and filter out some terms to reduce the sparsity of feature spaces,and then employs the attribute reduction algorithm to eliminate redundancy,so that the feature subsets which are more representative are acquired.The experimental results show that the new method is promising.

Key words: feature selection, text categorization, feature distinguishability, discernibility object pair set, attribute reduction

摘要: 特征选择是文本分类的关键步骤之一,所选特征子集的优劣直接影响文本分类的结果。首先简单分析了几种经典的特征选择方法,总结了它们的不足,然后提出了特征分辨率的概念,并提出了一个基于差别对象对集的属性约简算法,最后把该属性约简算法同特征分辨率结合起来,提出了一个新的特征选择方法。该方法首先利用特征分辨率进行特征初选以过滤掉一些词条来降低特征空间的稀疏性,然后利用所提属性约简算法消除冗余,从而获得较具代表性的特征子集。实验结果表明此种特征选择方法效果良好。

关键词: 特征选择, 文本分类, 特征分辨率, 差别对象对集, 属性约简

CLC Number: