New feature selection combined MI with RS

Computer Engineering and Applications ›› 2011, Vol. 47 ›› Issue (16): 135-137.

• 数据库、信号与信息处理 • Previous Articles Next Articles

New feature selection combined MI with RS

SHI Yuepeng1，ZHANG Minghui2，ZHU Haodong3

1.Department of Information Engineering，Zhengzhou College of Animal Husbandry Engineering，Zhengzhou 450011，China
2.Department of Information Technology，Zhengzhou Normal University，Zhengzhou 450044，China
3.School of Computer and Communication Engineering，Zhengzhou University of Light Industry，Zhengzhou 450002，China

Received:1900-01-01 Revised:1900-01-01 Online:2011-06-01 Published:2011-06-01

新的结合互信息和粗糙集的特征选择

史岳鹏1，张明慧2，朱颢东3

1.郑州牧业工程高等专科学校信息工程系，郑州 450011
2.郑州师范学院信息技术系，郑州 450044
3.郑州轻工业学院计算机与通信工程学院，郑州 450002

Abstract

Abstract: Feature selection is an important step in text categorization.MI is analyzed，according to deficiency of MI，RS is introduced and an attribute reduction algorithm based on attribute union is proposed.A new feature selection method combined MI with the proposed attribute reduction algorithm is presented which is suitable for massive text data sets.The method uses MI to select features，and employs the proposed attribute reduction algorithm to eliminate redundancy.The experimental results show that micro average F1 and macro average F1 of the new method are higher.

Key words: feature selection, text categorization, Mutual Information（MI）, Rough Set（RS）, attribute reduction

摘要： 特征选择是文本分类的一个重要步骤。分析了互信息，针对其不足引进了粗糙集给出了一个基于关系积的属性约简算法，并以此为基础提出了一个新的适用于海量文本数据集的特征选择方法。该方法使互信息进行特征初选，利用基于关系积的属性约简算法消除冗余词。实验结果表明此种特征选择方法的微平均F1和宏平均F1较高。

关键词: 特征选择, 文本分类, 互信息, 粗糙集, 属性约简

SHI Yuepeng1，ZHANG Minghui2，ZHU Haodong3. New feature selection combined MI with RS[J]. Computer Engineering and Applications, 2011, 47(16): 135-137.

史岳鹏1，张明慧2，朱颢东3. 新的结合互信息和粗糙集的特征选择[J]. 计算机工程与应用, 2011, 47(16): 135-137.

[1]	LI Li, JI Xinyuan, SONG Song. Prediction Model for Number of Software Defects in Loop [J]. Computer Engineering and Applications, 2021, 57(7): 158-163.
[2]	LI Jingxing, YANG Youlong. Feature Selection of Markov Blanket for High Dimensional Data [J]. Computer Engineering and Applications, 2021, 57(6): 58-66.
[3]	LIN Weixing, WANG Yujia, CHEN Wanfen, LIANG Haina. High-Dimensional Data Feature Selection Algorithm Based on Multifactor Particle Swarm Optimization [J]. Computer Engineering and Applications, 2021, 57(22): 199-207.
[4]	LI Longzhu, LIN Yaojin, LYU Yan, LU Shun, WANG Chenxi. Online Streaming Feature Selection Algorithm Using Neighborhood Information Interaction [J]. Computer Engineering and Applications, 2021, 57(21): 102-108.
[5]	CHEN Qianru, LI Yali, XU Kequan, LIU Yilong, WANG Shuqin. WKNN Feature Selection Method Based on Self-Tuning Adaptive Genetic Algorithm [J]. Computer Engineering and Applications, 2021, 57(20): 164-171.
[6]	WU Weijie, ZHANG Jingxiang. Random Forest Feature Selection Algorithm Based on Categorization Information and Application [J]. Computer Engineering and Applications, 2021, 57(17): 147-156.
[7]	QIU Yunfei, GAO Huacong. Hybrid Filter and Improved Adaptive GA for Feature Selection [J]. Computer Engineering and Applications, 2021, 57(11): 95-102.
[8]	SHEN Yanguang, JIA Yaoqing. Text Categorization Method Based on Word Co-occurrence and Graph Convolution [J]. Computer Engineering and Applications, 2021, 57(11): 173-178.
[9]	HUO Lin, LU Yinli. Improved Particle Swarm Optimization for Android Malware Detection [J]. Computer Engineering and Applications, 2020, 56(7): 96-101.
[10]	LIAO Wenxiong, ZENG Bi, LIANG Tiankai, XU Yayun, ZHAO Junfeng. Personal Credit Risk Assessment Method for High-Dimensional Data [J]. Computer Engineering and Applications, 2020, 56(4): 219-224.
[11]	PENG Ming, ZHANG Haipeng. Unsupervised Feature Selection via Schatten-p Norm and Feature Self-Representation [J]. Computer Engineering and Applications, 2020, 56(23): 45-52.
[12]	XIE Xinrui, LEI Xiuren, ZHAO Yan. Application of Mutual Information and Improved PCA Dimensionality Reduction Algorithm in Stock Price Forecasting [J]. Computer Engineering and Applications, 2020, 56(21): 139-144.
[13]	LIU Feng, Godfred Kim Mensah, LI Xinyun, LIU Hongli, LI Yao, GUO Hao. Abnormal Topological Analysis and Classification Research of Uncertain Brain Networks [J]. Computer Engineering and Applications, 2020, 56(2): 127-132.
[14]	YUE Peng, HOU Lingyan, YANG Dali, TONG Qiang. XLC-Stacking Method for Disease Diagnosis Based on XGBoost Feature Selection [J]. Computer Engineering and Applications, 2020, 56(17): 136-141.
[15]	HUANG Xin, MO Haimiao, ZHAO Zhigang, ZENG Min. Research on Discrete Enhanced Fireworks Algorithm and [kNN] in Feature Selection [J]. Computer Engineering and Applications, 2020, 56(16): 112-117.

New feature selection combined MI with RS

新的结合互信息和粗糙集的特征选择

PDF

Knowledge

Abstract

Cite this article

share this article

References

Related Articles 15

Recommended Articles

Metrics