Feature selection for illegitimate contents recognition

doi:10.3778/j.issn.1002-8331.2010.02.039

Computer Engineering and Applications ›› 2010, Vol. 46 ›› Issue (2): 129-131.DOI: 10.3778/j.issn.1002-8331.2010.02.039

• 数据库、信号与信息处理 • Previous Articles Next Articles

Feature selection for illegitimate contents recognition

ZHANG Yong-kui^1，2，GAO Feng¹

1.Faculty of Computer & Information Technology，Shanxi University，Taiyuan 030006，China
2.Key Laboratory of Ministry of Education for Computation Intelligence and Chinese Information Processing，Taiyuan 030006，China

Received:2008-07-29 Revised:2008-10-20 Online:2010-01-11 Published:2010-01-11
Contact: ZHANG Yong-kui

一种不良文本识别特征选择方法

张永奎^1，2，高峰¹

1.山西大学计算机与信息技术学院，太原 030006
2.计算智能与中文信息处理教育部重点实验室，太原 030006

通讯作者: 张永奎

Abstract

Abstract: To describe a two-steps fearture selection method.Firstly，recognise all the special words from the training texts by finite accepter and add it to the final feature set，recover the original text as well.Then select features from the processed texts and add them to the feature set by the way of‘conbination feature selection method’.The experiment result shows that it can improve the precision of the illegitimate contents recognition

Key words: special words, finite accepter, feature selection, illegitimate contents recognition

摘要： 针对不良文本的特殊性，提出一种两步特征选择方法。首先对训练文本用有限自动机识别其中的特殊词作为特征加入特征集，同时将原文还原为不含特殊词的文本。对还原后文本用“组合特征选择方法”选择特征加入特征集。实验结果表明利用两步特征选择方法能有效提高非法文本识别精度。

关键词: 特殊词, 有限自动机, 特征选择, 不良文本识别

CLC Number:

TP391

ZHANG Yong-kui^1，2，GAO Feng¹. Feature selection for illegitimate contents recognition[J]. Computer Engineering and Applications, 2010, 46(2): 129-131.

张永奎^1，2，高峰¹. 一种不良文本识别特征选择方法[J]. 计算机工程与应用, 2010, 46(2): 129-131.

[1]	LI Li, JI Xinyuan, SONG Song. Prediction Model for Number of Software Defects in Loop [J]. Computer Engineering and Applications, 2021, 57(7): 158-163.
[2]	LI Jingxing, YANG Youlong. Feature Selection of Markov Blanket for High Dimensional Data [J]. Computer Engineering and Applications, 2021, 57(6): 58-66.
[3]	LIN Weixing, WANG Yujia, CHEN Wanfen, LIANG Haina. High-Dimensional Data Feature Selection Algorithm Based on Multifactor Particle Swarm Optimization [J]. Computer Engineering and Applications, 2021, 57(22): 199-207.
[4]	LI Longzhu, LIN Yaojin, LYU Yan, LU Shun, WANG Chenxi. Online Streaming Feature Selection Algorithm Using Neighborhood Information Interaction [J]. Computer Engineering and Applications, 2021, 57(21): 102-108.
[5]	CHEN Qianru, LI Yali, XU Kequan, LIU Yilong, WANG Shuqin. WKNN Feature Selection Method Based on Self-Tuning Adaptive Genetic Algorithm [J]. Computer Engineering and Applications, 2021, 57(20): 164-171.
[6]	WU Weijie, ZHANG Jingxiang. Random Forest Feature Selection Algorithm Based on Categorization Information and Application [J]. Computer Engineering and Applications, 2021, 57(17): 147-156.
[7]	QIU Yunfei, GAO Huacong. Hybrid Filter and Improved Adaptive GA for Feature Selection [J]. Computer Engineering and Applications, 2021, 57(11): 95-102.
[8]	HUO Lin, LU Yinli. Improved Particle Swarm Optimization for Android Malware Detection [J]. Computer Engineering and Applications, 2020, 56(7): 96-101.
[9]	LIAO Wenxiong, ZENG Bi, LIANG Tiankai, XU Yayun, ZHAO Junfeng. Personal Credit Risk Assessment Method for High-Dimensional Data [J]. Computer Engineering and Applications, 2020, 56(4): 219-224.
[10]	PENG Ming, ZHANG Haipeng. Unsupervised Feature Selection via Schatten-p Norm and Feature Self-Representation [J]. Computer Engineering and Applications, 2020, 56(23): 45-52.
[11]	LIU Feng, Godfred Kim Mensah, LI Xinyun, LIU Hongli, LI Yao, GUO Hao. Abnormal Topological Analysis and Classification Research of Uncertain Brain Networks [J]. Computer Engineering and Applications, 2020, 56(2): 127-132.
[12]	YUE Peng, HOU Lingyan, YANG Dali, TONG Qiang. XLC-Stacking Method for Disease Diagnosis Based on XGBoost Feature Selection [J]. Computer Engineering and Applications, 2020, 56(17): 136-141.
[13]	HUANG Xin, MO Haimiao, ZHAO Zhigang, ZENG Min. Research on Discrete Enhanced Fireworks Algorithm and [kNN] in Feature Selection [J]. Computer Engineering and Applications, 2020, 56(16): 112-117.
[14]	ZHOU Wanying, MA Yingcang, XU Qiuxia, ZHENG Yi. Unsupervised Feature Selection Algorithm Based on Maximum Entropy and [l2,0] Norm Constraints [J]. Computer Engineering and Applications, 2020, 56(11): 51-59.
[15]	CHEN Jia, LIU Dongxue, WU Dashuo. Stock Index Forecasting Method Based on Feature Selection and LSTM Model [J]. Computer Engineering and Applications, 2019, 55(6): 108-112.

Feature selection for illegitimate contents recognition

一种不良文本识别特征选择方法

PDF

Knowledge

Abstract

Cite this article

share this article

References

Related Articles 15

Recommended Articles

Metrics