基于黑寡妇算法的特征选择方法研究

doi:10.3778/j.issn.1002-8331.2101-0158

摘要/Abstract

摘要： 特征选择通过去除无关和冗余特征提高学习算法性能，本质是组合优化问题。黑寡妇算法是模拟黑寡妇蜘蛛生命周期的元启发式算法，在收敛速度、适应度值优化等方面具有诸多优势。针对黑寡妇算法不能进行特征选择的问题，设计五种优化策略：二进制策略、“或门”策略、种群限制策略、快速生殖策略以及适应度优先策略，提出黑寡妇特征选择算法（black widow optimization feature selection algorithm，BWOFS）和生殖调控黑寡妇特征选择算法（procreation controlled black widow optimization feature selection algorithm，PCBWOFS），从特征空间中搜索有效特征子集。在多个分类、回归公共数据集上验证新方法，实验结果表明，相较其他对比方法（全集、AMB、SFS、SFFS、FSFOA），BWOFS和PCBWOFS能找到预测精度更高的特征子集，可提供有竞争力、有前景的结果，而且与BWOFS相比，PCBWOFS计算量更小，性能更好。

关键词: 特征选择, 黑寡妇算法（BWO）, 黑寡妇特征选择算法（BWOFS）, 生殖调控黑寡妇特征选择算法（PCBWOFS）

Abstract: Feature selection is essentially a combinatorial optimization problem to improve the performance of learning algorithms by removing irrelevant and redundant features. Black widow optimization algorithm（BWO） is a new meta-heuristic algorithm of simulating the life cycle of black widow spiders. This algorithm has many advantages in terms of convergence speed and fitness value optimization. To counter the problem that black widow optimization algorithm cannot select feature, five kinds of optimization strategies are designed, including binary strategy, “or” strategy, population limit strategy, rapid reproduction strategy and fitness priority strategy, black widow optimization feature selection algorithm（BWOFS） and procreation controlled black widow optimization feature selection algorithm（PCBWOFS） are proposed to search effective feature subsets from feature space. New methods is validated in multiple classified and regression common datasets. The experimental results show that compared with other comparison methods（full set, AMB, SFS, SFFS and FSFOA）, BWOFS and PCBWOFS can find feature subsets with higher prediction accuracy, and can provide competitive and promising results. Moreover, compared with BWOFS, PCBWOFS has smaller computation and better performance.

Key words: feature selection, black widow optimization algorithm（BWO）, black widow optimization feature selection algorithm（BWOFS）, procreation controlled black widow optimization feature selection algorithm（PCBWOFS）

李郅琴, 杜建强, 聂斌, 熊旺平, 徐国良, 罗计根, 李冰涛. 基于黑寡妇算法的特征选择方法研究[J]. 计算机工程与应用, 2022, 58(16): 147-156.

LI Zhiqin, DU Jianqiang, NIE Bin, XIONG Wangping, XU Guoliang, LUO Jigen, LI Bingtao. Research on Feature Selection Method Based on Black Widow Optimization Algorithm[J]. Computer Engineering and Applications, 2022, 58(16): 147-156.

参考文献

[1] 李郅琴，杜建强，聂斌，等.特征选择方法综述[J].计算机工程与应用，2019，55（24）：10-19.
LI Z Q，DU J Q，NIE B，et al.A review of feature selection methods[J].Computer Engineering and Applications，2019，55（24）：10-19.
[2] HAYYOLALAM V，KAZEM A A P.Black widow optimization algorithm：a novel meta-heuristic approach for solving engineering optimization problems[J].Engineering Applications of Artificial Intelligence，2020，87：103249.
[3] HOUSSEIN E H，HELMY E D，OLIVA D，et al.A novel black widow optimization algorithm for multilevel thresholding image segmentation[J].Expert Systems with Applications，2021，167：114159.
[4] KATOOLI M S，KOOCHAKI A.Detection and classification of incipient faults in three-phase power transformer using DGA information and rule-based machine learning method[J].Journal of Control，Automation and Electrical Systems，2020，31（5）：1251-1266.
[5] TIGHTIZ L，NASAB M A，YANG H，et al.An intelligent system based on optimized ANFIS and association rules for power transformer fault diagnosis[J].ISA Transactions，2020，103：63-74.
[6] MICEV M，CALASAN M，PETROVIC D，et al.Field current waveform-based method for estimation of synchronous generator parameters using adaptive black widow optimization algorithm[J].IEEE Access，2020，8：207537-207550.
[7] PREMKUMAR K，VISHNUPRIYA M，SUDHAKAR BABU T，et al.Black widow optimization-based optimal PI-controlled wind turbine emulator[J].Sustainability，2020，12（24）：10357.
[8] HALL M A.Correlation-based feature selection for machine learning[D].Hamilton：University of Waikato，1999.
[9] HALL M A.Correlation-based feature selection for discrete and numeric class machine learning[C]//Proceedings of the 17th International Conference on Machine Learning，2000：359-366.
[10] RESHEF D N，RESHEF Y A，Finucane H K，et al.Detecting novel associations in large data sets[J].Science，2011，334（6062）：1518-1524.
[11] PENG H，LONG F，DING C.Feature selection based on mutual information：criteria of max-dependency，max-relevance，and min-redundancy[J].IEEE Transactions on Pattern Analysis and Machine Intelligence，2005，27（8）：1226-1238.
[12] PUDIL P，NOVOVICOV J，KITTLER J.Floating search methods in feature selection[J].Pattern Recognition Letters，1994，15（11）：1119-1125.
[13] KIRA K，RENDELL L A.The feature selection problem：traditional methods and a new algorithm[C]//Proceedings of the 10th National Conference on Artificial Intelligence，San Jose，Jul 12-16，1992：129-134.
[14] JOHN G H，KOHAVI R，PFLEGER K.Irrelevant features and the subset selection problem[C]//Proceedings of the 11th International Conference on Machine Learning，New Brunswick，Jul 10-13，1994：121-129.
[15] KOLLER D，SAHAMI M.Toward optimal feature selection[C]//Proceedings of the 13th International Conference on Machine Learning，1996：284-292.
[16] DASH M，LIU H.Feature selection for classification[J].Intelligent Data Analysis，1997，1（3）：131-156.
[17] DAVIES S，RUSSELL S.NP-completeness of searches for smallest possible feature sets[C]//Proceedings of the 1994 AAAI Fall Symposium on Relevance，1994：37-39.
[18] TAN K C，TEOH E J，YU Q，et al.A hybrid evolutionary algorithm for attribute selection in data mining[J].Expert Systems with Applications，2009，36（4）：8616-8630.
[19] EMARY E，ZAWBAA H M，HASSANIEN A E.Binary ant lion approaches for feature selection[J].Neurocomputing，2016，213：54-65.
[20] ZAWBAA H M，EMARY E.Applications of flower pollination algorithm in feature selection and knapsack problems[J].Nature-Inspired Algorithms and Applied Optimization，2018，744：217-243.
[21] MAFARJA M，MIRJALILI S.Whale optimization approaches for wrapper feature selection[J].Applied Soft Computing，2018，62：441-453.
[22] GHAEMI M，FEIZI-DERAKHSHI M R.Feature selection using forest optimization algorithm[J].Pattern Recognition，2016，60：121-129.
[23] GHAEMI M，FEIZI-DERAKHSHI M-R.Forest optimization algorithm[J].Expert Systems with Applications，2014，41（15）：6676-6687.
[24] 刘兆赓，李占山，王丽，等.森林优化特征选择算法的增强与扩展[J].软件学报，2020，31（5）：1511-1524.
LIU Z G，LI Z S，WANG L，et al.Enhancement and extension of feature selection algorithm for forest optimization algorithm[J].Journal of Software，2020，31（5）：1511-1524.
[25] SCOTT C，KIRK D，MCCANN S，et al.Web reduction by courting male black widows renders pheromone-emitting females’ webs less attractive to rival males[J].Animal Behaviour，2015，107：71-78.