计算机工程与应用 ›› 2017, Vol. 53 ›› Issue (10): 132-138.DOI: 10.3778/j.issn.1002-8331.1512-0056

• 模式识别与人工智能 • 上一篇    下一篇

基于稀疏学习的低秩属性选择算法

胡荣耀1,2,刘星毅2,3,程德波1,2,何  威1,2   

  1. 1.广西师范大学 广西多源信息挖掘与安全重点实验室,广西 桂林 541004
    2.广西区域多源信息集成与智能处理协同创新中心,广西 桂林 541004
    3.广西钦州学院,广西 钦州 535000
  • 出版日期:2017-05-15 发布日期:2017-05-31

Low-rank feature selection algorithm based on sparse learning

HU Rongyao1,2, LIU Xingyi2,3, CHENG Debo1,2, HE Wei1,2   

  1. 1.Guangxi Key Lab of Multi-source Information Mining & Security, Guangxi Normal University, Guilin, Guangxi 541004, China
    2.Guangxi Collaborative Innovation Center of Multi-source Information Integration and Intelligent Processing, Guilin, Guangxi 541004, China
    3.Qinzhou University, Qinzhou, Guangxi 535000, China
  • Online:2017-05-15 Published:2017-05-31

摘要: 针对回归模型在进行属性选择未考虑类标签之间关系从而导致回归效果不理想,提出了一种新的具有鲁棒性的低秩属性选择算法。具体为,在线性回归的模型框架下,通过低秩约束来考虑类标签间的相关性和通过稀疏学习理论中的[l2,p-]范数来考虑属性间的关联结构,以此去除不相关的冗余属性的影响;算法通过嵌入子空间学习方法(线性判别分析(LDA))来调整属性选择结果。经实验验证,提出的属性选择算法在六个公开数据集上的效果均优于四种对比算法。

关键词: 线性回归, 线性判别分析, 属性选择, 子空间学习, 稀疏学习

Abstract: The traditional regression model does not ensure to output good performance since it conducts feature selection without considering the correlation between labels. To address this issue, this paper proposes a novel robust low-rank feature selection method. Specifically, this paper considers the correlation between labels into a low-rank regression model and then employs an [l2,p-]norm regularization term to conduct feature selection. Meanwhile, this paper also considers subspace learning method(i.e., Linear Discriminant Analysis(LDA)) into the proposed feature selection model to adjust the result of feature selection. The iteration between feature selection and LDA enables to output optimal features until the algorithm converges. The experimental results on six public datasets show that the proposed feature selection method outperformed four comparison methods.

Key words: linear regression, linear discriminant analysis, feature selection, subspace learning, sparse learning