计算机工程与应用 ›› 2010, Vol. 46 ›› Issue (30): 40-42.DOI: 10.3778/j.issn.1002-8331.2010.30.012

• 研究、探讨 • 上一篇    下一篇

针对不平衡数据集的Bagging改进算法

李明方,张化祥   

  1. 山东师范大学 信息科学与工程学院,济南 250014
  • 收稿日期:2009-04-03 修回日期:2009-06-05 出版日期:2010-10-21 发布日期:2010-10-21
  • 通讯作者: 李明方

Improving Bagging algorithm for imbalance data

LI Ming-fang,ZHANG Hua-xiang   

  1. College of Information Science and Engineering,Shandong Normal University,Jinan 250014,China
  • Received:2009-04-03 Revised:2009-06-05 Online:2010-10-21 Published:2010-10-21
  • Contact: LI Ming-fang

摘要: 传统的Bagging分类方法对不平衡数据集进行分类时,虽然能够达到很高的分类精度,但是对其中少数类的分类准确率不高。为提高其对少数类数据的分类精度,利用SMOTE算法对样例集中的少数类样例进行加工,在Bagging算法中根据类值对各个样例的权重进行调整。混淆矩阵和ROC曲线表明改进算法达到了既能保证整体的分类准确率,又能提高少数类分类精度的目的。

关键词: 不平衡类, 少类样本合成过采样技术(SMOTE), Bagging算法, 权重, 受试者工作特征曲线(ROC)

Abstract: The traditional Bagging method can achieve a high accuracy for imbalance data,but gets low accuracy of the minority class samples.In order to improve the accuracy of the minority class samples with Bagging algorithm,the paper proposes a two-step approach.Firstly,SMOTE algorithm is used to increase the number of the minority class samples and then adjusts the weight for each instance in Bagging according to its class value.Results of the confusing matrix and the ROC show the approach improves not only the classification performance of data as a whole but also that of the minority part.

Key words: imbalance dataset, Synthetic Minority Over-sampling Technique(SMOTE), Bagging, weights, Receiver Operating Characteristic(ROC) curve

中图分类号: