Computer Engineering and Applications ›› 2013, Vol. 49 ›› Issue (21): 172-176.

Previous Articles     Next Articles

Imbalanced data resampling based on oversampling and under-sampling

WU Lei1, FANG Bin1, DIAO Liping2, CHEN Jing1, XIE Nana1   

  1. 1.College of Computer Science of Chongqing University, Chongqing 400030, China
    2.Health Management Office of Xinqiao Hospital of Third Military Medical University, Chongqing 400037, China
  • Online:2013-11-01 Published:2013-10-30

融合过抽样和欠抽样的不平衡数据重抽样方法

吴  磊1,房  斌1,刁丽萍2,陈  静1,谢娜娜1   

  1. 1.重庆大学 计算机学院,重庆 400030
    2.第三军医大学新桥医院 健康管理科,重庆 400037

Abstract: There are?several?aspects that might influence the performance achieved by?existing learning systems in the area of machine learning. It has been reported that one of these aspects is related to class?imbalance in which examples in training data belonging to one class heavily outnumber the examples in the other class. Though there are several kinds of methods to get rid of this problem, this paper only discusses using resampling method to balance data in the period of preprocessing to improve the effect of classification. There are two kinds of resampling methods:over resampling and under resampling. In this paper, four methods which combine oversampling and under-sampling method are proposed for binary classification:BSM+Tomek, BSM+ENN, CBOS+Tomek and CBOS+ENN, and present very good results for data sets with a small number of positive examples. Moreover, ten other resampling methods are also taken to make comparative experiments with the four methods proposed by this paper, and the four methods also present very good results.

Key words: imbalanced datasets, resampling, Cluster-Based Oversampling(CBOS), Borderline Synthetic Minority Over-sampling Technique(BSM), Edited Nearest Neighbor(ENN), Tomek links, preprocess

摘要: 在机器学习领域的研究当中,分类器的性能会受到许多方面的影响,其中训练数据的不平衡对分类器的影响尤为严重。训练数据的不平衡也就是指在提供的训练数据集中,一类的样本总数远多于另一类的样本总数。常用的不平衡数据的处理方法有很多,只探讨利用重抽样方法对不平衡数据进行预处理来提高分类效果的方法。数据抽样算法有很多,但可以归为两大类:过抽样和欠抽样。针对二分类问题提出了四种融合过抽样和欠抽样算法的重抽样方法:BSM+Tomek、BSM+ENN、CBOS+Tomek和CBOS+ENN,并且与另外十种经典的重抽样算法做了大量的对比实验,实验证明提出的四种预处理算法在多种评价指标下提高了不平衡数据的分类效果。

关键词: 不平衡数据, 重抽样, 基于聚类的过抽样算法(CBOS), 基于边界值的虚拟少数类向上采样算法(BSM), 可选择最近邻算法(ENN), Tomek links, 预处理