计算机工程与应用 ›› 2008, Vol. 44 ›› Issue (21): 217-221.DOI: 10.3778/j.issn.1002-8331.2008.21.059

• 机器学习 • 上一篇    下一篇

一种用于不平衡数据分类的改进AdaBoost算法

郭乔进,李立斌,李 宁

  

  1. 1.南京大学 计算机软件新技术国家重点实验室,南京 210093
    2.南京大学 计算机科学与技术系,南京 210093
  • 收稿日期:2008-04-30 修回日期:2008-05-29 出版日期:2008-07-21 发布日期:2008-07-21
  • 通讯作者: 郭乔进

Novel modified AdaBoost algorithm for imbalanced data classification

GUO Qiao-jin,LI Li-bin,LI Ning   

  1. 1.National Laboratory for Novel Software Technology,Nanjing University,Nanjing 210093,China
    2.Department of Computer Science and Technology,Nanjing University,Nanjing 210093,China
  • Received:2008-04-30 Revised:2008-05-29 Online:2008-07-21 Published:2008-07-21
  • Contact: GUO Qiao-jin

摘要: 真实世界中存在大量的类别不平衡分类问题,传统的机器学习算法如AdaBoost算法,关注的是分类器的整体性能,而没有给予小类更多的关注。因此针对类别不平衡学习算法的研究是机器学习的一个重要方向。AsymBoost作为AdaBoost的一种改进算法,用于类别不平衡学习时,牺牲大类样本的识别精度来提高小类样本的分类性能。AsymBoost算法依然可能遭遇样本权重过大造成的过适应问题。据此提出了一种新型的AdaBoost改进算法。该方法通过对大类中分类困难样本的权重和标签进行处理,使分类器能够同时获得较好的查准率和查全率。实验结果表明,该方法可以有效提高在不平衡数据集上的分类性能。

关键词: 不平衡数据, 类别不平衡学习, AdaBoost, AsymBoost, 阈值

Abstract: Quantities of imbalanced datasets exist in real world and classical learning algorithms attempt to get high precision on the datasets while learning few concepts from the minority class.Research on class-imbalance learning is an important part of machine learning.As an improvement to AdaBoost,AsymBoost improves performance on classification of examples of minority class but decreases accuracy of examples of majority class.AsymBoost may still have the overfitting problem when weights of examples become too large.In this paper a novel modified AdaBoost algorithm is proposed by new reweighting and label-modifying approach to deal with imbalanced datasets and it has shown promising results when compared to AdaBoost and AsymBoost.

Key words: imbalanced datasets, class-imbalance learning, AdaBoost, AsymBoost, threshold