AdaBoost algorithm based on bregman distance and equality constraint regularization

Abstract

Abstract: Based on regularizing online learning pattern proposed by J.Kivinen and M.K.Warmuth, update model of weight of weak classifier via bregman distance and equality constraint is devised. Five update algorithms of weight of weak classifier, AdaBoostS, AdaBoostIE, AdaBoostRE, AdaBoostDE and AdaBoostE are achieved. In the experiments on real datasets, the algorithms performance of five update algorithms with state of art algorithms in assembly classifier research is compared.

Key words: bregman distance function, equality constraint problem, regularization, assembly classifier

摘要： 基于J.Kivinen和M.K.Warmuth提出的一种基于正则化的在线学习模式，提出基于bregman距离和等式约束正则化弱分类器权值更新模式，实现了AdaBoostS，AdaBoostIE，AdaBoostRE，AdaBoostDE和AdaBoostE五种弱分类器权更新算法。在实验部分，利用实际数据对提出的五种算法与Real AdaBoost、Gentle AdaBoost和Modest AdaBoost算法作了比较。

关键词: bregman距离函数, 等式约束问题, 正则化, 集成分类器

FU Jie, LIU Jianwei, LI Shuangcheng, LUO Xionglin. AdaBoost algorithm based on bregman distance and equality constraint regularization[J]. Computer Engineering and Applications, 2013, 49(3): 166-170.

付捷，刘建伟，李双成，罗雄麟. 基于bregman距离和等式约束正则化AdaBoost算法[J]. 计算机工程与应用, 2013, 49(3): 166-170.

[1]	ZHAO Tong, HUANG Zheng, WANG Xiuchao, LI Miao, ZHANG Yun, ZHENG Xiujuan, LIU Kai. Recognition Research on Concealing Behavior in Psychological Test [J]. Computer Engineering and Applications, 2020, 56(20): 158-164.
[2]	LIU Chunling, ZHANG Li. Recommendation Algorithm for Improving Asymmetric Similarity and Associated Regularization [J]. Computer Engineering and Applications, 2020, 56(16): 45-49.
[3]	HAN Ming1，2, WANG Jingtao1, MENG Junying1, LIU Jiaomin2. Energy Functional of Local Entropy Combined with Non-Convex Regularization for Image Segmentation [J]. Computer Engineering and Applications, 2019, 55(6): 160-167.
[4]	YANG-ZHAO Qilin, PENG Dingtao, TANG Qi, LUO Xiaomin. Smoothing Quasi-Newton Algorithm for [lp] Regularization of Sparse Optimization [J]. Computer Engineering and Applications, 2019, 55(22): 163-171.
[5]	ZHANG Xiaoting, HE Lang, HUANG Zhangcan, TAN Qing. High Order Ordinary Differential Equation Prediction Model Based on MFR-GEP [J]. Computer Engineering and Applications, 2019, 55(21): 247-253.
[6]	XU Shuang1, YU Li2. Regularized Matrix Factorization Algorithm for Multi-View Data Clustering [J]. Computer Engineering and Applications, 2019, 55(14): 142-147.
[7]	LIU Heng, HOU Yue. Application of Bayesian Neural Network in Prediction of Stock Time Series [J]. Computer Engineering and Applications, 2019, 55(12): 225-229.
[8]	SUN Jiamei, WU Chengmao. Regularized Picture Fuzzy Clustering and Its Robust Segmentation Algorithm [J]. Computer Engineering and Applications, 2019, 55(11): 179-186.
[9]	ZHANG Wei, XU Aiqiang. Application of MKL model incorporated within-class scatter in analog circuit diagnosis [J]. Computer Engineering and Applications, 2018, 54(9): 5-12.
[10]	CAO Zaihui1，2, WU Qingtao1，2, SHI Jinfa2，3. Attribute selection algorithm based on low rank and Tula Laplace [J]. Computer Engineering and Applications, 2018, 54(17): 110-115.
[11]	HUANG Jiqing, WANG Lihui, QIN Jin, CHENG Xinyu, ZHANG Jian, LI Zhi. Improved image super resolution reconstruction method based on multiple regularizations [J]. Computer Engineering and Applications, 2018, 54(15): 22-28.
[12]	CHEN Siyong, AN Congpei. l1-regularization approximation model and its application [J]. Computer Engineering and Applications, 2018, 54(12): 35-40.
[13]	WENG Qian1，2，3, MAO Zhengyuan2, LIN Jiawen3, JIAN Cairen4. Dimension reduction method based on spectral regression and graph regularization least square regression [J]. Computer Engineering and Applications, 2017, 53(5): 81-84.
[14]	ZHANG Hang, YE Dongyi. Recommender algorithm based on matrix factorization with multiple regularization parameters [J]. Computer Engineering and Applications, 2017, 53(3): 74-79.
[15]	GUO Caiping1，2，3, SHU Huazhong4, GUI Zhiguo1, 2, ZHANG Pengcheng1，2. Improvement based on regularization for building hybrid criteria model of radiotherapy planning [J]. Computer Engineering and Applications, 2017, 53(1): 23-28.

AdaBoost algorithm based on bregman distance and equality constraint regularization

基于bregman距离和等式约束正则化AdaBoost算法

PDF

Knowledge

Abstract

Cite this article

share this article

References

Related Articles 15

Recommended Articles

Metrics