计算机工程与应用 ›› 2015, Vol. 51 ›› Issue (7): 7-11.

• 博士论坛 • 上一篇    下一篇

基于改进支持向量机的快速稳健代理模型研究

刘玉琳1,2,陈文亮2,鲍益东2,丁力平2   

  1. 1.安徽工业大学 数理学院,安徽 马鞍山 243032
    2.南京航空航天大学 机电学院,南京 210016
  • 出版日期:2015-04-01 发布日期:2015-03-31

Fast and robust surrogate model research based on improved support vector machine

LIU Yulin1,2, CHEN Wenliang2, BAO Yidong2, Ding Liping2   

  1. 1.School of Mathematics and Physics, Anhui University of Technology, Ma’anshan, Anhui 243032, China
    2.College of Mechanical Engineering, Nanjing University of Aeronautics and Astronautics, Nanjing 210016, China
  • Online:2015-04-01 Published:2015-03-31

摘要: 最小二乘支持向量机代理模型具有较好的泛化能力和强大的非线性处理能力,但其对实际工程中不可避免的异常样本十分敏感,而传统的加权最小二乘支持向量机易产生过度拟合并且未考虑到回归误差分布特性,针对这一问题提出正态分布概率密度函数加权方法,并且采用回归误差的中值作为计算权值的衡量标准,增强了加权算法的稳健性;提出了迭代加权最小二乘支持向量机快速递推算法,利用矩阵关系进行迭代递推计算,减少了计算量,节约了建模时间。通过数值实例验证了该方法的可行性、有效性。

关键词: 稳健, 代理模型, 加权最小二乘支持向量机, 异常样本

Abstract: Surrogate model based on Least Squares Support Vector Machine(LS-SVM)has preferable generalization ability and powerful non-linear expression ability, but LS-SVM is very sensitive to outliers which are inevitable in actual projects. Traditional Weighted Least Squares Support Vector Machine(WLS-SVM)often has the problem of over fitting, and it does not consider the regression error distribution characteristic. Aiming at these problems, normal distribution probability density function weighted method is presented, and the median value of regression error is selected as criteria for computing weighted value in order to improve the weighted algorithm robustness. Moreover, fast recursive algorithm for iteratively weighted LS-SVM is proposed. Matrix relation is utilized in this fast algorithm for iteratively recursive calculation, which can reduce computation and save modeling time. Lastly, the results of numerical regression experiment validate the feasibility and effectiveness of this method.

Key words: robust, surrogate model, Weighted Least Squares Support Vector Machine(WLS-SVM), outliers