Surrogate Model Construction Method of Extreme Learning Machine Based on Transfer Learning and Application

doi:10.3778/j.issn.1002-8331.2105-0199

Abstract

Abstract:

Aiming at solving the problem of using a small number of samples to construct a high-precision surrogate model in the iterative update of engineering products or the redesign and optimization of similar projects under specific requirements, a surrogate modeling method of extreme learning machine based on transfer learning is proposed. Firstly, combine the historical accumulation data of similar engineering products and a small amount of real samples sampled on the current product to construct a multi-fidelity approximate model. Then, combine the random samples generated by the approximate model and the real samples of the current product to construct the surrogate model of extreme learning machine based on transfer learning. The proposed algorithm is verified by a numerical example, and further verified by an engineering case of constructing the maximum pressure surrogate model of the hydraulic system of the boom of a forklift truck. The experimental results show that the proposed algorithm can significantly improve the prediction accuracy of the surrogate model when a small number of samples are used.

Key words: transfer learning, extreme learning machine, surrogate model, multi-fidelity

摘要：

针对在工程产品的迭代更新或者相似工程在特定需求下的重新设计优化中，使用少量样本构建高精度代理模型的问题，提出了基于迁移学习的极限学习机代理建模方法。结合相似工程产品的历史累积数据和当前产品上采样的少量真实样本，构建变可信度近似模型；融合近似模型生成的随机样本和当前产品的真实样本，构建基于迁移学习的极限学习机代理模型。所提算法使用数值算例进行了验证，并通过构建叉车臂架液压系统变幅缸最大压力代理模型的工程案例做进一步验证，实验结果表明，使用少量样本时，所提算法能显著提升代理模型的预测精度。

关键词: 迁移学习, 极限学习机, 代理模型, 变可信度

HUANG Zeying, LI Haiyan, LIN Jingliang. Surrogate Model Construction Method of Extreme Learning Machine Based on Transfer Learning and Application[J]. Computer Engineering and Applications, 2021, 57(22): 257-262.

黄泽英，李海艳，林景亮. 迁移学习下的极限学习机代理建模方法及应用[J]. 计算机工程与应用, 2021, 57(22): 257-262.

References

[1] 龙腾，刘建，WANG G G，等.基于计算试验设计与代理模型的飞行器近似优化策略探讨[J].机械工程学报，2016，52（14）：79-105.
LONG T，LIU J，WANG G G，et al.Discuss on approximate optimization strategies using design of computer experiments and metamodels for flight vehicle design[J].Journal of Mechanical Engineering，2016，52（14）：79-105.
[2] IBRAHIM I，SILVA R P，MOHAMMADI M H，et al.Surrogate-based acoustic noise prediction of electric motors[J].IEEE Transactions on Magnetics，2020，56（2）：1-4.
[3] 魏锋涛，卢凤仪.融合核函数在改进径向基代理模型中的应用[J].计算机工程与应用，2019，55（7）：58-65.
WEI F T，LU F Y.Application of hybrid kernel function in improved radial basis function metamodel[J].Computer Engineering and Applications，2019，55（7）：58-65.
[4] JAKOBSSON S，PATRIKSSON M，RUDHOLM J，et al.A method for simulation based optimization using radial basis functions[J].Optimization & Engineering，2010，11（4）：501-532.
[5] 张晨曦，唐曙，唐珂.迁移学习下的火箭发动机参数异常检测策略[J].计算机应用，2020，40（9）：2774-2780.
ZHANG C X，TANG S，TANG K.Strategies of parameter fault detection for rocket engines based on transfer learning[J].Journal of Computer Applications，2020，40（9）：2274-2780.
[6] 廖一鹏，杨洁洁，王志刚，等.基于双模态卷积神经网络自适应迁移学习的浮选工况识别[J].光子学报，2020，49（10）：173-184.
LIAO Y P，YANG J J，WANG Z G，et al.Flotation performance recognition based on dual-modality convolutional neural network adaptive transfer learning[J].Acta Photonica Sinica，2020，49（10）：173-184.
[7] ZHU Z，GUO H W.Design of an RBF surrogate model for low reynolds number airfoil based on transfer learning[C]//31st Chinese Control and Decision Conference，Nanchang，Jun 2-5，2019：4555-4559.
[8] 周婷，吴宗成，陈泽民，等.翼身组合体的变可信度优化设计[J].北京航空航天大学学报，2012，38（7）：962-965.
ZHOU T，WU Z C，CHEN Z M，et al.Variable-fidelity optimization applied to wing-body configuration[J].Journal of Beijing University of Aeronautics and Astronautics，2012，38（7）：962-965.
[9] SHI M，LV L，SUN W，et al.A multi-fidelity surrogate model based on support vector regression[J].Structural and Multidisciplinary Optimization，2020，61（6）：2363-2375.
[10] KOU J，ZHANG W.Multi-fidelity modeling framework for nonlinear unsteady aerodynamics of airfoils[J].Applied Mathematical Modelling，2019，76：832-855.
[11] 周奇，杨扬，宋学官，等.变可信度近似模型及其在复杂装备优化设计中的应用研究进展[J].机械工程学报，2020，56（24）：219-245.
ZHOU Q，YANG Y，SONG X G，et al.Survey of multi-fidelity surrogate models and their applications in the design and optimization of engineering equipment[J].Journal of Mechanical Engineering，2020，56（24）：219-245.
[12] PAN S J，QIANG Y.A survey on transfer learning[J].IEEE Transactions on Knowledge and Data Engineering，2010，22（10）：1345-1359.
[13] HUANG G B，ZHU Q Y，SIEW C K，et al.Extreme learning machine：a new learning scheme of feedforward neural networks[C]//2004 IEEE International Joint Conference on Neural Networks，2004：985-990.
[14] KANG F.Extreme learning machine-based surrogate model for analyzing system reliability of soil slopes[J].European Journal of Environmental and Civil Engineering，2017，21（11）：1341-1362.
[15] PARDOE D，STONE P.Boosting for regression transfer[C]//27th International Conference on International Conference on Machine Learning，Haifa，Jun 21-24，2010：863-870.