Computer Engineering and Applications ›› 2014, Vol. 50 ›› Issue (9): 98-102.

Previous Articles     Next Articles

Computing resource optimization in heterogeneous Hadoop cluster based on harmony search algorithm

LI Fenggang1,2, WEI Yanyan1,2, YANG Long1,2   

  1. 1.School of Management, Hefei University of Technology, Hefei 230009, China
    2.Key Laboratory of Process Optimization and Intelligent Decision-making, Ministry of Education, Hefei 230009, China
  • Online:2014-05-01 Published:2014-05-14

基于和声算法异构Hadoop集群资源分配优化

李锋刚1,2,魏炎炎1,2,杨  龙1,2   

  1. 1.合肥工业大学 管理学院,合肥 230009
    2.教育部过程优化与智能决策重点实验室,合肥 230009

Abstract: In heterogeneous Map-Reduce environment, resource allocation strategies directly affect their response time. How to use effective strategies for the computing tasks assigned to the computing resources is an urgent problem to be solved. This paper uses harmony search algorithm to optimize computing resources in the heterogeneous Hadoop cluster environment. Taking into account the processing power, bandwidth, network quality and other factors impact on the resources allocation in the heterogeneous cloud computing environment, it models the issue and uses harmony search algorithm to optimize resource allocation strategies in order to reduce response time. It does experiments in Gridsim environment. The results show that using harmony search algorithm to optimize resource allocation can reduce response time.

Key words: cloud computing, Hadoop, heterogeneous cluster, harmony search algorithm, resource allocation

摘要: 异构Map-Reduce环境中资源分配策略直接影响其响应时间,如何利用有效的策略将计算任务分配到计算资源是亟待解决的问题。利用和声搜索算法对异构Hadoop集群中的计算资源分配问题进行优化。对问题进行建模时考虑了异构计算机集群中各节点的处理能力、带宽和线路质量和源数据位置等因素对计算资源分配的影响,利用和声搜索算法优化资源分配策略,以期在满足用户需求的前提下提高系统的响应时间。并用Gridsim对算法进行仿真实验,实验结果表明利用和声搜索算法可以达到减少系统响应时间的目的。

关键词: 云计算, Hadoop, 异构集群, 和声搜索算法, 资源分配