Computer Engineering and Applications ›› 2014, Vol. 50 ›› Issue (15): 65-71.

Previous Articles     Next Articles

Research of Hadoop resource-aware scheduler based on ant colony algorithm

ZHANG Haiyan, WU Fan, WANG Jianxin   

  1. School of Information Science & Technology, Beijing Forestry University, Beijing 100083, China
  • Online:2014-08-01 Published:2014-08-04

基于蚁群算法的Hadoop资源感知调度器研究

张海燕,吴  凡,王建新   

  1. 北京林业大学 信息学院,北京 100083

Abstract: By studying the colony algorithm, analyzing the deficiency of existing Hadoop scheduler, a resource-aware scheduler based on ant colony algorithm is proposed. It  can be more comprehensive and more scientific to assign tasks and improve the operating performance of the overall architecture. The experiment shows that, the resource-aware scheduler has not improved the performance markedly in isomorphic situation, however, it can significantly increase performance in isomerism situation. This resource-aware scheduler can improve the calculation speed of the system and reduce the computing time.

Key words: Hadoop, resource-aware scheduler, ant colony algorithm

摘要: 通过研究蚁群算法,针对现有Hadoop调度器的不足,提出一个基于蚁群算法的Hadoop资源感知调度器及其具体实现方案。从而使Hadoop作业调度器可以更有效地对任务进行分配,提高整体架构的作业性能。通过实验证明,利用蚁群算法实现的资源感知调度器在同构环境中虽没有明显改善系统计算速度,但是在异构环境中可以很好提高系统处理任务的性能,降低了运算时间。

关键词: Hadoop, 资源感知调度器, 蚁群算法