关键词: 云计算, 作业调度, Hadoop, 加权, MapReduce编程模型

Abstract: Among capacity scheduling algorithms, it is not fully taken into account whether the allocation of resources meets job varied service requirements. This paper presents a priority based weighted capacity scheduling algorithm which calculates the weight based on the priority of jobs, job’s wait time and other factors of job. Based on the weight of the job to sort the job queue and assign free slot to the team’s first job, so as to avoid falling into local optimal solution and better meet job varied service requirements. Experimental results on Hadoop platform show that improved algorithm can be more balanced with the resources, reduce waiting time for some jobs, and decrease the total run time of the job.

Key words: cloud computing, job scheduling, Hadoop, weighting, MaPreduce programming model