关键词: Hadoop, 云平台, 调度算法, 集群负载

Abstract: Wind data center contains status monitoring, data acquisition real-time jobs and other non-real-time jobs. The structure of C/S has been widely used, but it has many disadvantages, such as the imbalance of resource utilization, the high cost of management and maintenance, etc. This paper presents a data center architecture based on cloud computing platform; in order to solve the FIFO scheduler in the open source Hadoop platform can not satisfy the real-time monitoring jobs’ requirements, it designs a dual queue job scheduler based on the existing FIFO scheduler, which considers the deadline time and priority of the job to make schedule job decisions. Compared with the FIFO scheduler, the experimental results show that the dual queue job scheduler can make a good performance when the cluster load is large to make the real-time jobs can be executed first, and provides a guarantee for the safe operation of the wind turbines.

Key words: Hadoop, cloud platform, scheduling algorithm, cluster load