关键词: 媒资管理系统, Map-Reduce, 数据收集, hadoop单线程模式, hadoop伪分布模式, hadoop全分布模式

Abstract: In the traditional media resource management system, the task of data collecting is based on the C/S or B/S mode which needs the high performance on servers. In order to acquire the higher performance, the traditional method is to buy servers with higher configuration, the new way is to adopt the cloud computing which is emerged in recent years. In this paper, using the Hadoop Man-Reduce framework of Apache implements data collecting from different sources. In the experiments, It analyzes the experimental results and comparison of three modes which are standalone, pseudo-distributed of Hadoop, fully-distributed of Hadoop. According to the studies, the Map-Reduce can cut down the time and improve the performance of the servers.

Key words: media resource management system, Map-Reduce, data collecting, standalone mode of hadoop, pseudo-distributed mode of hadoop, fully-distributed mode of hadoop