支持多应用的桌面网格关键技术研究

计算机工程与应用 ›› 2016, Vol. 52 ›› Issue (23): 25-34.

支持多应用的桌面网格关键技术研究

阚文枭1，2，3，伍文静1，Andrei Tsaregorodtsev3，陈刚1

1.中国科学院高能物理研究所计算中心，北京 100049
2.中国科学院大学，北京 100049
3.法国科学院马赛粒子物理研究中心，法国马赛 13009

出版日期:2016-12-01 发布日期:2016-12-20

Research on key technology of supporting multi-application

KAN Wenxiao1，2，3, WU Wenjing1, Andrei Tsaregorodtsev3, CHEN Gang1

1.Center of Computing, Institute of High Energy Physics, Chinese Academy of Sciences, Beijing 100049, China
2.University of Chinese Academy of Sciences, Beijing 100049, China
3.Center for Particle Physics of Marseille, French National Centre for Scientific Research, Marseille 13009, France

Online:2016-12-01 Published:2016-12-20

摘要/Abstract

摘要： 针对基于多应用的计算需求及桌面网格设计中的主要技术问题，设计了桌面网格架构六层模型，并介绍了关键技术以及具体的实现方法，目的是解决在设计桌面网格架构时所面临的应用部署慢、整合异构计算资源难、作业调度模型少及扩展性差等问题，具体的实现方法包括采用多种通信模块，能够整合不同的计算资源访问系统；通过使用代理作业模块实现作业实例的转换的方法；采用文件系统及镜像服务，实现面向不同应用的作业环境及镜像需求；基于虚拟化技术实现异构计算资源的整合；针对不同应用类型的差异性，开发了通用控制程序组件；面向不同应用类型需求，实现的多种调度模型。基于这些方法实现了支持多应用的桌面网格系统，分析测试结果表明，这些方法可行并具备通用性。

关键词: 桌面网格架构, 虚拟化技术, 代理作业模式, 镜像服务, 通用性设计, 大数据处理, BOINC平台

Abstract: Aiming at multi-application requirements and the main issues in desktop grid, a six-layer model on desktop grid architecture is proposed to solve some common problems during design procedure. These common problems include slow application deployment, difficult job scheduling and bad system scalability. Besides, related key methods are introduced as well. More specifically, six key methods are introduced, including the use of multiple communication modes and multiple applications to integrate different computing resource access systems; the use of job agency module to implement general job instance transformation; the use of job file system and image metadata service to meet various requirements from different job types; integration of heterogeneous computing resources based on virtualization technology; development of general application control component based on multiple schedule models. Finally, based on these methods, a multi-application desktop grid systems are designed. The running results show that these methods are feasible and generic.

Key words: desktop grid architecture, virtualization technology, job agency module, image service, general-utility, big data processing, BOINC platform

阚文枭1，2，3，伍文静1，Andrei Tsaregorodtsev3，陈刚1. 支持多应用的桌面网格关键技术研究[J]. 计算机工程与应用, 2016, 52(23): 25-34.

KAN Wenxiao1，2，3, WU Wenjing1, Andrei Tsaregorodtsev3, CHEN Gang1. Research on key technology of supporting multi-application[J]. Computer Engineering and Applications, 2016, 52(23): 25-34.

[1]	崔雪涛，张曦煌. 可靠性云计算环境下能源效率的提高机制[J]. 计算机工程与应用, 2016, 52(1): 42-47.
[2]	李金忠，汤鹏杰，夏洁武，谭云兰. 迭代式MapReduce研究进展[J]. 计算机工程与应用, 2015, 51(12): 123-132.
[3]	常建忠，刘晓建. 虚拟机协同调度问题研究[J]. 计算机工程与应用, 2011, 47(6): 38-41.