Abstract:

To improve the performance, some accelerators, such as MIC co-processors, are added to server-side, which becomes heterogeneous systems consisting of multi-core CPUs and MIC co-processors. However, traditional web server software can not make full use of the heterogeneous systems. In order to solve the problem, this paper proposes a new web server software framework, which can exploit the performance of the heterogeneous systems with multi-core CPUs and MIC co-processors. To improve the performance, the software framework schedules some dynamic requests to MIC co-processors from CPU, and then these dynamic requests can be handled on both CPUs and MIC processors. Meanwhile, the software framework can also keep load balance between multi-core CPUs and MIC co-processors by adopting a load balance algorithm. Simulation experiments show that this software framework is superior to the traditional web server software based on First Come First Served（FCFS） algorithm in aspects of mean response time and throughput.

Key words: heterogeneous system, MIC co-processor, dynamic request, scheduling, web server

摘要：

在服务器端加入GPU或MIC等协处理器可以提升性能。但是，传统Web服务器端软件不能充分发挥多核CPU+MIC协处理器异构硬件体系的性能。为解决该问题，针对该硬件体系提出了一种新的Web服务器软件框架。该软件框架基于分阶段事件驱动模型，将部分动态请求调度至MIC协处理器执行，并可在多核CPU和MIC协处理器上并行处理动态请求。同时，通过采用自适应调度算法兼顾了CPU和MIC协处理器间的负载均衡。仿真实验表明，该模型在平均响应时间、吞吐量等方面均优于传统的基于先到先服务（First Come First Served，FCFS）的Web服务器软件模型。

关键词: 异构系统, MIC协处理器, 动态请求, 调度, Web服务器