Parallel program performance optimization for data-intensive applications on multi-core clusters

Computer Engineering and Applications ›› 2012, Vol. 48 ›› Issue (30): 73-77.

Previous Articles Next Articles

Parallel program performance optimization for data-intensive applications on multi-core clusters

HUANG Hualin1，2, ZHONG Cheng1

1.School of Computer, Electronics and Information, Guangxi University, Nanning 530004, China
2.Nanning Power Supply Bureau, Guangxi Power Grid, Nanning 530031, China

Online:2012-10-21 Published:2012-10-22

多核机群上数据密集型应用并行程序性能优化

黄华林1，2，钟诚1

1.广西大学计算机与电子学院，南宁 530004
2.广西电网南宁供电局，南宁 530031

Abstract

Abstract: Using dynamic data task block scheduling policy and all-locking technology on the heterogeneous multi-
core clusters, this paper presents a hybrid parallel programming mechanism of multiprocess-level and multithreaded-
level for the data-intensive applications, which can efficiently use the data in the main memory and dynamic schedule the data block in shared L2 cache, and presents the technology and strategy of paralleled application performance optimization for the data-intensive applications. The experiments for solving the multi-keyword search of random sequences parallelly on the heterogeneous multi-core clusters show that the parallel programming mechanism and performance optimization methods are usable and efficient.

Key words: multi-core cluster, multiple threads, parallel programming, performance optimization

摘要： 在异构多核机群系统上利用数据任务块的动态调度策略和全锁定技术，给出一种面向数据密集型应用的结点内主存和可用的共享二级缓存大小中动态调度数据块的多进程级和多线程级并行编程机制，给出了优化数据密集型应用并行程序性能的策略和技术。在多核计算机组成的异构机群上并行求解随机序列多关键字查找的实验结果表明，所给出的多核并行程序设计机制和性能优化方法可行和高效。

关键词: 多核机群, 多线程, 并行编程, 性能优化

HUANG Hualin1，2, ZHONG Cheng1. Parallel program performance optimization for data-intensive applications on multi-core clusters[J]. Computer Engineering and Applications, 2012, 48(30): 73-77.

黄华林1，2，钟诚1. 多核机群上数据密集型应用并行程序性能优化[J]. 计算机工程与应用, 2012, 48(30): 73-77.

[1]	WANG Cong1，2, XU Qi1，2, CHENG Yaodong1, CHEN Gang1. Research of event data management and data transfer system in high energy physics [J]. Computer Engineering and Applications, 2018, 54(23): 230-237.
[2]	ZHU Yongzhi, XU Shiqiang, YU Jiguo. Optimized implementation of N-body problem based on OpenMP/MPI parallel programming model [J]. Computer Engineering and Applications, 2016, 52(5): 16-21.
[3]	LI Jinzhong, TANG Pengjie, XIA Jiewu, TAN Yunlan. Advances in iterative MapReduce [J]. Computer Engineering and Applications, 2015, 51(12): 123-132.
[4]	LUO Gui’e, KANG Xia. Research and implementation of solid state storage system-level performance optimization [J]. Computer Engineering and Applications, 2015, 51(1): 43-48.
[5]	HE Jinwei, DING Lu, LIU Zhimin. Realization and optimization of LTE system-level simulation platform [J]. Computer Engineering and Applications, 2012, 48(22): 104-108.
[6]	WEI Xingliu1, ZHONG Cheng1, LI Zhi1，2, CAI Dexia1, CHEN Qingyuan1. Parallel downloading large files and mixed files using multiple threads [J]. Computer Engineering and Applications, 2012, 48(14): 84-89.
[7]	HAN Chao1，2, NA Wenwu1，2, LIU Zhenjun1, XU Lu1. Research on BW-RAID reconstruction technology and optimization [J]. Computer Engineering and Applications, 2012, 48(1): 60-63.
[8]	SHI Yingchao，ZHANG Facun，DUAN Jinghong. PIMC：Data parallel language for embedded applications [J]. Computer Engineering and Applications, 2011, 47(4): 61-63.
[9]	SUN Chang-le，GUO Dong-ming，GAO Hang，ZOU Ling-hao . Intelligent data batch processing control model [J]. Computer Engineering and Applications, 2010, 46(13): 224-228.
[10]	LI Zhan-sheng¹,BI Hui-juan¹,DU Zhi-hui²,JIAO Qing³. Improvement and performance analysis of MPI_ALLGATHER algorithm [J]. Computer Engineering and Applications, 2007, 43(27): 66-71.
[11]	JIANG Hong-xun,YANG Yong-yan,SU Jun. Study on comprehensive optimization model of multi parallel IT applications in IT systems management [J]. Computer Engineering and Applications, 2007, 43(27): 240-242.
[12]	ZHOU Kuan-jiu¹，HOU Gang²，ZHANG Xi-han². Performance optimization of D3D Player [J]. Computer Engineering and Applications, 2007, 43(23): 97-99.
[13]	WANG Guo-qiang，LI Jin-long，ZHANG Min，WANG Xu-fa. Solving performance optimization problem of cognitive radio with multiobjective evolutionary algorithm [J]. Computer Engineering and Applications, 2007, 43(20): 159-162.

Parallel program performance optimization for data-intensive applications on multi-core clusters

多核机群上数据密集型应用并行程序性能优化

PDF

Knowledge

Abstract

Cite this article

share this article

References

Related Articles 13

Recommended Articles

Metrics