Parallel data partition algorithm based on fitting of amount of computation

Computer Engineering and Applications ›› 2008, Vol. 44 ›› Issue (10): 34-36.

• 理论研究 • Previous Articles Next Articles

Parallel data partition algorithm based on fitting of amount of computation

CHEN Yu-shu,SONG Jun-qiang,WU Jian-ping,GONG Xi-ping,LIU Zhi-qiang

School of Computer，National University of Defense Technology，Changsha 410073，China

Received:2007-09-18 Revised:2008-01-10 Online:2008-04-01 Published:2008-04-01
Contact: CHEN Yu-shu

基于计算量拟合的并行数据剖分算法

陈宇澍,宋君强,吴建平,龚西平,刘志强

国防科学技术大学计算机学院，长沙 410073

通讯作者: 陈宇澍

Abstract

Abstract: A data partition algorithm based on the fitting of the amount of computation is proposed.It estimates the amount of computation for each atomic data partition unit by numerical fitting from the computation time of each processor，and calculates the data partition following the principle that the computation time of each processor should be the same.It has been proved by experiments that the algorithm is efficient in load balancing.

Key words: data partition, load balancing, atomic data partition unit, fitting of the amount of computation

摘要： 提出了一种基于计算量拟合的并行数据剖分算法，算法针对并行计算中静态负载不平衡问题，由各处理器实测计算时间，拟合出各基本数据剖分单元的计算量，在此基础上按各处理器计算时间相等的原则确定数据剖分。模拟试验表明，该算法能快速有效地实现各处理器的负载平衡。

关键词: 数据剖分, 负载平衡, 基本数据剖分单元, 计算量拟合

CHEN Yu-shu,SONG Jun-qiang,WU Jian-ping,GONG Xi-ping,LIU Zhi-qiang. Parallel data partition algorithm based on fitting of amount of computation[J]. Computer Engineering and Applications, 2008, 44(10): 34-36.

陈宇澍,宋君强,吴建平,龚西平,刘志强. 基于计算量拟合的并行数据剖分算法[J]. 计算机工程与应用, 2008, 44(10): 34-36.

[1]	WANG Baojian, HU Dasha, JIANG Yuming. Application of Improved A* Algorithm in Path Planning [J]. Computer Engineering and Applications, 2021, 57(12): 243-247.
[2]	YUAN Yang, YE Feng, LAI Yizong, ZHAO Yuting. Multi-AGV Path Planning Combined with Load Balancing and A* Algorithm [J]. Computer Engineering and Applications, 2020, 56(5): 251-256.
[3]	WANG Li, ZHAO Aqun, ZHAO Chenhui. Virtual Slice Load Balancing Algorithm Based on Fat-Tree [J]. Computer Engineering and Applications, 2020, 56(13): 93-99.
[4]	QIN Feng, ZENG Hao, LIN Kaidong. Load Balancing-Based Routing Protocol for LLN Under High-Load Scenario [J]. Computer Engineering and Applications, 2020, 56(1): 121-126.
[5]	ZHU Ruijin, GONG Xuejiao, TANG Bo. Distributed Hybrid Compressive Sensing for Wireless Sensor Network Data Collection [J]. Computer Engineering and Applications, 2019, 55(6): 73-80.
[6]	WANG Jun, WANG Menglin, WANG Yue, LIU Junjie. Load Balancing Scheme Based on Flow Classification for SDN Data Center Network [J]. Computer Engineering and Applications, 2019, 55(24): 75-83.
[7]	LIU Huan, FANG Sheng, LI Zhe, ZHAO Qing. Load Balancing Algorithm Based on Multiple HEVC Parallel Encoder [J]. Computer Engineering and Applications, 2019, 55(18): 180-188.
[8]	GU Jing，HOU Yongping，ZHANG Xin. Dynamic CRE Bias Selection Based on Improved Bat Algorithm in Heterogeneous Networks [J]. Computer Engineering and Applications, 2019, 55(13): 93-99.
[9]	WANG Penghui，ZHANG Ning，XIAO Mingming. Routing and Spectrum Allocation Algorithm Based on Node Importance [J]. Computer Engineering and Applications, 2019, 55(13): 106-111.
[10]	LI Hong, ZHU Xuan, LIU Yunfei, LI Junhui. Improved TORA Protocol with Low Overhead and Load Balancing [J]. Computer Engineering and Applications, 2019, 55(11): 67-73.
[11]	WU Yaoyao1, YANG Geng1，2. Distributed File System Load Balancing in Cloud Environment [J]. Computer Engineering and Applications, 2019, 55(10): 67-72.
[12]	LIU Kang1, ZHANG Xueying1, LI Fenglian1, TIAN Yuchu1，2. Graph partitioning method for social networks based on communication load balancing [J]. Computer Engineering and Applications, 2018, 54(4): 66-71.
[13]	LUO Yu1, ZHOU Xing1, LONG Yu1, KUANG Hanbao1, Thomas Dreibholz2, TAN Yuyin1. Supporting verification from IPv6+MPTCP technology on upper-layer application [J]. Computer Engineering and Applications, 2018, 54(24): 79-86.
[14]	QI Xing, LI Guanglei, ZHOU Huachun, CHEN Jia. DDoS attack elimination policy based on traffic awareness for multi-data center [J]. Computer Engineering and Applications, 2018, 54(24): 87-96.
[15]	YU Fangping, LIU Jian, MA Can. Research of mixed-model automobile assembly sequencing based on hybrid cuckoo search algorithm [J]. Computer Engineering and Applications, 2017, 53(8): 240-245.

Parallel data partition algorithm based on fitting of amount of computation

基于计算量拟合的并行数据剖分算法

PDF

Knowledge

Abstract

Cite this article

share this article

References

Related Articles 15

Recommended Articles

Metrics