Distributed data mining on grid services

doi:10.3778/j.issn.1002-8331.2010.28.002

Computer Engineering and Applications ›› 2010, Vol. 46 ›› Issue (28): 6-9.DOI: 10.3778/j.issn.1002-8331.2010.28.002

• 博士论坛 • Previous Articles Next Articles

Distributed data mining on grid services

DENG Yong，WANG Ru-chuan，DENG Song

School of Computer，Nanjing University of Posts and Telecommunications，Nanjing 210003，China

Received:2009-08-11 Revised:2010-08-23 Online:2010-10-01 Published:2010-10-01
Contact: DENG Yong

基于网格服务的分布式数据挖掘

邓勇，王汝传，邓松

南京邮电大学计算机学院，南京 210003

通讯作者: 邓勇

Abstract

Abstract: This paper presents distributed data mining platform on grid services，which combines grid services with distributed data mining to solve problems of traditional data mining.Meanwhile，this paper implements Distributed BP Classification Algorithm on Grid Services（DBPC-GS）.Simulation experiments show that contrasted with concentrative algorithms，the average consumptive time of DBPC-GS decreases apparently，and CPU load is reduced about 40% with increments of grid codes.

Key words: distributed data mining, grid service, BP net, classification

摘要： 在分析传统分布式数据挖掘平台不足的基础上，结合网格服务的思想，提出了基于网格服务的分布式数据挖掘平台，同时在该平台上，实现了分布式BP网络分类算法（GBPC-GS）。仿真实验表明，与单机环境相比，随着网格节点数增加，算法的平均耗时明显下降，同时CPU的负载也下降了约40%。

关键词: 分布式数据挖掘, 网格服务, BP网络, 分类

CLC Number:

TP311

DENG Yong，WANG Ru-chuan，DENG Song. Distributed data mining on grid services[J]. Computer Engineering and Applications, 2010, 46(28): 6-9.

邓勇，王汝传，邓松. 基于网格服务的分布式数据挖掘[J]. 计算机工程与应用, 2010, 46(28): 6-9.

[1]	YANG Chunxia, LI Xinxu, WU Jiajun, LIU Tianyu. Hierarchical Network Sentiment Classification Based on Attention Interaction Mechanism [J]. Computer Engineering and Applications, 2021, 57(9): 134-139.
[2]	ZHANG Hanyu, WU Zhihao, XU Yong, CHEN Bin. Face Forensics Detection Method Based on Enhanced Convolutional Neural Networks [J]. Computer Engineering and Applications, 2021, 57(8): 220-224.
[3]	HAN Dongfang, Turdy Toheti, Askar Hamdulla. Survey on Question Classification Method in Question Answering System [J]. Computer Engineering and Applications, 2021, 57(6): 10-21.
[4]	HUANG Jinjie, LIN Jiangquan, HE Yongjun, HE Jinjie, WANG Yajun. Chinese Short Text Classification Algorithm Based on Local Semantics and Context [J]. Computer Engineering and Applications, 2021, 57(6): 94-100.
[5]	HAN Weiyu, CHENG Longsheng. Research on Roling Bearing Failure Mode Classification Based on MTS and SVM [J]. Computer Engineering and Applications, 2021, 57(6): 239-246.
[6]	HUO Guangyu, ZHANG Yong, SUN Yanfeng, YIN Baocai. Research on Archive Data Intelligent Classification Based on Semantic [J]. Computer Engineering and Applications, 2021, 57(6): 247-253.
[7]	LI Shuo, LIANG Yi. Prediction Model of Execution Time for Batch Application in Spark [J]. Computer Engineering and Applications, 2021, 57(5): 79-87.
[8]	WANG Fengqin, KE Hengjin. Application of CNN and Its Analysis in Depression Identification [J]. Computer Engineering and Applications, 2021, 57(5): 245-250.
[9]	WAN Yaling, ZHONG Xiwu, LIU Hui, QIAN Yurong. Survey of Application of Convolutional Neural Network in Classification of Hyperspectral Images [J]. Computer Engineering and Applications, 2021, 57(4): 1-10.
[10]	TAO Tiwei, LIU Mingxia, WANG Mingliang, WANG Linlin, YANG Deyun, ZHANG Qiang. Effective Distance Based Low-Rank Representation [J]. Computer Engineering and Applications, 2021, 57(4): 141-147.
[11]	ZHENG Cheng, DONG Chunyang, HUANG Xiayan. Short Text Classification Method Based on BTM Graph Convolutional Network [J]. Computer Engineering and Applications, 2021, 57(4): 155-160.
[12]	SHE Hailong, XIE Shanjuan, ZOU Jingjie. 3D-CNN with Standard Score Dimensionality Reduction for Hyperspectral Remote Sensing Images Classification [J]. Computer Engineering and Applications, 2021, 57(4): 169-175.
[13]	YU Duo, HUANG Yongdong. Hyperspectral Image Classification Based on SPCA and Domain Transform Recursive Filtering [J]. Computer Engineering and Applications, 2021, 57(4): 199-208.
[14]	DING Zhihui, QIAO Gangzhu, CHENG Tan, SU Rong. Shapelets Transform Method Based on LSH [J]. Computer Engineering and Applications, 2021, 57(3): 112-119.
[15]	XIONG Jian, QIN Renchao, HE Mengyi, LIU Jianlan, TANG Fengyang. Application of Improved Random Forest Algorithm in Android Malware Detection [J]. Computer Engineering and Applications, 2021, 57(3): 130-136.

Distributed data mining on grid services

基于网格服务的分布式数据挖掘

PDF

Knowledge

Abstract

Cite this article

share this article

References

Related Articles 15

Recommended Articles

Metrics