计算机工程与应用 ›› 2014, Vol. 50 ›› Issue (3): 117-120.
• 数据库、数据挖掘、机器学习 • 上一篇 下一篇
董 微,闻 育
出版日期:
发布日期:
DONG Wei, WEN Yu
Online:
Published:
摘要: 现代信息系统的突出特征是基于海量数据的分布式应用集群。优化海量数据的存储布局,以提升存储资源的利用率和应用执行的速度,是一个重要研究课题。由于数据与数据之间存在关联性,只考虑负载均衡的布局算法缺乏实用性,需要进一步考虑数据与数据的关联性以提高应用执行速度。建立了数据和数据的关联矩阵,基于关联矩阵进行聚类,再将数据分配到各个数据中心中,计算执行应用时的数据迁移量,并与一致hash算法进行了比较,结果表明数据迁移量大大低于一致hash算法。
关键词: 数据布局, 聚类, 一致hash, 数据关联性
Abstract: The prominent feature of the modern information systems is the distributed applications clustering based on massive data, so optimizing the storage of mass data to improve the response time of the application service while making full use of the storage resources is an important task. Because of the dependency of the data, the data placement algorithm which simply considers the load balancing is lack of practicability, so it needs to further consider the denpendency of the data to improve the response time of the application service. So it establishes a denpendency matrix, clusters the data based on the dependency matrix, and then distributes the data to each data center. It analyses data movements of the application and compared with the consistent hashing, the results show that the data movements is greatly decreased.
Key words: data placement, clustering, consistent hash, data dependence
董 微,闻 育. 基于数据关联性聚类的数据布局算法[J]. 计算机工程与应用, 2014, 50(3): 117-120.
DONG Wei, WEN Yu. Data placement algorithm based on data dependence[J]. Computer Engineering and Applications, 2014, 50(3): 117-120.
0 / 推荐
导出引用管理器 EndNote|Ris|BibTeX
链接本文: http://cea.ceaj.org/CN/
http://cea.ceaj.org/CN/Y2014/V50/I3/117