计算机工程与应用 ›› 2010, Vol. 46 ›› Issue (12): 21-24.DOI: 10.3778/j.issn.1002-8331.2010.12.006

• 博士论坛 • 上一篇    下一篇

面向本地分布式存储系统的动态副本策略

伍文静,程耀东,汪 璐,武 杰,陈 刚   

  1. 中国科学院 高能物理研究所 计算中心,北京 100049
  • 收稿日期:2009-12-15 修回日期:2010-03-02 出版日期:2010-04-21 发布日期:2010-04-21
  • 通讯作者: 伍文静

Dynamic replica strategy for local distributed storage systems

WU Wen-jing,CHENG Yao-dong,WANG Lu,WU Jie,CHEN Gang   

  1. Computing Center,Institute of High Energy Physics,Chinese Academy of Sciences,Beijing 100049,China
  • Received:2009-12-15 Revised:2010-03-02 Online:2010-04-21 Published:2010-04-21
  • Contact: WU Wen-jing

摘要: 针对本地分布式存储系统的拓扑结构与存储组成单元的特性,提出了一种基于频度的动态副本算法FBDR。FBDR分别采用基于密度的单次频度分析和基于区间长度的两次频度聚合的方法对文件访问流进行分析,作为确定热点文件的依据,具有较高的命中率。在副本创建位置选择上,综合考虑了存储单元的可用空间、负载、IO性能等因素,使热点文件获得更高的IO速率,同时兼顾了存储单元之间的负载与资源利用的平衡。

Abstract: Based on the characteristics of topology and storage nodes of local distributed storage systems,a new Frequency Based Dynamic Replica(FBDR) strategy is proposed.FBDR uses two newly proposed algorithms called OFMI(One way Frequency Measure by Intensity) and TFMS(Two way Frequency Measure by Span) to identify hot files based on their access record history to improve the hit rate of hot files.FBDR takes available space,system load and IO performance of storage nodes into account to decide the location to replicate files,which not only improves the IO performance of frequently accessed files,but also balances the system load and resource consumptions on different storage nodes.

中图分类号: