计算机工程与应用 ›› 2017, Vol. 53 ›› Issue (9): 85-89.DOI: 10.3778/j.issn.1002-8331.1601-0129

• 大数据与云计算 • 上一篇    下一篇

提高云存储效率的并行处理策略研究

周兰凤1,孟  驰1,彭俊杰2   

  1. 1.上海应用技术学院 计算机科学与信息工程学院,上海 201418
    2.上海大学 计算机工程与科学学院,上海 200444
  • 出版日期:2017-05-01 发布日期:2017-05-15

Research on parallel processing strategy of cloud-storage efficiency promotion

ZHOU Lanfeng1, MENG Chi1, PENG Junjie2   

  1. 1.School of Computer Science and Information Engineering, Shanghai Institute of Technology, Shanghai 201418, China
    2.School of Computer Engineering and Science, Shanghai University, Shanghai 200444, China
  • Online:2017-05-01 Published:2017-05-15

摘要: 在云存储过程中,从本地发送大量文件到服务器端采用打包传输时,在接收端需要等待文件包完整接收后方可进行打包,这一过程由于打包和解包耗时较多降低了传输效率。针对这一问题,提出了一种优化传输的并行处理策略,将传输的大量文件无损压缩后以特定的大小进行多批次打包,传输过程中接收端同时对接收之前批次的包文件进行解包,以此达到并行处理打包和解包操作,实验表明并行处理的策略有效地降低了传输时间,提高了存储效率。

关键词: 云存储, 并行处理, 传输效率

Abstract: During the process of cloud-storage, enormous amount of data files are transmitted from local storage to the server terminals by the means of packaging. The files should be received completely to unpack in the server terminal, which will reduce the efficiency of transmitting because of time consumption of packaging and unpacking. Aiming at solving this problem, this paper proposes a parallel processing scheme of optimizing transmitting. It packs batches of file packages based on file size threshold in local storage before transmitting them. Meanwhile, in the receiving side the former batches of package files are being unpacked to complete the parallel processing of packing and unpacking. Experiment results show that parallel processing scheme can reduce the time consumption of transmitting time efficiently, as a result the storage efficiency is improved.

Key words: cloud-storage, parallel processing, transmitting efficiency