Computer Engineering and Applications ›› 2015, Vol. 51 ›› Issue (2): 71-75.

Previous Articles     Next Articles

Key technologies of network file storage system

XU Yang   

  1. Department of Computer Science and Technology, Tsinghua University, Beijing 100084, China
  • Online:2015-01-15 Published:2015-01-12

一个网络文件存储系统TNS关键技术

徐  阳   

  1. 清华大学 计算机系,北京 100084

Abstract: The file storage system based on multi-server architecture with multi-user service often meets the challenge of unbalanced distribution of resources, files redundancy, which wastes large storage space. It designs and develops a network file storage system TNS, which is based on multi-server storage architecture, composed by user servers, index servers, data servers, sharing server, management server and login server, provides multi-user service, with consistency hash algorithm for load balance, supporting data deduplication on client side with file granularity. The experiment in the real environment shows that TNS is good at load balancing and data deduplication, which saves large storage space and improves the utilization of storage devices.

Key words: network file storage, load balance, data deduplication

摘要: 基于多服务器架构、为多用户服务的网络文件存储系统普遍存在资源分配不均,重复文件多,存储空间浪费严重的问题。设计并实现了TNS网络文件存储系统,该系统基于多服务器存储架构,分别由用户服务器、索引服务器、数据服务器、共享服务器、管理服务器和登录服务器组成,为多用户服务,采用一致性Hash实现负载均衡,支持在客户端进行文件粒度的重复数据删除。经过实际生产环境运行测试,具有良好的负载均衡能力和重复数据删除功能,可以有效节省存储空间,提高存储设备利用率。

关键词: 网络文件存储, 负载均衡, 重复数据删除