Design and Implementation of MooseFS Hot Standby Master

doi:10.3778/j.issn.1002-8331.1802-0006

Computer Engineering and Applications ›› 2019, Vol. 55 ›› Issue (13): 72-77.DOI: 10.3778/j.issn.1002-8331.1802-0006

Previous Articles Next Articles

Design and Implementation of MooseFS Hot Standby Master

LIN Bingdong1，2, ZHAO Danpu1，3, TAI Xianqing4

1.Research Center of Intelligent City and Intelligent Transportation, CAS R&D Center for Internet of Things, Wuxi, Jiangsu 214135, China
2.School of Microelectronics, University of Chinese Academy of Sciences, Beijing 101407, China
3.Key Laboratory of Technology in Geospatial Information Processing and Application System, Institute of Electronics, Chinese Academy of Sciences, Beijing 100190, China
4.Laboratory of Geospatial Information Systems, Institute of Electronics, Chinese Academy of Sciences, Suzhou, Jiangsu 215121, China

Online:2019-07-01 Published:2019-07-01

MooseFS热备元数据节点设计与实现

林炳东1，2，赵旦谱1，3，台宪青4

1.中国科学院物联网研究发展中心智慧城市与智能交通研究中心，江苏无锡 214135
2.中国科学院大学微电子学院，北京 101407
3.中国科学院电子学研究所中国科学院空间信息处理与应用系统技术重点实验室，北京 100190
4.中国科学院电子学研究所苏州研究院地理空间信息系统研究室，江苏苏州 215121

Abstract

Abstract: Aiming at the single point of failure problem of the MooseFS master, a hot standby master is added for MooseFS through modifying the source code. By synchronizing the metadata between the primary and standby master and the standby master replay log, the standby master’s metadata in memory are always consistent with the master’s. After the primary master fails over to the standby master, the standby master can quickly take over services from the primary master without loading the metadata from the local. Test results show that the metadata of the standby master in the local and in memory are consistent with the primary master, and the time of failure recovery is less than 1 second.

Key words: MooseFS master, hot standby, metadata, data consistency, log replay

摘要： 针对MooseFS元数据节点的单点故障问题，对MooseFS源码进行改造，为其增加一个热备的备元数据节点，并通过主备之间同步元数据，备节点回放操作日志等技术使得备元数据节点内存中的元数据时刻跟主元数据节点保持一致。当主元数据节点发生故障切换到备元数据节点后，备元数据节点无需从本地加载元数据即可快速接替主元数据节点对外提供服务。测试结果表明，备元数据节点本地和内存中的元数据均与主元数据节点保持一致，且故障恢复时间小于1 s。

关键词: MooseFS元数据节点, 热备, 元数据, 数据一致性, 日志回放

LIN Bingdong1，2, ZHAO Danpu1，3, TAI Xianqing4. Design and Implementation of MooseFS Hot Standby Master[J]. Computer Engineering and Applications, 2019, 55(13): 72-77.

林炳东1，2，赵旦谱1，3，台宪青4. MooseFS热备元数据节点设计与实现[J]. 计算机工程与应用, 2019, 55(13): 72-77.

[1]	ZHU Xiangru1，2, LIU Bainian1，2, ZHANG Weimin1，2, CAO Xiaoqun1，2. General framework and component design of application platform for atmospheric reanalysis products [J]. Computer Engineering and Applications, 2018, 54(5): 223-230.
[2]	HAO Kun, XIN Junchang, HUANG Da, WANG Guoren. Decentralized model for distributed storage system [J]. Computer Engineering and Applications, 2017, 53(24): 1-7.
[3]	JI Meili1, WANG Xinhua1，2. Research on cooperative caching in mobile P2P network [J]. Computer Engineering and Applications, 2012, 48(9): 70-73.
[4]	XU Yongshi1，2, ZANG Dongsong1，2, SUN Gongxing1. Design of a kind of distributed file metadata management system [J]. Computer Engineering and Applications, 2012, 48(7): 1-4.
[5]	SU Fang, SHOU Yongxi, SU Yila. Research on metadata driven ETL [J]. Computer Engineering and Applications, 2012, 48(6): 114-118.
[6]	XU Yongshi1，2, HUO Jing1，2, SUN Gongxing1. Node-localized data storage and processing system [J]. Computer Engineering and Applications, 2012, 48(5): 7-11.
[7]	WANG Huan, LI Zhanhuai, ZHANG Xiao. Design of cloud backup system architecture supporting continuous data protection [J]. Computer Engineering and Applications, 2012, 48(1): 90-93.
[8]	JIANG Zhixiong1，2，JIN Hai1，HUANG Xiaoqing2. Design and implementation of metadata-driven BI-PAAS [J]. Computer Engineering and Applications, 2011, 47(36): 91-95.
[9]	CHEN Xu，CHEN Dehua，LE Jiajin. Government information resource retrieval algorithm based on metadata semantic relevance oriented ranking [J]. Computer Engineering and Applications, 2011, 47(25): 121-125.
[10]	WANG Li，GAO Zhong-li. Research on persistence of RDF data based on faceted navigation [J]. Computer Engineering and Applications, 2010, 46(9): 130-133.
[11]	ZENG Sai-feng¹，ZHOU Jian-wei²，ZHANG Fu¹，LI Qiang¹. Automatic extraction and utility of multimedia object metadata in CAS [J]. Computer Engineering and Applications, 2010, 46(36): 79-81.
[12]	LV Hong-liang^1，2，WANG Jin-lin²，DENG　Feng². Two-way content adaptation strategy supporting partial update [J]. Computer Engineering and Applications, 2010, 46(33): 6-8.
[13]	GAO Ni¹，ZHOU Ming-quan²，GENG Guo-hua¹，HE Yi-yue¹. Design and implementation of resources’ presentation platform based on metadata [J]. Computer Engineering and Applications, 2009, 45(25): 141-144.
[14]	MA Li-li，HUANG Hong-bin，DENG Su. Research on creating semantic overlay networks including association [J]. Computer Engineering and Applications, 2009, 45(21): 153-155.
[15]	WANG Zhe,PAN Mao,GUO Yan-jun. Excel information extraction based on XML metadata and schema [J]. Computer Engineering and Applications, 2008, 44(33): 135-137.

Design and Implementation of MooseFS Hot Standby Master

MooseFS热备元数据节点设计与实现

PDF

Knowledge

Abstract

Cite this article

share this article

References

Related Articles 15

Recommended Articles

Metrics