Design and implementation of I/O trace collection system in distributed environment

doi:10.3778/j.issn.1002-8331.2010.36.024

Computer Engineering and Applications ›› 2010, Vol. 46 ›› Issue (36): 88-90.DOI: 10.3778/j.issn.1002-8331.2010.36.024

• 海量存储技术专题 • Previous Articles Next Articles

Design and implementation of I/O trace collection system in distributed environment

ZHAN Ling¹，MA Jun²，CHEN Bo-jiang²，CHEN Wei-liang³，LV Rui²

1.Department of Computer Science，Hubei University of Education，Wuhan 430074，China
2.Sino-Tech Mass Storage Technology Ltd.（Beijing），Beijing 100083，China
3.Qilu Securities Co.，Ltd.，Zibo，Shandong 255034，China

Received:2010-10-15 Revised:2010-11-16 Online:2010-12-21 Published:2010-12-21
Contact: ZHAN Ling

分布式I/O日志收集系统的设计与实现

詹玲¹，马骏²，陈伯江²，陈维梁³，吕睿²

1.湖北第二师范学院计算机学院，武汉 430205
2.中科海量存储技术（北京）有限公司，北京 100083
3.齐鲁证券有限公司，山东淄博 255034

通讯作者: 詹玲

Abstract

Abstract: With the rapid development of information technology application，I/O system is becoming more and more complicated，especially in the distributed computing environment.In order to explore the I/O behavior in the distributed computing environment，this paper designs and implements a novel tracing tool called distributed I/O trace system，which can simultaneously control each node’s I/O trace collecting behavior in a parallel distributed system.Distributed I/O trace system can also receive the I/O traces collected from each node，then save and manage the I/O traces.This paper describes the design considerations and the implementation details.

Key words: trace collection, distributed, storage system

摘要： 随着存储系统的快速发展，以及实际应用中对存储系统的要求日益苛刻，为了研究存储系统I/O子系统的运行形态，设计并实现了一种分布式I/O日志收集系统，该系统能够通过总控制台同时控制分布式系统的多个节点并行收集分布式系统的I/O日志，为分析和回放分布式系统的I/O日志提供有效的数据，且详细描述了系统的设计与实现。

关键词: 日志收集, 分布式, 存储系统

CLC Number:

TP303

ZHAN Ling¹，MA Jun²，CHEN Bo-jiang²，CHEN Wei-liang³，LV Rui². Design and implementation of I/O trace collection system in distributed environment[J]. Computer Engineering and Applications, 2010, 46(36): 88-90.

詹玲¹，马骏²，陈伯江²，陈维梁³，吕睿². 分布式I/O日志收集系统的设计与实现[J]. 计算机工程与应用, 2010, 46(36): 88-90.

[1]	JIANG Kui, QIU Yuandong, ZHENG Haocheng. ICMPv6 DDoS Attack Detection Method Based on Information Entropy and LSTM [J]. Computer Engineering and Applications, 2021, 57(21): 148-154.
[2]	WANG Hairui, XIANYU Jianchuan. Application of Distributed Generation Configuration Based on Improved Sparrow Search Algorithm [J]. Computer Engineering and Applications, 2021, 57(20): 245-252.
[3]	TIAN Yang, CHEN Zhigang, SONG Xinxia, LI Tianming. Overview of Blockchain Application in Supply Chain Management [J]. Computer Engineering and Applications, 2021, 57(19): 70-83.
[4]	ZHANG Jun, LIAO Xuehua, YU Xuling, LEI Meng. Research on Realizing Relational Database In-Memory Storage Model [J]. Computer Engineering and Applications, 2021, 57(19): 123-128.
[5]	WANG Xiaojun, WANG Bo, YANG Chunxia, JIN Minjie, CHEN Haibo. AGV Path Planning and Collision Avoidance Strategy for Compact and Dense Auto Store System [J]. Computer Engineering and Applications, 2021, 57(15): 259-270.
[6]	XIANG Yixuan, JIANG He, PAN Pinchen, SUN Conghui. Study on [K]-means Clustering Algorithm of Quadratic Power Coupling [J]. Computer Engineering and Applications, 2021, 57(14): 95-102.
[7]	WANG Wentao, LI Shumei, TANG Jie, LYU Weilong. DDoS Attack Detection Method Based on Probability Graph Model and DNN [J]. Computer Engineering and Applications, 2021, 57(13): 108-115.
[8]	ZHOU Bifeng, LUO Yiping. Aperiodically Intermittent Neutralization Control of Distributed Parameter Systems with Delay [J]. Computer Engineering and Applications, 2020, 56(8): 220-225.
[9]	WEI Zhanchen, LIU Xiaoyu, HUANG Qiulan, SUN Gongxing. Research on Optimization for Iteration-Intensive Applications on Spark [J]. Computer Engineering and Applications, 2020, 56(23): 68-73.
[10]	LIU Zujun, HE Ming, MA Ziyu, GU Lingfeng. UAV Formation Control Method Based on Distributed Consistency [J]. Computer Engineering and Applications, 2020, 56(23): 146-152.
[11]	HE Feng, ZENG Wen, WANG Bingjun. Design and Implementation of Parallel Real-Time Storage System for TT&C Data [J]. Computer Engineering and Applications, 2020, 56(23): 253-258.
[12]	HU Xuelin, Hasan·Wumaier. Review on Recommender Algorithms Based on Distributed Representation Technology [J]. Computer Engineering and Applications, 2020, 56(22): 13-24.
[13]	CHENG Zhenjing, CHENG Yaodong, CHEN Gang, WANG Lu, LI Haibo, HU Qingbao. High Energy Physics Data Placement Strategy Based on Random Forest [J]. Computer Engineering and Applications, 2020, 56(21): 60-64.
[14]	ZHOU Guoliang, LI Gang. Research on Distributed Scheduling Strategy of Virtual Power Plant Considering Blockchain [J]. Computer Engineering and Applications, 2020, 56(15): 268-273.
[15]	HU Yang, HU Xuegang, LI Peipei. Fast Short Text Data Stream Classification Method Based on Spark [J]. Computer Engineering and Applications, 2020, 56(14): 138-147.

Design and implementation of I/O trace collection system in distributed environment

分布式I/O日志收集系统的设计与实现

PDF

Knowledge

Abstract

Cite this article

share this article

References

Related Articles 15

Recommended Articles

Metrics