Design and implementation of continuous query language based on Aurora system

Abstract

Abstract: The research on data stream management systems has gained much attention recently because of the emergence of many real-time data processing applications. Aurora is a general-purpose fully functional data stream management system, which only supports queries in the form of operator network. To this end, this paper designs and implements a continuous query language called Conger CQL based on Aurora. In order to verify the expression ability of Conger CQL, it implements the Linear Road Benchmark using Conger CQL, which shows that Conger CQL is able to express complex continuous queries defined by the Linear Road Benchmark.

Key words: data stream, data stream management system, continuous query language

摘要： 随着新型数据应用的不断出现，针对流形态数据的数据流管理系统已经成为数据管理领域研究的新热点。针对目前通用数据流管理系统只支持基于操作符流图的查询表达方式这一不足，设计了一种新的持续型数据流查询语言，并在通用数据流处理系统Aurora上进行了实现。为验证新语言的表达能力，该系统使用新语言定义了数据流基准测试Linear Road Benchmark的查询集，在Aurora系统上部署运行。测试结果表明针对Linear Road Benchmark的测试用例，新语言具有较完备的语义和良好的表达能力。

关键词: 数据流, 数据流管理系统, 持续型查询语言

WANG Hongya, CAO Jiao, JIN Jie. Design and implementation of continuous query language based on Aurora system[J]. Computer Engineering and Applications, 2014, 50(21): 133-138.

王洪亚，曹姣，金杰. 基于Aurora系统的持续型查询语言设计与实现[J]. 计算机工程与应用, 2014, 50(21): 133-138.

[1]	WANG Junhong, GUO Yahui. Imbalanced Data Stream Classification Algorithm for Dynamic Data Chunk [J]. Computer Engineering and Applications, 2021, 57(13): 124-129.
[2]	ZHOU Yu, ZHU Wenhao, FANG Qian, BAI Lei. Survey of Outlier Detection Methods Based on Clustering [J]. Computer Engineering and Applications, 2021, 57(12): 37-45.
[3]	XU Qingyan, HE Li, ZHU Hongxi. Improved Detection Method of Concept Drift Based on the Hoeffding Inequality [J]. Computer Engineering and Applications, 2020, 56(19): 55-61.
[4]	HU Yang, HU Xuegang, LI Peipei. Fast Short Text Data Stream Classification Method Based on Spark [J]. Computer Engineering and Applications, 2020, 56(14): 138-147.
[5]	SONG Yao1，2，3, SUN Xiaojuan1，2，3, HU Yuxin1，2，3, LEI Bin1，2，3, LU Xiaojun4. Quick-View Processing Method for Remote Sensing Data Based on Stream Computing [J]. Computer Engineering and Applications, 2019, 55(10): 77-82.
[6]	WEI Zijin1，2，3, XIAO Li2，3. Parallel out-of-core model simplification algorithm based on improved vertex clustering [J]. Computer Engineering and Applications, 2018, 54(13): 181-190.
[7]	LIU Xiao, LIU Huiping, JIN Cheqing. Approximate solution for ER-Topk query upon uncertain data stream [J]. Computer Engineering and Applications, 2017, 53(4): 98-105.
[8]	HAN Chong1, YUAN Yingshan2, MEI Tao2, GENG Huiling2. Data stream outlier detection algorithm based on K-means [J]. Computer Engineering and Applications, 2017, 53(3): 58-63.
[9]	SHI Yingzhong 1, 2, CAO Jianfeng2, DENG Zhaohong1, JIANG Yizhang1. Flexible drift support vector machines for data stream classification [J]. Computer Engineering and Applications, 2017, 53(23): 118-122.
[10]	LI Shaobo1，2, MENG Wei1, QU Jinglei1. GSWCLOF：density-based outlier detection algorithm on data stream [J]. Computer Engineering and Applications, 2016, 52(19): 7-11.
[11]	LIU Huiting, HOU Mingli, ZHAO Peng, YAO Sheng. Mining maximum frequent itemsets over uncertain data streams [J]. Computer Engineering and Applications, 2016, 52(19): 72-77.
[12]	YIN Shaohong, ZHANG Panpan. Ensemble classification algorithm for data stream based on repeatability of concept [J]. Computer Engineering and Applications, 2016, 52(12): 80-84.
[13]	XIONG Zhongyang, ZHOU Xingqin, ZHANG Yufang. Data stream classifier with limited labelled data [J]. Computer Engineering and Applications, 2015, 51(6): 124-128.
[14]	YIN Shaohong, SHAN Kunyu, FAN Guidan. Mining algorithm research of data stream maximum frequent itemsets in sliding window [J]. Computer Engineering and Applications, 2015, 51(22): 145-149.
[15]	ZHU Lin, ZHU Canshi. Data stream sliding window clustering algorithm applied in IDS [J]. Computer Engineering and Applications, 2014, 50(1): 87-90.

Design and implementation of continuous query language based on Aurora system

基于Aurora系统的持续型查询语言设计与实现

PDF

Knowledge

Abstract

Cite this article

share this article

References

Related Articles 15

Recommended Articles

Metrics