Computer Engineering and Applications ›› 2021, Vol. 57 ›› Issue (7): 88-94.DOI: 10.3778/j.issn.1002-8331.2003-0386

Previous Articles     Next Articles

Adaptive Early Warning Method for Streaming Big Data Events Based on Two-Stage Regression

ZHAO Linsuo, MA Ruiqiang, JIANG Tian, SONG Baoyan , PAN Yishan   

  1. 1.College of Mechanics and Engineering, College of Mechanics and Engineering, Fuxin, Liaoning 123000, China
    2.School of Information, Liaoning University, Shenyang 110036, China
  • Online:2021-04-01 Published:2021-04-02



  1. 1.辽宁工程技术大学 力学与工程学院,辽宁 阜新 123000
    2.辽宁大学 信息学院,沈阳 110036


Affected by factors such as external environment of collector deployment and human interference, streaming data has drift characteristics. Simultaneously, the occurrence of streaming data events has no fixed rule and random characteristics, which leads to the low accuracy of existing methods for identifying data stream events, and the result of identifying cannot be obtained before the event is completely completed, the identification is lag behind. In order to solve these problems, this paper proposes an adaptive two-stage regression method for real-time event identification of large data streams. Firstly, based on massive historical disaster events, this method introduces the first-order moving regression method to establish weight support region and extract event data feature points. Secondly, the second-order linear regression method is used to set up event model, the least square error analysis is performed on the model, and then constructs the event identification domain. Finally, this paper proposes a step-by-step real-time identification method for streaming data events, introduces confidence factor concept based on event identification domain, estimates the future development trend of events through self-adaptive transformation strategy of confidence factor and realizes real-time event identification. Experiments show that the proposed method has great advantages in the efficiency and accuracy of event identification.

Key words: moving regression method, linear regression method, confidence factor, adaptive transformation, real-time early warning



关键词: 移动回归法, 线性回归法, 判识因子, 自适应变换, 实时预警