Computer Engineering and Applications ›› 2020, Vol. 56 ›› Issue (5): 135-140.DOI: 10.3778/j.issn.1002-8331.1811-0261

Previous Articles     Next Articles

Internet of Things Data Injection System Based on Netty and Kafka

ZHEN Kaicheng, HUANG He, SONG Liangtu   

  1. 1.Institute of Intelligent Machine, Chinese Academy of Sciences, Hefei 230031, China
    2.University of Science and Technology of China, Hefei 230026, China
  • Online:2020-03-01 Published:2020-03-06



  1. 1.中国科学院 合肥智能机械研究所,合肥 230031
    2.中国科学技术大学,合肥 230026


At present, in the application of the Internet of Things, a large number of acquisition terminals are used for sensing environment, positioning services, condition monitoring and so on. This terminals continuously upload data, which brings great challenges to remote server data collection and real-time processing while improving the efficiency of production. It utilizes the Netty network communication library to construct a high-performance network communication processing service and designs a communication protocol for the terminal and the server. Then, time-consuming operation in network communication service is stripped out and data are pushed into streaming message processing system Kafka. Kafka consumers are responsible for subsequent data persistence and real-time analysis. A data injection system supporting high concurrency and low latency is implemented. The experimental results show that the system can work normally and maintain a fast response speed under the condition of 10,000-level connections.

Key words: Internet of Things data, network communications, Netty, Kafka



关键词: 物联网数据, 网络通信, Netty, Kafka