计算机工程与应用 ›› 2022, Vol. 58 ›› Issue (7): 176-184.DOI: 10.3778/j.issn.1002-8331.2009-0486

• 模式识别与人工智能 • 上一篇    下一篇

教室监控下学生异常行为检测系统

谭暑秋,汤国放,涂媛雅,张建勋,葛盼杰   

  1. 1.重庆理工大学 计算机科学与工程学院,重庆 400054
    2.中国矿业大学 计算机科学与工程学院,江苏 徐州 221116
  • 出版日期:2022-04-01 发布日期:2022-04-01

Classroom Monitoring Students Abnormal Behavior Detection System

TAN Shuqiu, TANG Guofang, TU Yuanya, ZHANG Jianxun, GE Panjie   

  1. 1.College of Computer Science and Engineering, Chongqing University of Technology, Chongqing 400054, China
    2.College of Computer Science and Engineering, China University of Mining and Technology, Xuzhou, Jiangsu 221116, China
  • Online:2022-04-01 Published:2022-04-01

摘要: 针对教室监控中学生异常行为无法实时检测并反馈的现状,设计了一套基于YOLO v3算法的教室监控学生异常行为检测系统,包括摄像头硬件采集、异常行为识别和响应三个模块。其中采用基于数据标签的随机擦除预处理方法模拟图像中的目标被遮挡的情形,提高网络的泛化能力,使得网络仅通过学习局部特征即可完成目标的检测和识别;其次改进了YOLO v3算法的骨干网络Darknet,扩充浅层网络,使网络不容易忽略图片边缘或小目标物体。改进后网络的精准度、召回率以及运算速度分别提升4.2%、4.8%和8?frame/s;最后将检测功能集成于Qt编写的可视化软件,降低使用检测模型的成本,满足实时检测任务的要求,一定程度上减轻教员工作量并且提升课堂效率。

关键词: 深度学习, 异常行为, 教室监控, 随机擦除, YOLO v3算法, GIoU

Abstract: Aiming at the status quo that abnormal behaviors of students in classroom monitoring cannot be detected and feedback in real time, a classroom monitoring student abnormal behavior detection system based on YOLO v3 algorithm is designed, which includes three modules:camera hardware acquisition, abnormal behavior recognition and response. Among them, the random erasure preprocessing method based on data labels is used to simulate the situation where the target in the image is occluded, and the generalization ability of the network is improved, so that the network can complete the detection and recognition of the target only by learning local features. Secondly, it improves YOLO v3 algorithm’s backbone network, Darknet, expands the shallow network so that it is not easy for the network to ignore the edges of pictures or small target objects. The improved algorithm effectively increases the speed and accuracy of student abnormal behavior detection and reduces the missed detection rate, basically meeting the requirements of real-time detection tasks, which reduces the teachers’ workload to a certain extent and improving classroom efficiency.

Key words: deep learning, abnormal behavior, classroom monitoring, random erasers, YOLO v3 algorithm, GIoU