Computer Engineering and Applications ›› 2022, Vol. 58 ›› Issue (7): 237-242.DOI: 10.3778/j.issn.1002-8331.2009-0509

• Graphics and Image Processing • Previous Articles     Next Articles

Research and Implementation of Semantic Constraint Verification Algorithm in Object Detection

YANG Jiayun, YAO Yinuo, YU Kun, LIU Xiumei, YU Minghe, ZHAO Zhibin#br#   

  1. 1.School of Computer Science and Engineering, Northeastern University, Shenyang 110000, China
    2.School of Software, Northeastern University, Shenyang 110000, China
  • Online:2022-04-01 Published:2022-04-01



  1. 1.东北大学 计算机科学与工程学院,沈阳 110000
    2.东北大学 软件学院,沈阳 110000

Abstract: The aim of basic object detection consists in identifying objects in an image, as well as classifying and localizing them. However, in many application scenarios, object detection is often semantically constrained. These constraints typically include the quantitative constraint to a single category object and spatial position constraint to multiple objects. For an instance, in a video surveillance system for manufacture safety, the object detection is designed to not only identify and label safety protective equipment, but also verify the appropriate usage of it under specifications. This paper proposes a checking algorithm with semantic constraint for object detection. Firstly, a semantic constraint model is defined, and then objects in an image are detected with semantic information. Finally, the consistency of the preliminary detecting result and the semantic constraint is verified. The validity of thissemantic constraint verification algorithm is evaluated by an application instance on protective equipment detection in electricity construction and on-site safety surveillance video.

Key words: object detection, semantic constraint, template matching

摘要: 基本的目标检测任务是在图像中识别目标,并标注目标的类别和位置信息。但是,很多应用中的目标检测任务常常带有语义约束,典型的包括单类别目标的数量约束和多个目标之间的空间位置约束。如在基于视频的生产安全监控系统中,目标检测不仅要识别和标定安全防护装备,还要检测这些安全防护装备是否被规范穿戴。提出了一种目标检测中语义约束检查算法,定义一种语义约束的模型,然后对图像进行带有语义信息的目标检测,最终对目标检测结果与语义约束进行一致性判定。以电力施工防护装备检查的实际需求和现场安监视频为例,验证了所提出的目标检测中语义约束检查算法的有效性。

关键词: 目标检测, 语义约束, 模板匹配