Computer Engineering and Applications ›› 2022, Vol. 58 ›› Issue (17): 277-284.DOI: 10.3778/j.issn.1002-8331.2101-0240

• Engineering and Applications • Previous Articles     Next Articles

Eulerian Video Vibration Detection Against Camera Motion Interference

XIN Yitong, CAO Wenxia, CHEN Jing, YANG Xuezhi, WU Kewei, SHEN Jing   

  1. 1.School of Computer and Information, Hefei University of Technology, Hefei 230009, China
    2.Anhui Province Key Laboratory of Industry Safety and Emergency Technology, Hefei 230009, China
    3.Anhui Water Conservancy Technical College, Hefei 231603, China
    4.School of Software, Hefei University of Technology, Hefei 230009, China
    5.School of Electronic Information and Electrical Engineering, Hefei Normal University, Hefei 230061, China
    6.Anhui Microwave and Communication Engineering Technology Research Center, Hefei 230061, China
  • Online:2022-09-01 Published:2022-09-01

抗相机运动干扰的欧拉视频振动检测

辛宜曈,曹文霞,陈鲸,杨学志,吴克伟,沈晶   

  1. 1.合肥工业大学 计算机与信息学院,合肥 230009
    2.工业安全与应急技术安徽省重点实验室,合肥 230009
    3.安徽水利水电职业技术学院,合肥 231603
    4.合肥工业大学 软件学院,合肥 230009
    5.合肥师范学院 电子信息与电气工程学院,合肥 230061
    6.安徽微波与通信工程技术研究中心,合肥 230061

Abstract: The interference of camera motion is an important cause of error in video vibration detection. To solve this problem, this paper proposes a cross-resistance sample consensus method against jitter and vibration which can effectively separate the vibration signal and camera motion signal in video, thus improving the reliability of video vibration detection. First, candidate feature points are extracted through SURF(speeded-up robust features) algorithm, and the mutual inhibition measure of vibration and camera motion is designed which can separate the candidate feature points to obtain the feature points of camera motion. Second, it registers the video images according to the feature points of camera motion to obtain a video sequence that removes the interference of camera motion. Finally, for the video sequence of the stabilized camera, Eulerian video vibration detection is used to obtain the vibration frequency. Videos under different camera movements are collected, and the parameters of mutual inhibition measures are estimated. The accuracy of the vibration frequency is better than the existing non-contact vibration detection methods through the verification of the test set data.

Key words: vision measurement, frequency detection, cross-resistance sample consensus method against jitter and vibration, image registration

摘要: 相机运动的干扰是造成视频振动检测误差的重要原因。针对该问题,提出一种互抑制一致采样方法,对视频中的振动信号和相机运动信号实现有效分离,从而提高视频振动检测的可靠性。通过SURF(加速稳健特征)算法提取候选的特征点,并设计了振动与相机运动的互抑制测度,对候选的特征点进行分离,以获得相机运动的特征点。根据相机运动特征点对视频图像进行配准,以获得去除相机运动干扰的视频序列。对稳定相机的视频序列,采用欧拉视频振动检测方法获得振动频率。自行采集了不同相机运动下的视频,并针对互抑制测度的参数进行估计。通过对测试集数据进行验证,得到的振动频率准确率优于现有的非接触振动检测方法。

关键词: 视觉测量, 频率检测, 互抑制一致采样算法, 图像配准