抗相机运动干扰的欧拉视频振动检测

doi:10.3778/j.issn.1002-8331.2101-0240

计算机工程与应用 ›› 2022, Vol. 58 ›› Issue (17): 277-284.DOI: 10.3778/j.issn.1002-8331.2101-0240

抗相机运动干扰的欧拉视频振动检测

辛宜曈，曹文霞，陈鲸，杨学志，吴克伟，沈晶

1.合肥工业大学计算机与信息学院，合肥 230009
2.工业安全与应急技术安徽省重点实验室，合肥 230009
3.安徽水利水电职业技术学院，合肥 231603
4.合肥工业大学软件学院，合肥 230009
5.合肥师范学院电子信息与电气工程学院，合肥 230061
6.安徽微波与通信工程技术研究中心，合肥 230061

出版日期:2022-09-01 发布日期:2022-09-01

Eulerian Video Vibration Detection Against Camera Motion Interference

XIN Yitong, CAO Wenxia, CHEN Jing, YANG Xuezhi, WU Kewei, SHEN Jing

1.School of Computer and Information, Hefei University of Technology, Hefei 230009, China
2.Anhui Province Key Laboratory of Industry Safety and Emergency Technology, Hefei 230009, China
3.Anhui Water Conservancy Technical College, Hefei 231603, China
4.School of Software, Hefei University of Technology, Hefei 230009, China
5.School of Electronic Information and Electrical Engineering, Hefei Normal University, Hefei 230061, China
6.Anhui Microwave and Communication Engineering Technology Research Center, Hefei 230061, China

Online:2022-09-01 Published:2022-09-01

摘要/Abstract

摘要： 相机运动的干扰是造成视频振动检测误差的重要原因。针对该问题，提出一种互抑制一致采样方法，对视频中的振动信号和相机运动信号实现有效分离，从而提高视频振动检测的可靠性。通过SURF（加速稳健特征）算法提取候选的特征点，并设计了振动与相机运动的互抑制测度，对候选的特征点进行分离，以获得相机运动的特征点。根据相机运动特征点对视频图像进行配准，以获得去除相机运动干扰的视频序列。对稳定相机的视频序列，采用欧拉视频振动检测方法获得振动频率。自行采集了不同相机运动下的视频，并针对互抑制测度的参数进行估计。通过对测试集数据进行验证，得到的振动频率准确率优于现有的非接触振动检测方法。

关键词: 视觉测量, 频率检测, 互抑制一致采样算法, 图像配准

Abstract: The interference of camera motion is an important cause of error in video vibration detection. To solve this problem, this paper proposes a cross-resistance sample consensus method against jitter and vibration which can effectively separate the vibration signal and camera motion signal in video, thus improving the reliability of video vibration detection. First, candidate feature points are extracted through SURF（speeded-up robust features） algorithm, and the mutual inhibition measure of vibration and camera motion is designed which can separate the candidate feature points to obtain the feature points of camera motion. Second, it registers the video images according to the feature points of camera motion to obtain a video sequence that removes the interference of camera motion. Finally, for the video sequence of the stabilized camera, Eulerian video vibration detection is used to obtain the vibration frequency. Videos under different camera movements are collected, and the parameters of mutual inhibition measures are estimated. The accuracy of the vibration frequency is better than the existing non-contact vibration detection methods through the verification of the test set data.

Key words: vision measurement, frequency detection, cross-resistance sample consensus method against jitter and vibration, image registration

辛宜曈, 曹文霞, 陈鲸, 杨学志, 吴克伟, 沈晶. 抗相机运动干扰的欧拉视频振动检测[J]. 计算机工程与应用, 2022, 58(17): 277-284.

XIN Yitong, CAO Wenxia, CHEN Jing, YANG Xuezhi, WU Kewei, SHEN Jing. Eulerian Video Vibration Detection Against Camera Motion Interference[J]. Computer Engineering and Applications, 2022, 58(17): 277-284.

参考文献

[1] DIAMOND D H，HEYNS P S，OBERHOLSTER A J.Accuracy evaluation of sub-pixel structural vibration measurements through optical flow analysis of a video sequence[J].Measurement，2017，95：166-172.
[2] WADHWA N，WU H Y，DAVIS A，et al.Eulerian video magnification and analysis[J].Communications of the ACM，2017，60（1）：87-95.
[3] HATI A，NELSON C W.W-band vibrometer for noncontact thermoacoustic imaging[J].IEEE Transactions on Ultrasonics Ferroelectrics and Frequency Control，2019，66（9）：1536-1539.
[4] FENG D，SCARANGELLO T，FENG M Q，et al.Cable tension force estimate using novel noncontact vision-based sensor[J].Measurement，2017，99：44-52.
[5] DHIRAJ S，OMKAR X.Object drop detection on railway track through rayleigh wave sensing using laser vibro meter[J].IEEE Transactions on Vehicular Technology，2018，67（10）：9158-9172.
[6] 魏闪闪，谢巍，贺志强.新兴数字视频稳像中相机运动估计技术综述[J].计算机应用研究，2017（2）：321-327.
WEI S S，XIE W，HE Z Q.Camera motion estimation in emerging digital video stabilization：a survey[J].Application Research of Computers，2017（2）：321-327.
[7] CHEN J G，WADHWA N，CHA Y J，et al.Modal identification of simple structures with high-speed video using motion magnification[J].Journal of Sound and Vibration，2015，345：58-71.
[8] WADHWA N，CHEN J G，SELLON J B，et al.Motion microscopy for visualizing and quantifying small motions[J].Proceedings of the National Academy of Sciences of the United States of America，2017，114（44）：11639-11644.
[9] SARRAFI A，MAO Z，NIEZRECKI C，et al.Vibration-based damage detection in wind turbine blades using phase-based motion estimation and motion magnification[J].Journal of Sound & Vibration，2018，421：300-318.
[10] CHOI A J，HAN J H.Frequency-based damage detection in cantilever beam using vision-based monitoring system with motion magnification technique[J].Journal of Intelligent Material Systems and Structures，2018，29（20）：3923-3936.
[11] YANG Y，SANCHEZ L，ZHANG H，et al.Estimation of full-field，full-order experimental modal model of cable vibration from digital video measurement with physics-guided unsupervised machine learning and computer vision[J].Structural Control and Health Monitoring，2019，26（6）：1-14.
[12] PENG C，ZENG C，WANG Y.Camera-based micro-vibration measurement for lightweight structure using an improved phase-based motion extraction[J].IEEE Sensors Journal，2019（20）：2590-2599.
[13] AOYAMA T，LI L，JIANG M，et al.Vibration sensing of a bridge model using a multithread active vision system[J].IEEE/ASME Transactions on Mechatronics，2018，23（1）：179-189.
[14] MOYA-ALBOR E，BRIEVA J，PONCE H，et al.A non-contact heart rate estimation method using video magnification and neural networks[J].IEEE Instrumentation and Measurement Magazine，2020，23（4）：56-62.
[15] ZHANG D，TIAN B，WEI Y，et al.Structural dynamic response analysis using deviations from idealized edge profiles in high-speed video[J].Optical Engineering，2019，58（1）：1-9.
[16] LIU J，BU F L.Improved RANSAC features image-matching method based on SURF[J].The Journal of Engineering，2019（5）：9118-9122.
[17] 魏利胜，甘泉.基于小波变换的新型SURF图像拼接方法[J].电子测量与仪器学报，2017，31（5）：766-772.
WEI L S，GAN Q.Novel SURF image mosaic method based on wavelet transform[J].Journal of Electronic Measurement and Instrument，2017，31（5）：766-772.
[18] KIM S，LEE J.Positioning accuracy improvement of curved section in 3D map using MLESAC algorithm[J].Journal of Institute of Control，Robotics and Systems，2017，23（7）：583-589.
[19] 任克强，胡梦云.基于改进SURF算子的彩色图像配准算法[J].电子测量与仪器学报，2016，30（5）：748-756.
REN K Q，HU M Y.Color image registration algorithm based on improved SURF[J].Journal of Electronic Measurement and Instrument，2016，30（5）：748-756.

抗相机运动干扰的欧拉视频振动检测

Eulerian Video Vibration Detection Against Camera Motion Interference

PDF

可视化

摘要/Abstract

引用本文

使用本文

参考文献

相关文章 15

编辑推荐

Metrics

[1]	董鹏，周烽，赵悰悰，王亚飞，米泽田，付先平. 基于双目视觉的水下海参尺寸自动测量方法[J]. 计算机工程与应用, 2021, 57(8): 271-278.
[2]	夏丹，周睿. 视差图像配准技术研究综述[J]. 计算机工程与应用, 2021, 57(2): 18-27.
[3]	郭艳芬，崔喆，杨智鹏，彭静，胡金蓉. 基于深度学习的医学图像配准技术研究进展[J]. 计算机工程与应用, 2021, 57(15): 1-8.
[4]	刘天，曾亮. 纹理抑制的光照不均图像配准算法研究[J]. 计算机工程与应用, 2020, 56(23): 180-188.
[5]	闵超波. 基于自适应混合多项式变换的图像配准[J]. 计算机工程与应用, 2020, 56(23): 194-201.
[6]	于润泽，习俊通. 白车身复杂装配特征点云提取及参数计算[J]. 计算机工程与应用, 2020, 56(19): 244-251.
[7]	曾安，王烈基，潘丹，黄殷. 基于FCN和互信息的医学图像配准技术研究[J]. 计算机工程与应用, 2020, 56(18): 202-208.
[8]	程德强，白春梦，郭昕，李腾腾，庄焕东，徐辉. 基于分层区域的自适应图像配准算法[J]. 计算机工程与应用, 2019, 55(17): 199-206.
[9]	贾雯晓1，张贵仓1，汪亮亮1，秦娜2. 基于SIFT和改进的RANSAC图像配准算法[J]. 计算机工程与应用, 2018, 54(2): 203-207.
[10]	刘俊利，王立锋，孔秀平. 煤岩界面识别和定位测量方法研究[J]. 计算机工程与应用, 2017, 53(8): 246-249.
[11]	曹国刚，张晴，张培君，王志敏. 基于多核并行化差异进化算法的图像配准方法[J]. 计算机工程与应用, 2017, 53(20): 166-172.
[12]	雒培磊1，李国庆2，曾怡1. 一种改进的基于深度学习的遥感影像拼接方法[J]. 计算机工程与应用, 2017, 53(20): 180-186.
[13]	张卫国，李景妹. 改进的基于纹理特征的图像配准算法[J]. 计算机工程与应用, 2016, 52(6): 214-218.
[14]	卫建龙1，田铮1，2，延伟东1，范明1. 图像多尺度配准的小波域SURF算法[J]. 计算机工程与应用, 2014, 50(21): 200-204.
[15]	邓朝省，陈莹. 基于局部SIFT特征点的双阈值配准算法[J]. 计算机工程与应用, 2014, 50(2): 189-193.