无人机平台的人体呼吸率检测

doi:10.3778/j.issn.1002-8331.2211-0159

摘要/Abstract

摘要： 使用无人机载相机进行呼吸率检测是一种新兴的伤情评估手段，然而现有的视频呼吸率检测算法只适用于固定相机。在基于空间相位的呼吸信号提取技术基础上，提出一种基于无人机载视频的人体呼吸率非接触式测量方法，使用复可控金字塔提取出每一帧图像的空间相位，按时间顺序排列得到相位序列；接着采用经验模态分解从相位序列中拆解出多个模态分量，并设计频率变异性分析模型从中选择出具有稳定频率的分量，也即目标呼吸信号；利用峰值检测方法检测出人体呼吸率。实验结果表明，该方法在无人机晃动干扰下的呼吸率检测平均准确率能够达到98%以上，优于现有检测方法。

关键词: 无人机, 呼吸率, 经验模态分解, 频率变异性, 空间相位

Abstract: It is a means of injury assessment to detect respiratory rate using an unmanned aerial camera. However, the existing video-based respiratory rate detection algorithms are only applicable to fixed cameras. On the basis of spatial phase based respiratory signal extraction technology, a non-contact measurement method of human respiratory rate with videos recorded by unmanned aerial vehicle (UAV) is proposed. The complex steerable pyramid is used to extract the spatial phase of each frame image, and the phase sequence is obtained in chronological order. Secondly, the empirical mode decomposition (EMD) is used to decompose multiple modal components from the phase sequence, and the frequency variability analysis model is designed to select the components with stable frequencies, or the target respiratory signal. The peak value detection method is used to detect the human respiratory rate. The experimental results show that the average accuracy of the method can reach more than 98%, which is superior to the existing detection methods.

Key words: unmanned aerial vehicle, respiratory rate, empirical mode decomposition, frequency variability, spatial phase

梁帅, 杨学志, 臧宗迪. 无人机平台的人体呼吸率检测[J]. 计算机工程与应用, 2024, 60(6): 323-329.

LIANG Shuai, YANG Xuezhi, ZANG Zongdi. Human Respiratory Rate Detection on UAV Platform[J]. Computer Engineering and Applications, 2024, 60(6): 323-329.

参考文献

[1] SMITH I, MACKAY J, FAHRID N, et al. Respiratory rate measurement: a comparison of methods[J]. British Journal of Healthcare Assistants, 2011, 5(1): 18-23.
[2] KARMAKAR C, KHANDOKER A, PENZEL T, et al. Detection of respiratory arousals using photoplethysmography (PPG) signal in sleep apnea patients[J]. IEEE Journal of Biomedical and Health Informatics, 2013, 18(3): 1065-1073.
[3] MASSARONI C, NICOLO A, LO PRESTI D, et al. Contact-based methods for measuring respiratory rate[J]. Sensors, 2019, 19(4): 908.
[4] KLAP T, SHINAR Z. Using piezoelectric sensor for continuous-contact-free monitoring of heart and respiration rates in real-life hospital settings[C]//Computing in Cardiology, 2013: 671-674.
[5] KWASNIEWSKA A, SZANKIN M, RUMINSKI J, et al. Improving accuracy of respiratory rate estimation by restoring high resolution features with transformers and recursive convolutional models[C]//Proceedings of the IEEE/CVF Conference on Computer Vision and Pattern Recognition, 2021: 3857-3867.
[6] MILLER D J, CAPODILUPO J V, LASTELLA M, et al. Analyzing changes in respiratory rate to predict the risk of COVID-19 infection[J]. PloS One, 2020, 15(12): e0243693.
[7] SIAM A I, EL-BAHNASAWY N A, EL BANBY G M, et al. Efficient video-based breathing pattern and respiration rate monitoring for remote health monitoring[J]. Journal of the Optical Society of America A, 2020, 37(11): C118-C124.
[8] 霍亮, 杨学志, 李江山, 等. 适用于昼夜环境的呼吸率视频检测[J]. 中国图象图形学报, 2018, 23(1): 144-154.
HUO L, YANG X Z, LI J S, et al. Respiratory rate estimation under day and night conditions[J]. Journal of Image and Graphics, 2018, 23(1): 144-154.
[9] 任国军, 杨学志, 臧宗迪, 等. 多种姿态下的人体呼吸率视觉检测[J]. 计算机系统应用, 2022, 31(8): 252-258.
REN G J, YANG X Z, ZANG Z D, et al. Visual detection of human respiratory rate in multiple poses[J]. Computer Systems & Applications, 2022, 31(8): 252-258.
[10] RIVERA A J A, VILLALOBOS A D C, MONJE J C N. Post-disaster rescue facility: human detection and geolocation using aerial drones[C]//2016 IEEE Region 10 Conference (TENCON), 2016: 384-386.
[11] AL-NAJI A, PERERA A G, CHAHL J. Remote measurement of cardiopulmonary signal using an unmanned aerial vehicle[C]//IOP Conference Series: Materials Science and Engineering.[S.l.]: IOP Publishing, 2018
[12] AL-NAJI A, PERERA A G, MOHAMMED S L, et al. Life signs detector using a drone in disaster zones[J]. Remote Sensing, 2019, 11(20): 2441.
[13] SANYAL S, NUNDY K K. Algorithms for monitoring heart rate and respiratory rate from the video of a user’s face[J]. IEEE Journal of Translational Engineering in Health and Medicine, 2018, 6: 1-11.
[14] CHAN A M, SELVARAJ N, FERDOSI N, et al. Wireless patch sensor for remote monitoring of heart rate, respiration, activity, and falls[C]//Annual International Conference of the IEEE Engineering in Medicine and Biology Society (EMBC), 2013: 6115-6118.
[15] WADHWA N, RUBINSTEIN M, DURAND F, et al. Phase-based video motion processing[J]. ACM Transactions on Graphics (TOG), 2013, 32(4): 1-10.
[16] RIAZ F, HASSAN A, REHMAN S, et al. EMD-based temporal and spectral features for the classification of EEG signals using supervised learning[J]. IEEE Transactions on Neural Systems and Rehabilitation Engineering, 2015, 24(1): 28-35.
[17] XUAN B, XIE Q, PENG S. EMD sifting based on bandwidth[J]. IEEE Signal Processing Letters, 2007, 14(8): 537-540.
[18] KARLEN W, RAMAN S, ANSERMINO J M, et al. Multiparameter respiratory rate estimation from the photoplethysmogram[J]. IEEE Transactions on Biomedical Engineering, 2013, 60(7): 1946-1953.
[19] HONG H P, CUI X Z. Time-frequency spectral representation models to simulate nonstationary processes and their use to generate ground motions[J]. Journal of Engineering Mechanics, 2020, 146(9): 04020106.
[20] GANFURE G O. Using video stream for continuous monitoring of breathing rate for general setting[J]. Signal, Image and Video Processing, 2019, 13(7): 1395-1403.
[21] 刘今越, 刘浩, 贾晓辉, 等. 基于视觉的非接触呼吸频率自动检测方法[J]. 仪器仪表学报, 2019, 40(2): 51-58.
LIU J Y, LIU H, JIA X H, et al. Vision-based automatic detection method for non-contact respiratory rate[J]. Chinese Journal of Scientific Instrument, 2019, 40(2): 51-58.