面向计算机视觉的吸烟检测方法研究综述

doi:10.3778/j.issn.1002-8331.2305-0154

摘要/Abstract

摘要： 公共场所吸烟严重危害人们身体健康甚至生命财产安全，因此实时高效的吸烟检测具有重要意义。目前基于计算机视觉的吸烟检测以高效率、高精度等优势逐渐成为主流方法。在对非计算机视觉的吸烟检测方法进行简要概述的基础上，重点归纳总结了三类基于计算机视觉的检测方法。探讨了颜色、外观、运动等多种烟雾特征的提取方法；介绍了基于单步骤和多步骤目标检测两种方法提取烟支目标；从人工特征构建、深度学习特征提取角度论述不同类型的吸烟动作特征提取方法。对上述方法进行分析总结并展望未来研究方向。

关键词: 计算机视觉, 吸烟检测, 目标检测, 行为识别

Abstract: Smoking in public places seriously harms people’s health and even life and property safety, so real-time and efficient smoking detection is of great significance. At present, smoking detection based on computer vision has gradually become the mainstream method with the advantages of high efficiency and high precision. On the basis of a brief overview of non-computer vision smoking detection methods, three kinds of detection methods based on computer vision are summarized. Firstly, the extraction methods of smoke features such as color, appearance and movement are discussed. Secondly, two methods of extracting cigarette target based on single step and multi-step target detection are introduced. Finally, different types of smoking action feature extraction methods are discussed from the perspectives of artificial feature construction and deep learning feature extraction. The above methods are analyzed and summarized, and the future research direction is prospected.

Key words: computer vision, smoking detection, object detection, behavior recognition

何嘉彬, 李雷孝, 林浩, 徐国新. 面向计算机视觉的吸烟检测方法研究综述[J]. 计算机工程与应用, 2024, 60(1): 40-56.

HE Jiabin, LI Leixiao, LIN Hao, XU Guoxin. Review of Smoking Detection Methods for Computer Vision[J]. Computer Engineering and Applications, 2024, 60(1): 40-56.

参考文献

[1] JHA P. The hazards of smoking and the benefits of cessation: a critical summation of the epidemiological evidence in high-income countries[J]. Elife, 2020, 9: e49979.
[2] WANG Z, JIANG K, HOU Y, et al. A survey on human behavior recognition using channel state information[J]. IEEE Access, 2019, 7: 155986-156024.
[3] YANG X, TIAN Y L. Super normal vector for activity recognition using depth sequences[C]//Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition. Piscataway, NJ: IEEE Press, 2014: 804-811.
[4] MM S V, SIVARAMAKRISHNA M, CHITRAKKUMAR S. Design of an innovative smoke sensor and fire alarm panel[C]//2022 Third International Conference on Intelligent Computing Instrumentation and Control Technologies (ICICICT), Chengdu, 2022: 1365-1369.
[5] IMTIAZ M H, RAMOS-GARCIA R I, WATTAL S, et al. Wearable sensors for monitoring of cigarette smoking in free-living: a systematic review[J]. Sensors, 2019, 19(21): 4678.
[6] ZHENG X, WANG J, SHANGGUAN L, et al. Smokey: ubiquitous smoking detection with commercial WiFi infrastructures[C]//IEEE INFOCOM 2016-The 35th Annual IEEE International Conference on Computer Communications. San Francisco: IEEE, 2016: 1-9.
[7] HAMEED H, AZAM N, USMAN M, et al. RF sensing for smoking detection at oil fields[C]//2022 IEEE International Symposium on Antennas and Propagation and USNC-URSI Radio Science Meeting (AP-S/URSI). Singapore: IEEE, 2022: 944-945.
[8] XIE Y, LI F, WU Y, et al. HearSmoking: smoking detection in driving environment via acoustic sensing on smartphones[J]. IEEE Transactions on Mobile Computing, 2021, 21(8): 2847-2860.
[9] ZHANG Q, LIU Y, YIN W, et al. The in situ detection of smoking in public area by laser-induced breakdown spectroscopy[J]. Chemosphere, 2020, 242: 125184.
[10] ROSSEL P O, PAREDES L, BASCUR A, et al. SAS4P: providing automatic smoking detection for a persuasive smoking cessation application[J]. International Journal of Distributed Sensor Networks, 2019, 15(11): 15501.
[11] SENYUREK V, IMTIAZ M, BELSARE P, et al. Cigarette smoking detection with an inertial sensor and a smart lighter[J]. Sensors, 2019, 19(3): 570.
[12] KIRMIZIS A, KYRITSIS K, DELOPOULOS A. A bottom-up method towards the automatic and objective monitoring of smoking behavior in-the-wild using wrist-mounted inertial sensors[C]//2021 43rd Annual International Conference of the IEEE Engineering in Medicine & Biology Society (EMBC) . NY: IEEE, 2021: 6867-6870.
[13] IMTIAZ M H, SENYUREK V Y, BELSARE P, et al. Objective detection of cigarette smoking from physiological sensor signals[C]//2019 41st Annual International Conference of the IEEE Engineering in Medicine and Biology Society (EMBC) . Germany: IEEE, 2019: 3563-3566.
[14] RAMOS-GARCIA R I, SAZONOV E, TIFFANY S. Recognizing cigarette smoke inhalations using hidden Markov models[C]//2017 39th Annual International Conference of the IEEE Engineering in Medicine and Biology Society (EMBC), 2017: 1242-1245.
[15] 潘广贞, 元琴, 樊彩霞, 等. 基于混合高斯模型和帧差法的吸烟检测算法[J]. 计算机工程与设计, 2015, 36(5): 1290-1294.
PAN G Z, YUAN Q, FAN C X, et al. Cigarette-smoke detection based on Gaussian mixture model and frame difference[J]. Computer Engineering and Design, 2015, 36(5): 1290-1294.
[16] 唐杰, 周洋, 杨萌, 等. 采用颜色混合模型和特征组合的视频烟雾检测[J]. 光电子激光, 2017, 28(7): 751-758.
TANG J, ZHOU Y, YANG M, et al. A smoke detection algorithm using color mixture model and feature combination[J]. Journal of Optoelectronics·Laser, 2017, 28(7): 751-758.
[17] 胡春海, 王晓婧, 刘斌, 等. 一种基于MI-Simba算法的香烟烟雾识别方法[J]. 模式识别与人工智能, 2015, 28(3): 253-259.
HU C H, WANG X J, LIU B, et al. A recognition approach for cigarette smoke based on MI-Simba[J]. Pattern Recognition and Artificial Intelligence, 2015, 28(3): 253-259.
[18] LIN Z, LV C, DOU Y, et al. Smoking behavior detection based on hand trajectory tracking and mouth saturation changes[C]//2018 International Conference on Security, Pattern Analysis, and Cybernetics (SPAC), Jinan, 2018.
[19] 汪祖云, 廖惠敏, 张日东, 等. 结合烟雾多特征的出租车司机吸烟行为检测[C]//第十二届全国信号和智能信息处理与应用学术会议论文集, 杭州, 2018: 368-373.
WANG Z Y, LIAO H M, ZHANG R D, et al. Detection of smoking behavior of taxi drivers based on smoke characteristics[C]//Proceedings of the 12th National Conference on Signal and Intelligent Information Processing and Application, Hangzhou, 2018: 368-373.
[20] 黄训平, 贾克斌, 刘鹏宇. 基于交通监控的出租车司机吸烟行为自动检测[J]. 计算机仿真, 2020, 37(12): 337-344.
HUANG X P, JIA K B, LIU P Y. Automatic detection of taxi driver smoking behavior based on traffic monitoring[J]. Computer Simulation, 2020, 37(12): 337-344.
[21] CHEN M, LUDTKE S J. Deep learning-based mixed-dimensional Gaussian mixture model for characterizing variability in cryo-EM[J]. Nature Methods, 2021, 18(8): 930-936.
[22] 张日东. 出租车司机吸烟行为评判标准及自动检测算法研究[D]. 北京: 北京工业大学, 2018.
ZHANG R D. Study on the evaluation standard of smoking behavior of taxi drivers and automatic detection algorithm[D]. Beijing: Beijing University of Technology, 2018.
[23] GIRSHICK R, DONAHUE J, DARRELL T, et al. Rich feature hierarchies for accurate object detection and semantic segmentation[C]//Proceedings of the 2014 IEEE Conference on Computer Vision and Pattern Recognition, 2014: 580-587.
[24] REDMON J, DIVVALA S, GIRSHICK R, et al. You only look once: unified, real-time object detection[C]//Computer Vision & Pattern Recognition. Las Vegas: IEEE, 2016.
[25] JIANG T, MU X, WEI X, et al. Research progress of single-stage small target detection based on deep learning[C]//2022 4th International Conference on Artificial Intelligence and Advanced Manufacturing (AIAM). Germany: IEEE, 2022: 893-898.
[26] POONAM G, SHASHANK B N, ATHRI G R. Development of framework for detecting smoking scene in video clips[J]. Indonesian Journal of Engineering and Computer Science, 2019: 22-26.
[27] LIAO J, ZOU J. Smoking target detection based on Yolo V3[C]//2020 5th International Conference on Mechanical, Control and Computer Engineering (ICMCCE), Harbin, 2020: 2241-2244.
[28] MACALISANG J R, MERENCILLA N E, LIGAYO M A D, et al. Eye-smoker: a machine vision-based nose inference system of cigarette smoking detection using convolutional neural network[C]//2020 IEEE 7th International Conference on Engineering Technologies and Applied Sciences (ICETAS), Xi’an, 2020: 1-5.
[29] SANTIAGO E C, REYES E M, TRIA M L, et al. Deep convolutional neural network for detection of cigarette smokers in public places: a low sample size training data approach[C]//2022 International Conference on Decision Aid Sciences and Applications (DASA), 2022: 1276-1280.
[30] ZOU L, SHAO J, YU Y. Smoking behavior monitoring system in public places based on YOLOv5l+ CBAM[C]//2021 Smart City Challenges & Outcomes for Urban Transformation (SCOUT), Hainan, 2021: 100-106.
[31] 杨国亮, 龚志鹏, 黄聪, 等. 基于深度学习的吸烟行为实时检测[J]. 安全与环境学报, 2023, 23(10): 3696-3705.
YANG G L, GONG Z P, HUANG C, et al. Real-time smoking behavior detection based on deep learning[J]. Journal of Safety and Environment, 2023, 23(10): 3696-3705.
[32] YANG T, YANG J, MENG J. Driver’s illegal driving behavior detection with ssd approach[C]//2021 IEEE 2nd International Conference on Pattern Recognition and Machine Learning (PRML), Chengdu, 2021: 109-114.
[33] 李倩. 基于深度学习的烟支检测技术研究与应用[D]. 西安: 西安邮电大学, 2020.
LI Q. Research and application of cigarette detection technology based on deep learning[D]. Xi’an: Xi’an University of Posts and Telecommunications, 2020.
[34] HE Z, ZHANG L, GAO X, et al. Multi-adversarial faster-RCNN with paradigm teacher for unrestricted object detection[J]. International Journal of Computer Vision, 2023, 131(3): 680-700.
[35] RENTAO Z, MENGYI W, ZILONG Z, et al. Indoor smoking behavior detection based on yolov3-tiny[C]//2019 Chinese Automation Congress (CAC), Hangzhou, 2019: 3477-3481.
[36] WEI Z, ZHU Y X, LI Q X, et al. Improved smoking target detection algorithm based on YOLOv3[J]. Journal of Physics: Conference Series, 2021, 1883(1): 012052.
[37] WANG D, YANG J, HOU F H. Design of intelligent detection system for smoking based on improved YOLOv4[J]. Sensors and Materials, 2022, 34(8): 3271-3284.
[38] MA Y, YANG J, LI Z, et al. YOLO-cigarette: an effective YOLO network for outdoor smoking real-time object detection[C]//2021 Ninth International Conference on Advanced Cloud and Big Data (CBD), Xi’an, 2022: 121-126.
[39] SHI F, ZHOU H, YE C, et al. Faster detection method of driver smoking based on decomposed YOLOv5[J]. Journal of Physics: Conference Series, 2021, 1993(1): 012035.
[40] TANG J, LIU S, ZHENG B, et al. Smoking behavior detection based on improved YOLOv5s algorithm[C]//2021 9th International Symposium on Next Generation Electronics (ISNE), Changsha, 2021: 1-4.
[41] LI R, SONG B, LIU X, et al. Smoking behavior detection based on TF-YOLOv5[C]//2022 3rd International Conference on Pattern Recognition and Machine Learning (PRML), Chengdu, 2022: 14-19.
[42] 刘浩翰, 樊一鸣, 贺怀清, 等. 改进YOLOv7-tiny的目标检测轻量化模型[J]. 计算机工程与应用, 2023, 59(14): 166-175.
LIU H H, FAN Y M, HE H Q, et al. Improved YOLOv7-tiny’s object detection lightweight model[J]. Computer Engineering and Applications, 2023, 59(14): 166-175.
[43] HAN L, RONG L, LI Y, et al. CA-SSD-based real-time smoking target detection algorithm[C]//2021 5th International Conference on Digital Signal Processing, Chengdu, 2021: 283-288.
[44] 张洋, 姚登峰, 江铭虎, 等. 基于EfficientDet网络的细粒度吸烟行为识别[J]. 计算机工程, 2022, 48(3): 302-309.
ZHANG Y, YAO D F, JIANG M H, et al. Fine-grained smoking behavior recognition based on EfficientDet network[J]. Computer Engineering, 2022, 48(3): 302-309.
[45] CHI J, GUO S, ZHANG H, et al. L-GhostNet: extract better quality features[J]. IEEE Access, 2023, 11: 2361-2374.
[46] ZHAO L, WANG H. Salient object detection based on transformer and multi-scale feature fusion[C]//2023 3rd International Conference on Neural Networks, Information and Communication Engineering (NNICE), Guangzhou, 2023: 179-183.
[47] 陈睿龙, 罗磊, 蔡志平, 等. 基于深度学习的实时吸烟检测算法[J]. 计算机科学与探索, 2021, 15(2): 327-337.
CHEN R L, LUO L, CAI Z P, et al. Algorithm for real-time smoking detection based on deep learning[J]. Journal of Frontiers of Computer Science and Technology, 2021, 15(2): 327-337.
[48] 李祥祥, 李晓华, 石刚. 基于深度学习的吸烟检测研究[J]. 东北师大学报 (自然科学版), 2022, 54(3): 98-106.
LI X X, LI X H, SHI G. Research on smoking detection based on deep learning[J]. Journal of Northeast Normal University (Natural Science Edition), 2022, 54(3): 98-106.
[49] ZHANG D, JIAO C, WANG S. Smoking image detection based on convolutional neural networks[C]//2018 IEEE 4th International Conference on Computer and Communications (ICCC), Xizang, 2018.
[50] ZHANG Z, CHEN H, XIAO R, et al. Research on smoking detection based on deep learning[J]. Journal of Physics: Conference Series, 2021, 2024(1): 012042.
[51] ZHAO Z, ZHAO H, YE C, et al. FPN-D-based driver smoking behavior detection method[J]. IETE Journal of Research, 2021: 1-10.
[52] BRADSKI G. The OpenCV library[J]. Dr. Dobb’s Journal: Software Tools for the Professional Programmer, 2000, 25(11): 120-123.
[53] KING D E. Dlib-ml: a machine learning toolkit[J]. The Journal of Machine Learning Research, 2009, 10: 1755-1758.
[54] CECH J, SOUKUPOVA T. Real-time eye blink detection using facial landmarks[C]//21st Computer Vision Winter Workshop, 2016.
[55] DENG J, GUO J, VERVERAS E, et al. Retinaface: single-shot multi-level face localisation in the wild[C]//Proceedings of the IEEE/CVF Conference on Computer Vision and Pattern Recognition, 2020: 5203-5212.
[56] 程淑红, 马晓菲, 张仕军, 等. 基于多任务分类的吸烟行为检测[J]. 计量学报, 2020, 41(5): 538-543.
CHENG S H, MA X F, ZHANG S J, et al. Smoking behavior detection based on multitask classification[J]. Acta Metrologica Sinica, 2020, 41(5): 538-543.
[57] DANILCHENKO P V, ROMANOV N S. Neural networks application to detect the facts of smoking in video surveillance systems[J]. Journal of Physics: Conference Series, 2021, 1794(1): 012002.
[58] XIAO M. Automatic identification of smoking behaviour in public places based on improved YOLO algorithm[J]. International Journal of Data Science, 2022, 7(4): 331-347.
[59] 王鹏, 尹勇, 宋策. 基于改进RetinaFace和YOLOv4的船舶驾驶员吸烟和打电话行为检测[J]. 上海海事大学学报, 2022, 43(4): 44-50.
WANG P, YI Y, SONG C. Smoking and calling behavior detection of ship officers based on improved RetinaFace and YOLOv4[J]. Journal of Shanghai Maritime University, 2022, 43(4): 44-50.
[60] CABANTO W J D, JOCSON A D B, LATEO R L T, et al. Real-time multi-person smoking event detection[C]//Proceedings of the 2nd International Conference on Computing and Big Data, Taiwan, China, 2019: 126-130.
[61] BAI C, ZHOU Y, GUO Q. Application study of area-based and YOLOv4 smoking behavior detection[C]//2022 4th International Conference on Natural Language Processing (ICNLP), Xi’an, 2022: 7-12.
[62] 王鑫鹏, 王晓强, 林浩, 等. 深度学习典型目标检测算法的改进综述[J]. 计算机工程与应用, 2022, 58(6): 42-57.
XANG X P, WANG X Q, LIN H, et al. Review on improvement of typical object detection algorithms in deep learning[J]. Computer Engineering and Applications, 2022, 58(6): 42-57.
[63] 史芳菲. 监控视频下运营车辆司机吸烟行为检测系统的设计与实现[D]. 海口: 海南大学, 2021.
SHI F F. Design and implementation of a smoking detection system for operating vehicle drivers under surveillance video[D]. Haikou: Hainan University, 2021.
[64] YANG Z, HUANG H, XIA F, et al. Smoke detection algorithm based on improved EfficientDet[C]//Proceedings of the 2022 6th International Conference on Deep Learning Technologies, Xi’an, 2022: 61-67.
[65] SHA R, GUHA T. Detection of smoking in inside the office using deep learning for CCTV camera[C]//2022 International Conference on Innovative Computing, Intelligent Communication and Smart Electrical Systems (ICSES), 2022: 1-9.
[66] CHEN X, XUE Y, ZHU Y, et al. A novel smoke detection algorithm based on improved mixed Gaussian and YOLOv5 for textile workshop environments[J]. IET Image Processing, 2023: 1991-2004.
[67] WANG P, YUAN C, HU W, et al. Graph based skeleton motion representation and similarity measurement for action recognition[C]//14th European Conference on Computer Vision (ECCV 2016), The Netherlands, 2016: 370-385.
[68] 刘婧, 杨旭, 刘董经典, 等. 基于人体关节点的多人吸烟动作识别算法[J]. 计算机工程与应用, 2021, 57(1): 234-241.
LIU J, YANG X, LIU D J D, et al. Multi-person smoking action recognition algorithm based on human joint points[J]. Computer Engineering and Applications, 2021, 57(1): 234-241.
[69] 姜晓凤, 王保栋, 夏英杰, 等. 基于人体关键点和YOLOv4的吸烟行为检测[J]. 陕西师范大学学报 (自然科学版), 2022, 50(3): 96-103.
JIANG X F, WANG B D, XIA Y J, et al. Smoking behavior detection based on human keypoints and YOLOv4[J]. Journal of Shaanxi Normal University (Natural Science Edition), 2022, 50(3): 96-103.
[70] 邸昱卿, 张云伟. 基于人体关键点的吸烟行为识别方法研究[J]. 电视技术, 2022, 46(5): 12-16.
DI Y Q, ZHANG Y W. Research on smoking behavior recognition method based on human key points[J]. Video Engineering, 2022, 46(5): 12-16.
[71] 徐婉晴, 王保栋, 黄艺美, 等. 基于人体骨骼关键点的吸烟行为检测算法[J]. 计算机应用, 2021, 41(12): 3602-3607.
XU W Q, WANG B D, HUANG Y M, et al. Smoking behavior detection algorithm based on human skeleton key points[J]. Journal of Computer Applications, 2021, 41(12): 3602-3607.
[72] DU Y, FU Y, WANG L. Skeleton based action recognition with convolutional neural network[C]//2015 3rd IAPR Asian Conference on Pattern Recognition, Kuala Lumpur, 2015: 579-583.
[73] WANG P, LI W, LI C, et al. Action recognition based on joint trajectory maps with convolutional neural networks[J]. Knowledge-Based Systems, 2016, 158: 43-53.
[74] LIU M, CHEN C, LIU H. 3D action recognition using data visualization and convolutional neural networks[C]//2017 IEEE International Conference on Multimedia and Expo, Hong Kong, China, 2017: 925-930.
[75] LI B, DAI Y, CHENG X, et al. Skeleton based action recognition using translation-scale invariant image mapping and multi-scale deep CNN[C]//2017 IEEE International Conference on Multimedia & Expo Workshops, Hong Kong, China, 2017: 601-604.
[76] LIU M, LIU H, CHEN C. Enhanced skeleton visualization for view invariant human action recognition[J]. Pattern Recognition, 2017, 68: 346-362.
[77] YANG Z, LI Y, YANG J, et al. Action recognition with spatiotemporal visual attention on skeleton image sequences[J]. IEEE Transactions on Circuits and Systems for Video Technology, 2019, 29(8): 2405-2415.
[78] CAETANO C, BRéMOND F, SCHWARTZ W R. Skeleton image representation for 3D action recognition based on tree structure and reference joints[C]//2019 32nd SIBGRAPI Conference on Graphics, Patterns and Images, Brazil, 2019: 16-23.
[79] LI Y, XIA R, LIU X, et al. Learning shape-motion representations from geometric algebra spatiotemporal model for skeleton-based action recognition[C]//2019 IEEE International Conference on Multimedia and Expo, Hong Kong, China, 2019: 1066-1071.
[80] DU Y, WANG W, WANG L. Hierarchical recurrent neural network for skeleton based action recognition[C]//Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition, Los Angeles, 2015: 1110-1118.
[81] ZHU W, LAN C, XING J, et al. Co-occurrence feature learning for skeleton based action recognition using regularized deep LSTM networks[J]. Proceedings of the AAAI Conference on Artificial Intelligence, 2016.
[82] SHAHROUDY A, LIU J, NG T T, et al. NTU RGB+D: a large scale dataset for 3D human activity analysis[C]//Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition. Piscataway, NJ: IEEE Press, 2016: 1010-1019.
[83] LIU J, SHAHROUDY A, XU D, et al. Spatio-temporal LSTM with trust gates for 3D human action recognition [C]//European Conference on Computer Vision. Berlin: Springer, 2016: 816-833.
[84] ZHANG S, LIU X, XIAO J. On geometric features for skeleton-based action recognition using multilayer LSTM networks[C]//2017 IEEE Winter Conference on Applications of Computer Vision, California, 2017: 148-157.
[85] ZHANG P, LAN C, XING J, et al. View adaptive recurrent neural networks for high performance human action recognition from skeleton data[C]//Proceedings of the IEEE International Conference on Computer Vision. Piscataway, NJ: IEEE Press, 2017: 2117-2126.
[86] YAN S, XIONG Y, LIN D. Spatial temporal graph convolutional networks for skeleton-based action recognition[C]//Proceedings of the AAAI Conference on Artificial Intelligence, 2018.
[87] THAKKAR K, NARAYANAN P J. Part-based graph convolutional network for action recognition[J]. arXiv:1809. 04983, 2018.
[88] LI M, CHEN S, CHEN X, et al. Actional-structural graph convolutional networks for skeleton-based action recognition[C]//Proceedings of the IEEE/CVF Conference on Computer Vision and Pattern Recognition, Long Beach, 2019: 3595-3603.
[89] SHI L, ZHANG Y, CHENG J, et al. Skeleton-based action recognition with directed graph neural networks[C]//Proceedings of the IEEE/CVF Conference on Computer Vision and Pattern Recognition, Long Beach, 2019: 7912-7921.
[90] SHI L, ZHANG Y, CHENG J, et al. Two-stream adaptive graph convolutional networks for skeleton-based action recognition[C]//Proceedings of the IEEE/CVF Conference on Computer Vision and Pattern Recognition, Long Beach, 2019: 12026-12035.
[91] LI C, ZHONG Q, XIE D, et al. Skeleton-based action recognition with convolutional neural networks[C]//2017 IEEE International Conference on Multimedia & Expo Workshops, Hong Kong, China, 2017: 597-600.
[92] CAO C, LAN C, ZHANG Y, et al. Skeleton-based action recognition with gated convolutional neural networks[J]. IEEE Transactions on Circuits and Systems for Video Technology, 2019, 29(11): 3247-3257.
[93] 任国印, 吕晓琪, 李宇豪. 基于2D转3D骨架的多特征融合实时动作识别[J]. 激光与光电子学进展, 2021, 58(24): 233-241.
REN G Y, LV X Q, LI Y H. Multi-feature fusion real-time action recognition based on 2D to 3D skeleton[J]. Laser & Optoelectronics Progress, 2021, 58(24): 233-241.
[94] LI X, ZHANG J, WANG S, et al. Two-stream spatial graphormer networks for skeleton-based action recognition[J]. IEEE Access, 2022, 10: 100426-100437.
[95] YIN M, HE S, SOOMRO T A, et al. Efficient skeleton-based action recognition via multi-stream depthwise separable convolutional neural network[J]. Expert Systems with Applications, 2023, 226: 120080.
[96] LIU J, SHAHROUDY A, XU D, et al. Skeleton-based action recognition using spatiotemporal LSTM network with trust gates[J]. IEEE Transactions on Pattern Analysis and Machine Intelligence, 2018, 40(12): 3007-3021.
[97] ZHENG W, LI L, ZHANG Z, et al. Relational network for skeleton-based action recognition[C]//2019 IEEE International Conference on Multimedia and Expo, Shanghai, 2019: 826-831.
[98] 余晓毅, 宋涛, 赵明富, 等. 基于双流独立循环神经网络的人体行为识别[J]. 激光杂志, 2021, 42(4): 86-90.
YU X Y, SONG T, ZHAO M F, et al. Human action recognition with two-stream independently recurrent neural network[J]. Laser Journal, 2021, 42(4): 86-90.
[99] 付仔蓉, 吴胜昔, 吴潇颖, 等. 基于空间特征的BI-LSTM人体行为识别[J]. 华东理工大学学报(自然科学版), 2021, 47(2): 225-232.
FU Z R, WU S X, WU X Y, et al. Human action recognition using Bi-LSTM network based on spatial features[J]. Journal of East China University of Science and Technology, 2021, 47(2): 225-232.
[100] CAO Y, LIU C, SHENG Y, et al. Action recognition model based on 3D graph convolution and attention enhanced[J]. Journal of Electronics and Information, 2021, 43(7): 2071-2078.
[101] XIA H, GAO X. Multi-scale mixed dense graph convolution network for skeleton-based action recognition[J]. IEEE Access, 2021, 9: 36475-36484.
[102] YANG H, GU Y, ZHU J, et al. PGCN-TCA: pseudo graph convolutional network with temporal and channel-wise attention for skeleton-based action recognition[J]. IEEE Access, 2020, 8: 10040-10047.
[103] SHIRAKI K, HIRAKAWA T, YAMASHITA T, et al. Spatial temporal attention graph convolutional networks with mechanics-stream for skeleton-based action recognition [C]//Proceedings of the Asian Conference on Computer Vision. Berlin: Springer, 2020.
[104] YOON Y, YU J, JEON M. Predictively encoded graph convolutional network for noise-robust skeleton-based action recognition[J]. Applied Intelligence, 2022, 52(3): 2317-2331.
[105] LI C, LI S, GAO Y, et al. Improved shift graph convolutional network for action recognition with skeleton[J]. IEEE Signal Processing Letters, 2023, 30: 438-442.
[106] YU L, TIAN L, DU Q, et al. Multi-stream adaptive 3D attention graph convolution network for skeleton-based action recognition[J]. Applied Intelligence, 2023, 53(12): 14838-14854.
[107] ZHU A, WU Q, CUI R, et al. Exploring a rich spatial-temporal dependent relational model for skeleton-based action recognition by bidirectional LSTM-CNN[J]. Neurocomputing, 2020, 414: 90-100.
[108] ZHANG P, LAN C, ZENG W, et al. Semantics-guided neural networks for efficient skeleton-based human action recognition[C]//Proceedings of the IEEE/CVF Conference on Computer Vision and Pattern Recognition, 2020: 1112-1121.
[109] 冒鑫鑫, 吴胜昔, 咸博龙, 等. 基于骨架的自适应图卷积和LSTM行为识别[J]. 华东理工大学学报(自然科学版), 2022, 48(6): 816-825.
MAO X X, WU S X, XIAN B L, et al. Adaptive graph convolution and LSTM action recognition based on skeleton[J]. Journal of East China University of Science and Technology, 2022, 48(6): 816-825.
[110] JIANG Y, SUN Z, YU S, et al. A Graph skeleton transformer network for action recognition[J]. Symmetry, 2022, 14(8): 1547.
[111] CAETANO C, SENA J, BRéMOND F, et al. Skelemotion: a new representation of skeleton joint sequences based on motion information for 3D action recognition[C]//2019 16th IEEE International Conference on Advanced Video and Signal Based Surveillance, Taiwan, China, 2019: 1-8.
[112] 王洪雁, 袁海. 基于骨骼及表观特征融合的动作识别方法[J]. 通信学报, 2022, 43(1): 138-148.
WANG H Y, YUAN H. Action recognition method based on fusion of skeleton and apparent features[J]. Journal of Communications, 2022, 43(1): 138-148.
[113] ZHANG X, SU X, YU J, et al. Combine object detection with skeleton-based action recognition to detect smoking behavior[C]//2021 The 5th International Conference on Video and Image Processing, Guangzhou, 2021: 111-116.
[114] JIAO S J, LIU L Y, LIU Q. A hybrid deep learning model for recognizing actions of distracted drivers[J]. Sensors, 2021, 21(21): 7424.
[115] ARTAN Y, BALCI B, ELIHO? A, et al. Vision based driver smoking behavior detection using surveillance camera images[C]//20th International Conference on Image Analysis and Processing (ICIAP 2019). Italy: Springer International Publishing, 2019: 468-476.
[116] 孙方伟, 李承阳, 谢永强, 等. 深度学习应用于遮挡目标检测算法综述[J]. 计算机科学与探索, 2022, 16(6): 1243-1259.SUN F W, LI C Y, XIE Y Q, et al. Review of deep learning applied to occluded object detection[J]. Journal of Frontiers of Computer Science and Technology, 2022, 16(6): 1243-1259.
[117] MA Y, YUAN L, ABDELRAOUF A, et al. M2DAR: multi-view multi-scale driver action recognition with vision transformer[C]//Proceedings of the IEEE/CVF Conference on Computer Vision and Pattern Recognition, Britain, 2023: 5286-5293.