Abstract: Aiming at the problems existed in hand gestures recognition in complex environment, a hand gestures recognition approach fused depth information with infrared information is proposed in this paper. Firstly, depth information captured by Kinect is applied to segment the dynamic hand gesture, then, using infrared image to repair the hand gesture image. It solves the problem of real-time gesture segmentation and low recognition rate of gesture recognition using distribution feature of hand, when there is a defect or face interference in gesture segmentation region. The experimental results show that the proposed method is not sensitive to ambient light, and can identify gestures with small discrimination, and can recognize gesture of rotation, scaling, translation with strong robustness. For those gestures with large discrimination, the recognition rate is up to100%.

Key words: hand gesture segmentation, space eigenvector, hand gesture recognition, depth information, infrared information, complex background

摘要： 针对复杂环境中的手势识别问题，提出了一种融合深度信息和红外信息的手势识别方法。首先利用Kinect摄像头的深度信息进行动态实时手势分割，然后融合红外图像复原手势区域。解决了实时手势分割和利用手势的空间分布特征进行手势识别时由于分割的手势区域有缺损或有人脸干扰时识别率低的问题。经实验验证，提出的方法不仅不受环境光线的影响，而且可以识别区分度较小的手势，对旋转、缩放、平移的手势识别也具有鲁棒性。对于区分度较大的手势，识别率高达100%。

关键词: 手势分割, 空间特征向量, 手势识别, 深度信息, 红外信息, 复杂环境