计算机工程与应用 ›› 2007, Vol. 43 ›› Issue (12): 180-183.

• 工程与应用 • 上一篇    下一篇

基于范例集实现复杂场景下的动态手势跟踪

齐苏敏 黄贤武 季丽红   

  1. 苏州大学电子信息学院 曲阜师范大学计算机科学学院 苏州大学电子信息学院 曲阜师范大学计算机科学学院 苏州大学电子信息学院 曲阜师范大学计算机科学学院
  • 收稿日期:2006-08-30 修回日期:1900-01-01 出版日期:2007-04-20 发布日期:2007-04-20
  • 通讯作者: 齐苏敏

Exemplars Based Dynamic Gesture Tracking in Complex Background

Qi Su-min Huang Xian-wu Ji Li-hong   

  1. ( School of Electronics & Information Engineering,Soochow University,Suzhou,215021,Chin
  • Received:2006-08-30 Revised:1900-01-01 Online:2007-04-20 Published:2007-04-20

摘要: 范例集作为近年来视觉跟踪器的一种表示方法,已应用于手势跟踪与识别。但是基于范例集的手势跟踪往往不能实现复杂场景下手部轮廓特征的精确提取,并且不能在手部位置与方向任意变化情况下实现手部轮廓的提取与跟踪,极易造成手部动作的不准确预测,从而影响手势跟踪效果与手势识别率。本文提出一种新的基于范例集的跟踪器:CEE(CAMSHIFT Embedded Exemplar)跟踪器,实现复杂场景下的动态手势跟踪。在学习阶段,利用ICAMSHIFT(Improved CAMSHIFT)算法提取手部轮廓特征并生成范例集,同时建立手势的动态HMM模型;在跟踪阶段,首先利用由ICAMSHIFT算法获取的手部特征和HMM概率模型预测手势动作,然后根据学习所得范例集获取当前手部轮廓。实验结果表明,算法能实现复杂场景下的准确手势跟踪,并能在手部位置与方向任意变化情况下实现手部轮廓的提取与跟踪。此外,在严重遮挡情况下也能取得不错的跟踪效果。

关键词: 手势跟踪, 范例集, 遮挡, HMM, ICAMSHIFT

Abstract: As a choice for tracker representations exemplars have been applied to gesture tracking and recognition. However exemplars based tracker is unable to acquire the accurate abstraction of hand silhouette in complex background, which makes the inaccurate predication of the hand motion,which degrades the gesture Tracking and recognition. This paper proposes a new exemplar based tracker i.e. CEE(CAMSHIFT Embedded Exemplar) tracker to implement the dynamic hand gesture tracking in complex background. In training phase, ICAMSHIFT(Improved CAMSHIFT) algorithm is used for extracting hand silhouette and generating exemplars. At the same time, the dynamic HMM modal is established. In tracking phase, firstly the hand motion is predicted according to the hand feather extracted using ICAMSHIFT algorithm and the HMM modal. Secondly the hand contour is obtained according to the learned exemplars. Experiments results show that the accurate gesture tracking can be acquired in complex background. What’s more, the tracking is effective on the occasion of occlusion.

Key words: Gesture tracking, Exemplars, Occasion, HMM, ICAMSHIFT