Abstract: This paper presents an approach of deformable hand gesture tracking with single camera under disturbances from skin-color.It proposes a method to recognize static hand gestures based on PGH.In order to solve the problem of disturbances from skin-color，it achieves a predictive tracking method based on Kalman filter.Moreover，it proposes a solution based on a hierarchical structure to solve the problem of tracking initialization.Experimental results show that the proposed method can track the deformable hand gesture under disturbances from skin-color effectively，and thus it can meet the requirements of real-time vision-based human-computer interaction.