关键词: 多点触控, 沙画手势, 手势识别, 图形建模, 图嵌入

Abstract: Aiming at the problems of multi-touch gesture indirect command, a sand painting gesture recognition system based on multi-touch has been presented, which is controlled by temporal, spatial and shape information. Firstly, a gesture graphic modeling method is proposed to measure the spatial and temporal relationship between the gesture strokes. Then, the clustering algorithm is used to mark the shape information of the strokes in the gesture graph as the local shape feature and the benchmarking tool HBF49 is used to extract the global shape feature. Finally, the sand painting gesture recognition system based on multi-touch is evaluated by a collection of data with 10 different multi-touch sand painting gestures, using the graph embedding method and SVM classifier to identify gestures, achieving a recognition rate of 94.75%. The experiments show that the research plays an important role in completing the sand painting virtual system based on multi-touch.

Key words: multi-touch, sand painting gesture, gesture recognition, graph modeling, graph embedding