关键词: 虚拟沙画, 角域划分, 手势识别, Leap Motion, Unity3D

Abstract: Rapid development of virtual simulation technology and constantly updated somatosensory equipments bring new inspiration for sand painting animation which is a creative art form. Because of the complex process of live sand painting, this paper combines Leap Motion devices and Unity3D development environments to accomplish hand gesture recognition, and then successfully performs live sand painting in virtual environments. Firstly, hand key points of coordinate and direction are extracted according to the gesture information captured by Leap Motion. Then the method of angle domain segmentation is proposed and a new set of feature vector is added, which is in series with fetched information as the basis of hand classification. Finally, defined gestures are utilized to drive virtual hand to complete sand painting. The experiments show that gesture recognition by Leap Motion in close range performs more accurate than other methods, gesture tracking is stable with high real-time performance and the virtual sand painting system has a much stronger sense of immersion.

Key words: virtual sand art, angle domain segmentation, posture recognition, Leap Motion, Unity3D