关键词: 增强现实, 视触觉融合, 触觉交互, 三维注册

Abstract:

Augmented reality is a hot topic in the field of human-computer interaction in recent years. Adding haptic perception in an augmented reality environment enables users to see and interact with virtual objects in real scenes. To achieve more natural interaction with virtual objects in the augmented reality environment, this paper proposes a three-dimensional registration algorithm for visual and haptic integration. Firstly, a three-dimensional registration matrix is obtained based on image vision technology, then the transformation relationship between the haptic space and the image space is solved based on the spatial transformation relationship, finally, the relationship between the two and the camera space is combined to realize the augmented reality interactive of visual and haptic integration. To verify the effectiveness of this method, an assembly robot project based on visuo-haptic augmented reality is designed. The users can touch and move virtual robot parts in the real environment, and can also feel force feedback when touching, making the interaction more realistic.

Key words: augmented reality, visual and haptic integration, haptic interaction, three-dimensional registration