Computer Engineering and Applications ›› 2015, Vol. 51 ›› Issue (21): 161-167.

Previous Articles     Next Articles

Research and implementation of collision interaction between virtual and actual objects in range image

WANG Yi, YANG Gang   

  1. School of Information Science and Technology, Beijing Forestry University, Beijing 100083, China
  • Online:2015-11-01 Published:2015-11-16

利用深度图像的虚实物体碰撞交互研究与实现

王  祎,杨  刚   

  1. 北京林业大学 信息学院,北京 100083

Abstract: In traditional augmented reality system, it is difficult to implement the collision interaction between the virtual objects and actual objects. In order to solve the problem, this paper puts forward a method that uses scene range image segmentation and builds proxy geometry for every segmentation result to realize the collision interaction between virtual and actual objects. It adopts 3D depth measuring devices such as Kinect to get the color image information and range image information of current real scenarios. It analyzes the range image and through the way of normal clustering and plane fitting to segment the major plane area and other objects areas. Then, a 3D virtual plane of the identified plane and a 3D bounding box of the segmented object will be built up as the proxy geometries which later will be overlaid on the actual objects and endowed with physical property, thus enabling us to simulate the collision interaction between virtual and actual objects. Experimental results show that the algorithm can segment simple scenes effectively and realize the collision interaction between virtual and actual objects successfully.

Key words: augmented reality, Kinect, segmentation of range image, bounding box, interaction between virtual and actual objects

摘要: 对传统增强现实系统中虚拟物体与真实物体难以进行碰撞交互的问题,提出一种对深度图像中的场景进行分割,并基于分割结果构建代理几何体的方法来实现虚、实物体的碰撞交互。采用Kinect等深度获取设备获取当前真实场景的彩色图像信息和深度图像信息;通过深度图像的法向聚类及平面拟合技术来识别出场景中的主平面区域;对除去主平面区域的其他聚类点云区域进行融合处理,得到场景中的其他主要物体区域;为识别出的主平面构建虚拟平面作为该平面的代理几何体,为分割出的物体构建包围盒来作为其代理几何体。将这些代理几何体叠加到真实物体上,并对之赋予物理属性,即可模拟实现虚拟物体与真实物体的碰撞交互。实验结果表明,该方法可有效分割简单场景,从而实现虚实交互。

关键词: 增强现实, Kinect, 深度图像分割, 包围盒, 虚实交互