计算机工程与应用 ›› 2023, Vol. 59 ›› Issue (6): 291-298.DOI: 10.3778/j.issn.1002-8331.2110-0379

• 工程与应用 • 上一篇    下一篇

基于点云匹配的AR饰面作业系统跟踪注册方法

贾晓辉,冯重阳,刘今越   

  1. 河北工业大学 机械工程学院,天津 300401
  • 出版日期:2023-03-15 发布日期:2023-03-15

Tracking and Registration Method Based on Point Cloud Matching for Augmented Reality Facing Work System

JIA Xiaohui, FENG Chongyang, LIU Jinyue   

  1. School of Mechanical Engineering, Hebei University of Technology, Tianjin 300401, China
  • Online:2023-03-15 Published:2023-03-15

摘要: 针对建筑机器人饰面作业过程中常因视觉遮挡导致作业效率低的问题,使用增强现实解决遮挡并提出一种基于点云匹配的增强现实跟踪注册方法。利用目标模型点云与作业环境点云的匹配进行目标的初始定位;利用改进的相关滤波跟踪算法对目标进行跟踪获取目标位置;基于迭代最近点法对目标位姿进行估计。在跟踪注册过程中加入位姿优化,保证目标位姿估计精度。为了更加准确地跟踪目标位置,提出一种特征融合和尺度自适应的改进相关滤波目标跟踪算法。通过板材安装实验,表明跟踪注册方法精确性、实时性均较好,最小识别误差达到2.88?mm,具有良好的虚实融合效果。

关键词: 增强现实, 跟踪注册, 点云匹配, 饰面作业

Abstract: This paper proposes a tracking and registration method based on point cloud matching of augmented reality to solve the occlusion problem in facing work of construction robot. Firstly, the point cloud of the target model and the operating environment is matched and the location of target is initialized. Secondly, the improved correlation filter tracking algorithm is adopted to track the target and obtain the target position. Then, the ICP(iterative closest point) method is applied to estimate the pose of target. Finally, pose optimization is added in the tracking registration process. In order to track the target more accurately, the scale-adaptive correlation filter tracking based on multiple features is proposed. Through the panel installation experiments are carried out and the results show that the proposed method has good accuracy and real-time performance. The minimum positioning error is 2.88 mm, and the effect of virtual and reality fusion is perfect.

Key words: augmented reality, tracking and registration, point cloud matching, facing work