Computer Engineering and Applications ›› 2022, Vol. 58 ›› Issue (3): 289-296.DOI: 10.3778/j.issn.1002-8331.2008-0257

• Engineering and Applications • Previous Articles     Next Articles

Research of Outdoor Robot Localization Method on Fusion of Multi-camera and IMU

DONG Rong, LI Maohai, LIN Rui, LIU Shiqi, DING Wen   

  1. College of Mechanical and Electrical Engineering, Soochow University, Suzhou, Jiangsu 215021, China
  • Online:2022-02-01 Published:2022-01-28

多相机与IMU融合的室外机器人定位方法研究

董荣,厉茂海,林睿,刘仕琦,丁文   

  1. 苏州大学 机电工程学院,江苏 苏州 215021

Abstract: Improving the accuracy and robustness of SLAM algorithm is the key to solve the autonomous localization problem of outdoor mobile robot. MCSI-VINS, a method which integrates multi-camera and IMU, is proposed to solve the problems of monocular camera being vulnerable to occlusion in outdoor complex environment, camera moving too fast, image blurriness, algorithm accuracy and robustness decline under pure robot rotation, and cumulative offset of low-precision IMU. The layout of multiple cameras can make up for the case that the single eye is blocked, the rich visual information can make up for the accumulated error caused by the low-precision IMU, and the IMU fusion can solve the localization problem in the case that the camera moves too fast, the image is blurred, and the rotation is pure. It mainly introduces the data preprocessing, initialization and optimization localization module of the MCSI-VINS. This method is based on the VINS-MONO framework, but different from it, a method to build buffer based on queue data structure is proposed in the data pretreatment stage, and an initialization method based on the main camera is proposed in the front end. In the back end, the error term of other cameras is added and the time stamp is optimized. A mobile robot experiment platform is built based on ROS. Experiments verify that the proposed algorithm is more robust and accurate than the classical monocular and binocular VINS algorithms.

Key words: multi-camera, inertial measurement unit(IMU), outdoor mobile robot, robot operating system(ROS)

摘要: 提高SLAM(simultaneous localization and mapping)算法的精度和鲁棒性是解决室外移动机器人自主定位问题的关键。针对单目相机在室外复杂环境下易受到遮挡、相机移动过快、图像模糊以及机器人纯旋转下算法精度和鲁棒性下降、低精度IMU(inertial measurement unit)的累积偏移等问题,提出了一种多目相机与IMU融合的方案——MCSI-VINS(multi-camera and single-IMU-visual inertial navigation system)。多相机的布置可弥补单目受到遮挡的情形,丰富的视觉信息可弥补低精度IMU带来的累积误差,融合IMU可解决相机移动过快、图像模糊、纯旋转情形下的定位问题。MCSI-VINS包括数据预处理、初始化和优化定位模块。此方法基于VINS-MONO(multi-camera and single-IMU-monocular)框架,而与VINS-MONO不同的是,在数据预处理阶段提出了一种基于队列数据结构构建缓冲区的方法,前端提出了一种基于主相机的初始化方法,在后端中添加了其他相机的误差项并对时间戳进行了优化。用基于ROS(robot operating system)的移动机器人进行实验表明,提出的算法较经典的单目、双目VINS算法相比,鲁棒性更强,精度更高。

关键词: 多目相机, 惯性测量单元(IMU), 室外移动机器人, 机器人操作系统(ROS)