Research on Aerial Image Matching Algorithm of Power Patrol UAS

doi:10.3778/j.issn.1002-8331.2006-0052

Abstract

Abstract:

Image matching algorithm based on local features is the most practical method in aerial image matching algorithm for power patrol UAV. An aerial image matching algorithm based on Gaussian curvature scale space is proposed to solve the problem that the traditional matching algorithm can cause the loss of image edge information or low efficiency. The first order scale space is constructed with the help of Gaussian curvature filter, then the feature points are extracted by FAST algorithm and the feature sampling region is selected. The second order scale space is established for the feature sampling region and the descriptors within LIOP second order scale space layer are extracted. Then the second order scale space pairwise LIOP descriptors are differentiated and binarized. Finally, the cumulative binarization is worth matching ASV-LIOP descriptors. On aerial images, algorithms such as SIFT, ORB, KAZE, AKAZE, and improved KAZE are used to compare with the proposed experiments. Experiments show that the accuracy of the proposed algorithm increases by 5% on average and the matching efficiency decreases by 50%.

Key words: power patrol UAV, Gaussian curvature scale space, ASV-LIOP descriptors

摘要：

基于局部特征的图像匹配算法是电力巡线无人机航拍图像匹配算法中最为实用的一种方法。针对传统匹配算法构建尺度空间会致使图像边缘信息丢失或者效率较低等问题，提出一种基于高斯曲率尺度空间的航拍图像匹配算法。借助高斯曲率滤波器构建一阶尺度空间，利用FAST算法提取特征点并选择特征采样区域，再以对特征采样区域建立二阶尺度空间并提取二阶尺度空间层内LIOP描述符，随后二阶尺度空间两两层LIOP描述符做差值并二值化处理，累加二值化值得到ASV-LIOP描述符完成匹配。在航拍图像上，使用SIFT、ORB、KAZE、AKAZE、改进KAZE等算法与所提对比实验，实验表明，所提算法正确匹配率平均提高5%左右，匹配效率约降低50%，可应用对稳定性要求较高且实时性较低的场景。

关键词: 电力巡线无人机, 高斯曲率尺度空间, ASV-LIOP描述符

MA Yaoming, CHEN Yilin, LI Wanyu. Research on Aerial Image Matching Algorithm of Power Patrol UAS[J]. Computer Engineering and Applications, 2021, 57(21): 278-286.

马耀名，陈艺琳，李万禹. 电力巡线无人机航拍图像匹配算法研究[J]. 计算机工程与应用, 2021, 57(21): 278-286.

References

[1] 王永昆，王栋，孙永杰，等.输电线路无人机巡检应用与展望[J].电工技术，2020（1）：76-77.
WANG Y K，WANG D，SUN Y J，et al.Application and prospects of UAV in transmission lines inspection[J]. Electrical Technology，2020（1）：76-77.
[2] 缪希仁，刘志颖，鄢齐晨.无人机输电线路智能巡检技术综述[J].福州大学学报（自然科学版），2020，24（3）：10-27.
MIAO X R，LIU Z Y，YAN Q C.Review on UAV intelligent technology for transmission line inspection[J]. Journal of Fuzhou University（Natural Science Edition），2020，24（3）：10-27.
[3] 刘壮，杜勇，陈怡，等.±500?kV直流输电线路直线塔无人机巡检安全距离仿真与试验[J].高电压技术，2019，45（2）：426-432.
LIU Z，DU Y，CHEN Y，et al.Simulation and experiment on the safety distance of typical μ500?kV DC transmission lines and towers for UAV inspection[J].High Voltage Technology，2019，45（2）：426-432.
[4] 梁文勇，吴大伟，谷山强，等.输电线路多旋翼无人机精细化自主巡检航迹优化方法[J].高电压技术，2020，3（3）：1-8.
LIANG W Y，WU D W，GU S Q，et al.Optimization method for fine autonomous inspection route of transmission lines by multi-rotor unmanned aerial vehicle[J].High Voltage Technology，2020，3（3）：1-8.
[5] 彭向阳，易琳，钱金菊.大型无人直升机电力线路巡检系统实用化[J].高电压技术，2020，46（2）：384-396.
PENG X Y，YI L，QIAN J J.Practical research on patrol inspection system of electric power line based on large scale unmanned helicopter[J].High Voltage Technology，2020，46（2）：384-396.
[6] 邵瑰玮，刘壮，付晶.架空输电线路无人机巡检技术研究进展[J].高电压技术，2020，46（1）：14-22.
SHAO G W，LIU Z，FU J.Research progress in unmanned aerial vehicle inspection technology on overhead transmission lines[J].High Voltage Technology，2020，46（1）：14-22.
[7] 刘有.无人机序列影像匹配及拼接方法研究[D].长沙：中南大学，2012.
LIU Y.Research on matching and mosaicing methods for UAV image sequences[D].Changsha：Central South University，2012.
[8] 王勃.基于特征的无人机影像自动拼接技术研究[D].郑州：信息工程大学，2011.
WANG B.Automatic mosaic technique of UAV images based on features[D].Zhengzhou：University of Information Engineering，2011.
[9] LOWE D G.Distinctive image features from scale-invariant keypoints[J].International Journal of Computer Vision，2004，60（2）：91-110．
[10] BAY H，ESS A，TUYTELAARS T，et al.SURF：speeded up robust features[J].Computer Vision and Image Understanding，2008，110（3）：346-359.
[11] RUBLRR E，RABAUD V，KONOLIGE K，et al.ORB：an efficient alternative to SIFT or SURF[C]//Proceeding of International Conference on Computer Vision（ICCV）.Barcelona，Spain：IEEE，2011：2564-2571.
[12] ROSTEN E，DRUMMOND T.Machine learning for high-speed corner detection[C]//Proceedings of the 9th European Conference on Computer Vision.Graz：Springer，2006：430-443.
[13] CALONDER M，LEPETIT V，STRECHA C，et al.BRIEF：binary robust independent elementary features[C]//Proceedings of the 11th European Conference on Computer Vision.Heraklion：Springer，2010：778-792.
[14] ALCANTARILLA P F，BARTOLI A，DAVISON A J.KAZE features[C]//European Conference on Computer Vision（ECCV），2012：214-227.
[15] WEICKERT J，ROMENY B H，VIERGEVER M A.Efficient and reliable schemes for nonlinear diffusion filtering[J].IEEE Transactions on Image Processing，1998，3（7）：398-410.
[16] ALCANTARILLA P F，NUEVO J，BARTOLI A.Fast explicit diffusion for accelerated features in nonlinear scale spaces[C]//Proceedings of British Machine Vision Conference.Berlin，Germany：Springer，2013：131-142.
[17] YANG X，CHENG K T.LDB：an ultra-fast feature for scalable augmented reality on mobile devices[C]//IEEE and ACM International Symposium on Mixed and Augmented Reality（ISMAR），2012.
[18] 韩宇，宗群，邢娜.基于改进SIFT的无人机航拍图像快速匹配[J].南开大学学报（自然科学版），2019，52（1）：5-9.
HAN Y，ZONG Q，XING N.Fast matching of UAV aerial image based on SIFT[J].Journal of Nankai University（Natural Science Edition），2019，52（1）：5-9.
[19] 韩敏，闫阔，秦国帅.基于改进KAZE的无人机航拍图像拼接算法[J].自动化学报，2019，45（2）：305-314.
HAN M，YAN K，QIN G S.A mosaic algorithm for uav aerial image with improved KAZE[J].Journal of Automation，2019，45（2）：305-314.
[20] GONG Y H, SBALZARINI I F.Curvature filters efficiently reduce certain variational enengies[J].IEEE Transactions on Image Processing，2017，26（4）：1786-1798.
[21] WANG Z H，FAN B，WANG G，et al.Exploring local and overall ordinal information for robust feature description[J].IEEE Transactions on Pattern Analysis & Machine Intelligence，2015，75（3）：123-136.
[22] YANG T Y，LIN Y Y，CHUANG Y Y.Accumulated stability voting：a robust descriptor from descriptors of multiple scales[C]//2016 IEEE Conference on Computer Vision and Pattern Recognition，2016.
[23] ALAHI A，ORTIZ R，VANDERGHEYNST P，et al.FREAK：fast retina keypoint[C]//IEEE Conference on Computer Vision and Pattern Recognition，2012.