关键词: 多视角图像, 亮度调整, 单应性变换矩阵, 高光像素检测, 高光去除

Abstract: To solve the problem of texture information loss due to saturation and highlight of specular surface reflection, a method of removing highlight based on multi view image feature（MSF） matching is proposed. Firstly, two images from different viewpoint are selected to be reference image and auxiliary image. They are converted to HSV space to adjust the brightness. Next, the homography matrix is estimated from the matched feature points extracted from the two images. Then the homography is utilized to transform the auxiliary image to the same viewpoint of the reference image. Finally, the MSF algorithm is used to detect the highlight from the reference image and the highlight region is employed as a mask in auxiliary image to obtain the texture that can be used to fill the missing texture in the reference image. The experimental results show that proposed method is suitable for various real scene highlight removal. It can maximally recover the texture details of the highlight region at the same time to guarantee the peak signal-to-noise ratio and the structure similarity of the image. The visual effect after highlight removal is desirable.

Key words: multi view images, brightness adjustment, homography matrix, high pixel detection, high light removal