Abstract: Disparity estimate is a key technique of multi-view video.Facing a plentiful of environment information in immersive video，this paper presents a efficient method to estimate and refine the disparity.Firstly，the left and right images are smoothed and then segmented based on colors.Secondly，the initial DSD is computed using the matching function，which is found by histogram of pixel gains.Next，a smoothness constraint and a consistency constraint are enforced to refine the DSD.Lastly，some smoothing measures are taken.Experimental results show that more precise and smooth disparity field can be acquired with the proposed method，and it is good for obtaining the intermediate views with high quality.