Abstract: In order to overcome the deficiency of updating the background model and removing the shadow when the background subtraction method is applied to detect moving objects，an improved algorithm based on the single-Gaussian background model is proposed.The experimental results indicate that the algorithm can remove the shadow and extract the moving object effectively，which lays a solid foundation for the following work such as body recognization，behavior analysis and so on.