Abstract: In order to solve the feature point location problem of describing the mouth appearance，a new method to locate lip feature point from video is proposed based on the fact that the lip color and skin-color are varied in the color space.This paper first extracts frames from digital video，locates and extracts oral area，then classifies oral area into lip and non-lip area by the Support Vector Machine.At last，based on knowledge about the structure of the mouth area to realize feature points location.The experiment results prove that the proposed method is accurate and robust.