Abstract: The detection of driver’s fatigue has broad application prospects and realistic meanings in numerous fields.In order to overcome the influence of the different figure with different drivers，the deflection and inclines of driver’s face，Combining the space land characteristic of the internal form of human eye，the Pseudo-Zernike moments of the land varied characteristic of the internal form of human eye，the technology of template matched，and using the sorter with the lattice degree of nearness to judge the eye state.The results show that the accuracy of this method is proved high and slightly influenced by the factor of environmental，the velocity also meets the demands of the video’s information processing.