关键词: 人体行为识别, 显著性检测, 稠密轨迹, Fisher Vector

Abstract: Human action recognition based on dense trajectories samples the whole image of every frame densely, which leads to high feature dimensionality, large computational cost and containing the irrelevant background information. A human action recognition method is proposed based on dense trajectories with saliency detection. First, a multi-scale static saliency detection is used to get the action subject positions, which then is combined with the results of dynamic saliency detection to get human action areas. The original algorithm is improved by only extracting dense trajectories in these areas. To enhance adequacy of feature expression, Fisher vector is used to replace BOW model encoding the features. At last, SVM is used to get the results of human action recognition. The experimental results conducted on KTH dataset and UCF Sports dataset show that the proposed method has improved on the recognition accuracy compared with the original algorithm.

Key words: human action recognition, saliency detection, dense trajectories, Fisher Vector