Abstract: In order to simultaneously calculate the temporal and spatial feature of behavior sequence samples, a convolution neural network recognition model with multi-scale convolution operator is proposed. Firstly, the skeleton vector in the sequence sample is integrated into a behavior matrix by superposition. Then the matrix is input into the recognition model. The convolution operators in each layers of the convolution neural network are extended to the multi-scale convolution operator in order to excavate the role of the bone points with different adjacency relations in describing human behavior, and the features obtained by this network are used to action identify. Experiments on MSR-Action3D dataset and HDM05 dataset achieve better recognition rate.

Key words: human action recognition, spatial-temporal feature, deep convolution network, deep learning, action matrix

摘要： 为了同时计算行为序列样本在时间和空间的特征，提出了一种基于包含多尺度卷积算子的卷积神经网络识别模型。首先通过叠加的方式将序列样本中的骨骼向量信息整合为一个行为矩阵，然后将矩阵输入识别模型。为了挖掘具有不同邻接关系的骨骼点在描述人体行为时的作用，将卷积神经网络各层中的卷积算子拓展为多尺度卷积算子，并使用该网络得到的特征进行分类。实验在MSR-Action3D数据集和HDM05数据集获得较好的识别率。

关键词: 行为识别, 时空特征, 深度卷积神经网络, 深度学习, 行为矩阵