Person Re-Identification Algorithm Combining Attention and Local Feature Fusion

doi:10.3778/j.issn.1002-8331.2011-0235

Abstract

Abstract: Person re-identification refers to finding the pedestrian image most similar to the target from a bunch of candidate pictures, which is a sub-problem of image retrieval. In order to further enhance feature extraction capabilities and suppress noise interference, through studying the person re-recognition algorithm based on attention mechanism and local features, this paper proposes a person re-recognition network combing attention and local features fusion. The network adopts ResNeSt-50 as the backbone network, and uses a dual-stream structure to extract fine-grained global features and fine-grained local features separately. By focusing on the spatial domain information shared by different features and the feature correlation between different horizontal parts, the spatial-aware feature fusion module and cross-region feature fusion module are proposed. On the Market-1501, DukeMTMC-reID and CUHK03 datasets, experimental results verify that the proposed network significantly improves the retrieval capabilities. And it has a superior performance in comparison with existing algorithms.

Key words: attention mechanism, person re-identification, image retrieval, feature fusion, neural network

摘要： 行人重识别是指从一堆候选图片中找到与目标最相似的行人图片，本质上是一个图像检索的子问题。为了进一步增强网络提取关键特征的能力以及抑制噪声的干扰，通过对基于注意力机制和局部特征的行人重识别算法的研究，提出了结合注意力与局部特征融合的行人重识别算法。该算法将ResNeSt-50作为骨干网络，联合软注意力与非局部注意力机制，采用双流结构分别提取行人细粒度全局特征和细粒度局部特征，通过关注不同特征之间共享的空间域信息以及同一特征不同水平区域的潜在语义相关性，创建了空间感知特征融合模块（spatial-aware feature fusion module）以及跨区域特征融合模块（cross-region feature fusion module）。在Market-1501、DukeMTMC-reID以及CUHK03数据集上的实验结果表明该算法极大程度上提升了网络的检索能力，同时与现有算法进行比较，凸显出优越性能。

关键词: 注意力机制, 行人重识别, 图像检索, 特征融合, 神经网络

CHEN Linfeng, LEI Jingsheng, WU Hongyi, ZHUCHEN Sicong, YE Shichao. Person Re-Identification Algorithm Combining Attention and Local Feature Fusion[J]. Computer Engineering and Applications, 2022, 58(14): 282-290.

陈林锋, 雷景生, 吴宏毅, 朱陈思聪, 叶仕超. 结合注意力与局部特征融合的行人重识别算法[J]. 计算机工程与应用, 2022, 58(14): 282-290.

References

[1] LAVI B，SERJ M，ULLAH I.Survey on deep learning techniques for person re-identification task[J].arXiv：1807.05284，
2018.
[2] CHEN D，LI H，LIU X，et al.Improving deep visual representation for person re-identification by global and local image-language association[C]//European Conference on Computer Vision，2018：54-70.
[3] SUN Y，ZHENG L，YANG Y，et al.Beyond part models：person retrieval with refined part pooling（and a strong convolutional baseline）[C]//European Conference on Computer Vision，2018：480-496.
[4] WANG G，YUAN Y，CHEN X，et al.Learning discriminative features with multiple granularities for person re-identification[C]//ACM International Conference on Multimedia，2018：274-282.
[5] SUH Y，WANG J，TANG S，et al.Part-aligned bilinear representations for person re-identification[C]//European Conference on Computer Vsion，2018：402-419.
[6] ZHANG Z，LAN C，ZENG W，et al.Densely semantically aligned person re-identification[C]//IEEE Conference on Computer Vision and Pattern Recognition，2019：667-676.
[7] SUN Y，XU Q，LI Y，et al.Perceive where to focus：learning visibility-aware part-level features for partial person re-identification[C]//IEEE Conference on Computer Vision and Pattern Recognition，2019：393-402.
[8] ZHANG Z，LAN C，ZENG W，et al.Relation-aware global attention for person re-identification[C]//IEEE Conference on Computer Vision and Pattern Recognition，2020：3186-3195.
[9] LI W，ZHU X，GONG S.Harmonious attention network for person re-identification[C]//IEEE Conference on Computer Vision and Pattern Recognition，2018：2285-2294.
[10] CHEN B，DENG W，HU J.Mixed high-order attention network for person re-identification[C]//IEEE International Conference on Computer Vision，2019：371-381.
[11] XIA B，GONG Y，ZHANG Y，et al.Second-order non-local attention networks for person re-identi?cation[C]//IEEE Conference on Computer Vision and Pattern Recognition，2019：3760-3769.
[12] CHEN T，DING S，XIE J，et al.ABD-Net：attentive but diverse person re-identification[C]//IEEE International Conference on Computer Vision，2019：8351-8361.
[13] PARK H，HAM B.Relation network for person re-identification[J].arXiv：1911.09318，2019.
[14] ZHANG H，WU C，ZHANG Z，et al.ResNeSt：split-attention networks[J].arXiv：2004.08955，2020.
[15] ZHENG L，SHEN L，TIAN L，et al.Scalable person re-identification：a benchmark[C]//IEEE International Conference on Computer Vision，2015：1116-1124.
[16] ZHENG Z，ZHENG L，YANG Y.Unlabeled samples generated by GAN improve the person re-identification baseline in vitro[C]//IEEE International Conference on Computer Vision，2017：3754-3762.
[17] LI W，ZHAO R，XIAO T，et al.DeepReID：deep filter pairing neural network for person re-identification[C]//IEEE Conference on Computer Vision and Pattern Recognition，2014：152-159.
[18] HE K，ZHANG X，REN S，et al.Deep residual learning for image recognition[C]//IEEE Conference on Computer Vision and Pattern Recognition，2016：770-778.
[19] 宋丽丽，李彬，赵俊雅，等.正态重采样的改进行人再识别度量学习算法[J].计算机工程与应用，2020，56（8）：158-165.
SONG L L，LI B，ZHAO J Y，et al.Normality resampling of improved metric learning method for person re-identification[J].Computer Engineering and Applications，2020，56（8）：158-165.
[20] 祁磊，于沛泽，高阳.弱监督场景下的行人重识别研究综述[J].软件学报，2020，31（9）：2883-2902.
QI L，YU P Z，GAO Y.Research on weak-supervised person re-identification[J].Software，2020，31（9）：2883-2902.
[21] 邱耀儒，孙为军，黄永慧，等.基于生成对抗网络联合时空模型的行人重识别方法[J].计算机应用，2020，40（9）：2493-2498.
QIU Y R，SUN W J，HUANG Y H，et al.Person re-identification method based on GAN uniting with spatial-temporal pattern[J].Computer Applications，2020，40（9）：2493-2498.
[22] HERMANS A，BEYER L，LEIBE B.In defense of the triplet loss for person re-identification[J].arXiv：1703.07737，
2017.
[23] DENG J，DONG W，SOCHER R，et al.ImageNet：a large-scale hierarchical image database[C]//IEEE Conference on Computer Vision and Pattern Recognition，2009：248-255.
[24] WANG C，ZHANG Q，HUANG C，et al.Mancs：a multi-task attentional network with curriculum sampling for person re-identification[C]//European Conference on Computer Vision，2018：365-381.
[25] WANG G，YUAN Y，CHEN X，et al.Learning discriminative features with multiple granularities for person re-identification[C]//ACM International Conference on Multimedia，2018：274-282.
[26] CHEN G，LIN C，REN L，et al.Self-critical attention learning for person re-identification[C]//IEEE International Conference on Computer Vision，2019：9637-9646.
[27] GUO J，YUAN Y，HUANG L，et al.Beyond human parts：dual part-aligned representations for person re-identification[C]//IEEE International Conference on Computer Vision，2019：3642-3651.
[28] HE L，LIAO X，LIU W，et al.FastReID：a pytorch toolbox for real-world person re-identification[J].arXiv：2006.02631，
2020.
[29] ZHOU K，YANG Y，CAVALLARO A，et al.Omni-scale feature learning for person re-identification[C]//IEEE International Conference on Computer Vision，2019：3702-3712.
[30] ZHENG F，SUN X，JIANG X，et al.Pyramidal person re-identification via multi-loss dynamic training[C]//IEEE Conference on Computer Vision and Pattern Recognition，2019：8514-8522.
[31] SELVARAJU R，COGSWELL M，DAS A，et al.Visual explanations from deep networks via gradient-based localization[C]//IEEE International Conference on Computer Vision，2017：618-626.