Research on Person Re-Identification Based on Background Adaptive Learning

doi:10.3778/j.issn.1002-8331.2110-0376

Abstract

Abstract: The research of person re-identification based on human semantic information has become one of the most prevalent research highlights in recent years. However, most of the existing research based on this still stay in how to extract more accurate semantic information, ignoring the relationship between the semantic information of human body itself and the semantic information of human body and environment. In order to solve the problem, this research proposes a human semantic spatial relationship model based on background adaptive learning. The model can be mainly divided into three parts：semantic separation, rough feature extraction and spatial relation learning. Semantic separation is mainly used to distinguish human semantic information from environmental semantic information, rough feature extraction is mainly used to extract shallow features of different semantic information, and spatial relation learning is mainly used to enhance the above shallow features at the spatial relation level. Extensive experiments show that the method has achieved good results in two groups of public data sets（DukeMTMC-reID, CUHK-03）.

Key words: person re-identification, semantic segmentation, spatial relationship

摘要： 现有的基于语义分割的行人重识别研究大多还是停留在人体语义信息的提取本身，忽视了人体自身语义信息之间以及人体与环境语义信息之间的相互关系，为了解决这一问题，此项研究提出了基于背景自适应学习的人体语义空间关系模型。该模型主要分为语义分离，特征粗提取以及空间关系学习三部分，语义分离主要用于区分人体语义信息和环境语义信息，特征粗提取则是用于提取不同语义信息的浅层特征，空间关系学习主要是对上述的浅层特征进行空间关系维度的特征关联。通过广泛的实验证明，该方法在两组公开数据集中（DukeMTMC-reID、CUHK-03）均取得了较好的效果。

关键词: 行人重识别, 语义分割, 空间关系

HE Ruhan, XIONG Jiefan, XIONG Mingfu. Research on Person Re-Identification Based on Background Adaptive Learning[J]. Computer Engineering and Applications, 2023, 59(7): 126-133.

何儒汉, 熊捷繁, 熊明福. 基于背景自适应学习的行人重识别算法研究[J]. 计算机工程与应用, 2023, 59(7): 126-133.

References

[1] AHMED S M，LEJBOLLE A R，PANDA R，et al.Camera on-boarding for person re-identification using hypothesis transfer learning[C]//Proceedings of the IEEE/CVF Conference on Computer Vision and Pattern Recognition，2020：12144-12153.
[2] 周智恒，刘楷怡，黄俊楚，等.一种基于等距度量学习策略的行人重识别改进算法[J].电子与信息学报，2019，41（2）：477-483.
ZHOU Z H，LIU K Y，HUANG J C，et al.Improved metric learning algorithm for person re-identification based on equidistancep[J].Journal of Electronics & Information Technology，2019，41（2）：477-483.
[3] SUN Y，ZHENG L，YANG Y，et al.Beyond part models：person retrieval with refined part pooling（and a strong convolutional baseline）[C]//Proceedings of the European Conference on Computer Vision（ECCV），2018：480-496.
[4] ZHANG Z，SI T，LIU S.Integration convolutional neural network for person re-identification in camera networks[J].IEEE Access，2018，6：36887-36896.
[5] SUH Y，WANG J，TANG S，et al.Part-aligned bilinear representations for person re-identification[C]//Proceedings of the European Conference on Computer Vision（ECCV），2018：402-419.
[6] WANG G，YANG S，LIU H，et al.High-order information matters：learning relation and topology for occluded person re-identification[C]//Proceedings of the IEEE/CVF Conference on Computer Vision and Pattern Recognition，2020：6449-6458.
[7] KALAYEH M M，BASARAN E，G?KMEN M，et al.Human semantic parsing for person re-identification[C]//Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition，2018：1062-1071.
[8] ZHU K，GUO H，LIU Z，et al.Identity-guided human semantic parsing for person re-identification[C]//Proceedings of the 16th European Conference，Glasgow，UK，August 23-28，2020：346-363.
[9] RONNEBERGER O，FISCHER P，BROX T.U-Net：convolutional networks for biomedical image segmentation[C]//Proceedings of the International Conference on Medical Image Computing and Computer-Assisted Intervention，2015：234-241.
[10] GONG K，LIANG X，ZHANG D，et al.Look into person：self-supervised structure-sensitive learning and a new benchmark for human parsing[C]//Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition，2017：932-940.
[11] FAN X，LUO H，ZHANG X，et al.SCPNet：spatial-channel parallelism network for joint holistic and partial person re-identification[C]//Proceedings of the Asian Conference on Computer Vision，2018：19-34.
[12] LIU X，ZHANG P，YU C，et al.Watching you：global-guided reciprocal learning for video-based person re-identification[C]//Proceedings of the IEEE/CVF Conference on Computer Vision and Pattern Recognition，2021：13334-13343.
[13] LONG J，SHELHAMER E，DARRELL T.Fully convolutional networks for semantic segmentation[C]//Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition，2015：3431-3440.
[14] ZHAO H，SHI J，QI X，et al.Pyramid scene parsing network[C]//Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition，2017：2881-2890.
[15] CHEN L C，ZHU Y，PAPANDREOU G，et al.Encoder-decoder with atrous separable convolution for semantic image segmentation[C]//Proceedings of the European Conference on Computer Vision，2018：801-818.
[16] HE K，GKIOXARI G，DOLLáR P，et al.Mask R-CNN[C]//Proceedings of the IEEE International Conference on Computer Vision，2017：2961-2969.
[17] CAI H，WANG Z，CHENG J.Multi-scale body-part mask guided attention for person re-identification[C]//Proceedings of the IEEE/CVF Conference on Computer Vision and Pattern Recognition Workshops，2019.
[18] 陈璠，彭力.多层级重叠条纹特征融合的行人重识别[J].计算机科学与探索，2021，15（9）：1753-1761.
CHEN P，PENG L.Person re-identification based on multi-level feature fusion with overlapping stripes[J] Journal of Frontiers of Computer Science and Technology，2021，15（9）：1753-1761.
[19] JIN X，LAN C，ZENG W，et al.Style normalization and restitution for generalizable person re-identification[C]//Proceedings of the IEEE/CVF Conference on Computer Vision and Pattern Recognition，2020：3143-3152.
[20] MIAO J，WU Y，LIU P，et al.Pose-guided feature alignment for occluded person re-identification[C]//Proceedings of the IEEE/CVF International Conference on Computer Vision，2019：542-551.
[21] WANG G，GONG S，CHENG J，et al.Faster person re-identification[C]//Proceedings of the European Conference on Computer Vision，2020：275-292.
[22] ZHOU J，ROY S K，FANG P，et al.Cross-correlated attention networks for person re-identification[J].Image and Vision Computing，2020，100：103931.
[23] SONG C，HUANG Y，OUYANG W，et al.Mask-guided contrastive attention model for person re-identification[C]//Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition，2018：1179-1188.
[24] WANG C，ZHANG Q，HUANG C，et al.Mancs：a multi-task attentional network with curriculum sampling for person re-identification[C]//Proceedings of the European Conference on Computer Vision，2018：365-381.
[25] WANG G，YUAN Y，CHEN X，et al.Learning discriminative features with multiple granularities for person re-identification[C]//Proceedings of the 26th ACM International Conference on Multimedia，2018：274-282.
[26] CHEN B，DENG W，HU J.Mixed high-order attention network for person re-identification[C]//Proceedings of the IEEE/CVF International Conference on Computer Vision，2019：371-381.
[27] ZHENG M，KARANAM S，WU Z，et al.Re-identification with consistent attentive siamese networks[C]//Proceedings of the IEEE/CVF Conference on Computer Vision and Pattern Recognition，2019：5735-5744.
[28] YANG W，HUANG H，ZHANG Z，et al.Towards rich feature discovery with class activation maps augmentation for person re-identification[C]//Proceedings of the IEEE/CVF Conference on Computer Vision and Pattern Recognition，2019：1389-1398.
[29] WU S，GAO L.Multi-level joint feature learning for person re-identification[J].Algorithms，2020，13（5）：111.
[30] LI Y，YAO H，ZHANG T，et al.Part-based structured representation learning for person re-identification[J].ACM Transactions on Multimedia Computing，Communications，and Applications（TOMM），2020，16（4）：1-22.
[31] CHEN F，WANG N，TANG J，et al.A feature disentangling approach for person re-identification via self-supervised data augmentation[J].Applied Soft Computing，2021，100：106939.