Salient Detection Model Based on Channel-Spatial Joint Attention Mechanism

doi:10.3778/j.issn.1002-8331.2006-0238

Abstract

Abstract:

Concerning the problems that exist in computer vision, such as saliency areas highlight unevenness and unclear edges, which lead to poor saliency robustness. To solve this problem, a saliency detection model based on channel-spatial joint attention mechanism is proposed. Firstly, it improves the channel attention mechanism and adds the pixel probability values pixel by pixel in the feature map, so as to better obtain the correlation of information between the channels. Then, it integrates the spatial attention mechanism in parallel with the basis of the channel attention mechanism, and the saliency areas with prominent object are received by weighting the spatial information of the feature map. In addition, to obtain a more fine-grained saliency map, the two feature maps output by the channel and spatial attention mechanism are weighted fusion, which fed back to the channel-spatial joint attention mechanism. Sufficient experiments on public datasets DUTS-TE and SOD demonstrate that the proposed method outperforms the others from the value of F-measure and mean absolute error.

Key words: salient detection, channel attention mechanism, spatial attention mechanism

摘要：

针对显著性区域突出不均匀和边缘不清晰导致显著性检测鲁棒性差等问题，提出了一种通道-空间联合注意力机制的显著性检测模型。改进了一种通道注意力机制，将特征图中的像素概率值逐像素相加以更好的获取通道中层间信息的关联性；在通道注意力机制的基础上并行融入了空间注意力机制，对特征图的空间信息进行加权获得目标突出的显著性区域；将通道注意力机制与空间注意力机制输出的两个特征图加权融合反馈至通道-空间联合注意力机制，从而得到细粒度更高的显著图。实验结果表明，该模型在公开的数据集DUTS-TE和SOD上，使用F-measure和平均绝对误差作为评估标准均优于其他同类模型。

关键词: 显著性检测, 通道注意力机制, 空间注意力机制

陈维婧，周萍，杨海燕，杨青，陈睿. 通道-空间联合注意力机制的显著性检测模型[J]. 计算机工程与应用, 2021, 57(19): 214-219.

References

[1] 曾萍萍.图像显著性检测算法研究[D].西安：西安电子科技大学，2018.
ZENG P P.Research on image saliency detection algorithm[D].Xi’an：Xidan University，2018.
[2] ZHANG T Z，XU C S，YANG M H.Multi-task correlation particle filter for robust object tracking[C]//2017 IEEE Conference on Computer Vision and Pattern Recognition（CVPR），2017.
[3] CHEN L C，PAPANDREOU G，KOKKINOS I，et al.DeepLab：Semantic image segmentation with deep convolutional nets，atrous convolution，and fully connected CRFs[J].IEEE Transactions on Pattern Analysis & Machine Intelligence，2018，40（4）：834.
[4] ZHAO R，OUYANG W L，WANG X G.Person reidentification by saliency learning[J].IEEE Transactions on Pattern Analysis and Machine Intelligence，2017，39：356-370.
[5] CHENG M M，ZHANG F L，MITRA N J，et al.RepFinder：Finding approximately repeated scene elements for image editing[J].ACM Transactions on Graphics，2010，29（4）：157-166.
[6] ITTI L，KOCH C，NIEBUR E.A model of saliency-based visual attention for rapid scene analysis[J].IEEE Transactions on Pattern Analysis and Machine Intelligence，1998，20（11）：1254-1259.
[7] CHENG M M，ZHANG G X，MITRA N J，et al.Global contrast based salient region detection[J].Computer Vision & Pattern Recognition，2011，37（3）：409-416.
[8] ZHANG L，DAI J，LU H C，et al.A bi-directional message passing model for salient object detection[C]//IEEE Conference on Computer Vision and Pattern Recognition，2018.
[9] CHEN S H，TAN X L，WANG B，et al.Reverse attention for salient object detection[C]//European Conference on Computer Vision，2018.
[10] FENG M Y，LU H C，DING E R.Attentive feedback network for boundary-aware salient object detection[C]//Internaltional Conference on Computer Vision and Pattern Recogintion，2019.
[11] WOO S H，PARK J C，LEE J Y，et al.CBAM：Convolutional block attention module.[C]//European Conference on Computer Vision，2018.
[12] 王凯诚，鲁华祥，龚国良，等.基于注意力机制的显著性目标检测方法[J].智能系统学报，2020，15（5）：956-963.
WANG K C，LU H X，GONG G L，et al.Salient object detection method based on attention mechanism[J].CAAI Transactions on Intelligent Systems，2020，15（5）：956-963.
[13] LI J X，PAN Z F，LIU Q S，et al.Complementarity-aware attention network for salient object detection[J].IEEE Transactions on Cybernetics，2020，99：1-14.
[14] WANG L J，LU H C，WANG Y F，et al.Learning to detect salient objects with image-level supervision[C]//IEEE Conference on Computer Vision and Pattern Recognition，2017.
[15] YAN Q，XU L，SHI J P，et al.Hierarchical saliency detection[C]//IEEE Conference on Computer Vision and Pattern Recognition，2013.
[16] LI G B，YU Y Z.Visual saliency based on multiscale deep features[C]//IEEE Conference on Computer Vision and Pattern Recognition，2015.
[17] LI Y，HOU X D，CHRISTOF K，et al.The secrets of salient object segmentation[C]//IEEE Conference on Computer Vision and Pattern Recognition，2014.
[18] VIDA M，ELDER J H.Design and perceptual validation of performance measures for salient object segmentation[C]//IEEE Computer Society Conference on Computer Vision & Pattern Recognition Workshops，2010.
[19] QiN X B，ZHANG Z C，HUANG C Y，et al.BASNet：Boundary-aware salient object detection[C]//IEEE/CVF Conference on Computer Vision & Pattern Recognition，2019.
[20] WANG W G，SHEN J B，DONG X P，et al.Salient object detection driven by fixation prediction[C]//IEEE Conference on Computer Vision and Pattern Recognition，2018.
[21] LI X，YANG F，CHENG H，et al.Contour knowledge transfer for salient object detection[C]//European Conference on Computer Vision，2018.
[22] WANG T T，ALI B，ZHANG L H，et al.A stagewise refinement model for detecting salient objects in images[C]//IEEE International Conference on Computer Vision，2017.
[23] CHEN X W，ZHENG A L，LI J，et al.Look，Perceive and segment：Finding the salient objects in images via two-stream fixation?semantic CNNs[C]//IEEE International Conference on Computer Vision，2017.
[24] ZHANG P P，WANG D，LU H C，et al.Learning uncertain convolutional features for accurate saliency detection[C]//IEEE International Conference on Computer Vision，2017.