Self-Supervised Graph Neural Networks for Session-Based Recommendation

doi:10.3778/j.issn.1002-8331.2204-0245

Abstract

Abstract: Compared with traditional recommendation methods, session-based recommendation methods are more susceptible to the data sparsity problem due to the limited data of short-term user interaction. In order to enhance session data and alleviate the impact of datas parseness on session recommendation performance, a model named self-supervised graph neural networks for session-based recommendation（Ss-GNN） is proposed. It constructs asession graph and establishes a session recommendation task based on graph attention network to obtain the item-level and session-level representation. Then, from the perspective of the session-level representation, it uses the user’s general and current interests to construct an auxiliary task to obtain self-supervised signals.It utilizes self-supervised learning to maximize mutual information between the recommendation task and the auxiliary task to enhance session data and improve recommendation performance. Experiments are conducted on two public data sets, Yoochoose and Tmall. Compared with the baseline model, the proposed model improves at least 0.94% and 0.79% in P@20 and MRR@20 on Yoochoose, 9.61% and 4.67% in P@20 and MRR@20 on Tmall, which proves the effectiveness of Ss-GNN model.

Key words: session recommendation, self-supervised learning, data sparsity, graph neural network

摘要： 基于会话的推荐方法由于短期用户交互数据有限，与传统推荐方法相比，其性能更容易受到数据稀疏性问题的影响。为增强会话数据以缓解数据稀疏对会话推荐性能的影响，提出一种结合自监督学习的图神经网络会话推荐（Ss-GNN）模型。构建会话图并建立基于图注意力网络的会话推荐任务来获取项目级表示和会话级表示；从会话级表示的角度出发，利用用户的一般兴趣和当前兴趣来构建辅助任务获取自监督信号；利用自监督学习实现推荐任务和辅助任务之间的互信息最大化，以增强会话数据，从而提升推荐性能。在Yoochoose和Tmall两个公开数据集上进行实验，与基线模型相比，提出的模型在Yoochoose上P@20和MRR@20至少提升了0.94%和0.79%，在Tmall上P@20和MRR@20至少提升了9.61%和4.67%，证明了Ss-GNN模型的有效性。

关键词: 会话推荐, 自监督学习, 数据稀疏性, 图神经网络

WANG Yonggui, ZHAO Xiaoxuan. Self-Supervised Graph Neural Networks for Session-Based Recommendation[J]. Computer Engineering and Applications, 2023, 59(3): 244-252.

王永贵, 赵晓暄. 结合自监督学习的图神经网络会话推荐[J]. 计算机工程与应用, 2023, 59(3): 244-252.

References

[1] 黄立威，江碧涛，吕守业，等.基于深度学习的推荐系统研究综述[J].计算机学报，2018，41（7）：1619-1647.
HUANG L W，JIANG B T，LV S Y，et al.Survey on deep learning based recommender systems[J].Chinese Journal of Computers，2018，41（7）：1619-1647.
[2] WANG S，CAO L，WANG Y，et al.A survey on session-based recommender systems[J].ACM Computing Surveys（CSUR），2021，54（7）：1-38.
[3] GAO C，ZHENG Y，LI N，et al.Graph neural networks for recommender systems：challenges，methods，and directions[J].arXiv：2109.12843，2021.
[4] LIU X，ZHANG F，HOU Z，et al.Self-supervised learning：generative or contrastive[J].IEEE Transactions on Knowledge and Data Engineering，2021，35（1）：857-876.
[5] KOREN Y，BELL R，VOLINSKY C.Matrix factorization techniques for recommender systems[J].Computer，2009，42（8）：30-37.
[6] RENDLE S，FREUDENTHALER C，SCHMIDT-THIEME L.Factorizing personalized markov chains for next-basket recommendation[C]//Proceedings of the 19th International Conference on World Wide Web，2010：811-820.
[7] HIDASI B，KARATZOGLOU A，BALTRUNAS L，et al.Session-based recommendations with recurrent neural networks[J].arXiv：1511.06939，2015.
[8] LI J，REN P，CHEN Z，et al.Neural attentive session-based recommendation[C]//Proceedings of the 2017 ACM on Conference on Information and Knowledge Management，2017：1419-1428.
[9] LIU Q，ZENG Y，MOKHOSI R，et al.STAMP：short-term attention/memory priority model for session-based recommendation[C]//Proceedings of the 24th ACM SIGKDD International Conference on Knowledge Discovery & Data Mining，2018：1831-1839.
[10] WU S，TANG Y，ZHU Y，et al.Session-based recommendation with graph neural networks[C]//Proceedings of the AAAI Conference on Artificial Intelligence，2019，33（1）：346-353.
[11] XU C，ZHAO P，LIU Y，et al.Graph contextualized self-attention network for session-based recommendation[C]//28th International Joint Conference on Artifical Intelligence，2019：3940-3946.
[12] YU F，ZHU Y，LIU Q，et al.TAGNN：target attentive graph neural networks for session-based recommendation[C]//Proceedings of the 43rd International ACM SIGIR Conference on Research and Development in Information Retrieval，2020：1921-1924.
[13] QIU R，LI J，HUANG Z，et al.Rethinking the item order in session-based recommendation with graph neural networks[C]//Proceedings of the 28th ACM International Conference on Information and Knowledge Management，2019：579-588.
[14] WANG W，ZHANG W，LIU S，et al.Beyond clicks：modeling multi-relational item graph for session-based target behavior prediction[C]//Proceedings of the Web Conference，2020：3056-3062.
[15] WANG Z，WEI W，CONG G，et al.Global context enhanced graph neural networks for session-based recommendation[C]//Proceedings of the 43rd International ACM SIGIR Conference on Research and Development in Information Retrieval，2020：169-178.
[16] BACHMAN P，HJELM R D，BUCHWALTER W.Learning representations by maximizing mutual information across views[J].Advances in Neural Information Processing Systems，2019，32.
[17] DEVLIN J，CHANG M W，LEE K，et al.Bert：pre-training of deep bidirectional transformers for language understanding[J].arXiv：1810.04805，2018.
[18] ZHOU K，WANG H，ZHAO W X，et al.S3-rec：self-supervised learning for sequential recommendation with mutual information maximization[C]//Proceedings of the 29th ACM International Conference on Information & Knowledge Management，2020：1893-1902.
[19] MA J，ZHOU C，YANG H，et al.Disentangled self-supervision in sequential recommenders[C]//Proceedings of the 26th ACM SIGKDD International Conference on Knowledge Discovery & Data Mining，2020：483-491.
[20] XIE X，SUN F，LIU Z，et al.Contrastive pre-training for sequential recommendation[J].arXiv：2010.14395，2020.
[21] XIA X，YIN H，YU J，et al.Self-supervised hypergraph convolutional networks for session-based recommendation[C]//Proceedings of the AAAI Conference on Artificial Intelligence，2021：4503-4511.
[22] WU Z，PAN S，CHEN F，et al.A comprehensive survey on graph neural networks[J].IEEE Transactions on Neural Networks and Learning Systems，2020，32（1）：4-24.
[23] VASWANI A，SHAZEER N，PARMAR N，et al.Attention is all you need[J].Advances in Neural Information Processing Systems，2017，30.
[24] VELICKOVIC P，FEDUS W，HAMILTON W L，et al.Deep graph infomax[J].arXiv：1809.10341，2018.
[25] TAN Y K，XU X，LIU Y.Improved recurrent neural networks for session-based recommendations[C]//Proceedings of the 1st Workshop on Deep Learning for Recommender Systems，2016：17-22.
[26] SARWAR B，KARYPIS G，KONSTAN J，et al.Item-based collaborative filtering recommendation algorithms[C]//Proceedings of the 10th International Conference on World Wide Web，2001：285-295.
[27] DUAN H，ZHU J.Context-aware short-term interest first model for session-based recommendation[J].arXiv：2103.15514，2021.