Exploring Interpretability of Attention Mechanism Based on Mobility Pattern
WENG Xiaoxiong, TIAN Dan, QIN Zhenlin1, LUO Ruifa
1.School of Civil Engineering and Transportation, South China University of Technology, Guangzhou 510630, China
2.Shenzhen Genvict Technologies Co. Ltd., Shenzhen, Guangdong 518000, China
WENG Xiaoxiong, TIAN Dan, QIN Zhenlin, LUO Ruifa. Exploring Interpretability of Attention Mechanism Based on Mobility Pattern[J]. Computer Engineering and Applications, 2022, 58(24): 284-290.
[1] JIANG R,SONG X,FAN Z,et al.Deep ROI-based modeling for urban human mobility prediction[J].Proceedings of the ACM on Interactive,Mobile,Wearable and Ubiquitous Technologies,2018,2(1):1-29.
[2] FENG J,LI Y,YANG Z,et al.Predicting human mobility with semantic motivation via multi-task attentional recurrent networks[J].IEEE Transactions on Knowledge and Data Engineering,2022,34(5):2360-2374.
[3] POUYANFAR S,SADIQ S,YAN Y,et al.A survey on deep learning:algorithms,techniques,and applications[J].ACM Computing Surveys(CSUR),2018,51(5):1-36.
[4] HU D.An introductory survey on attention mechanisms in NLP problems[C]//Proceedings of SAI Intelligent Systems Conference.Cham:Springer,2019:432-448.
[5] XIE Q,MA X,DAI Z,et al.An interpretable knowledge transfer model for knowledge base completion[J].arXiv:1704.05908,2017.
[6] JAIN S,WALLACE B C.Attention is not explanation[J].arXiv:1902.10186,2019.
[7] WIEGREFFE S,PINTER Y.Attention is not not explanation[J].arXiv:1908.04626,2019.
[8] VASHISHTH S,UPADHYAY S,TOMAR G S,et al.Attention interpretability across NLP tasks[J].arXiv:1909.11218,2019.
[9] LI F,GUI Z,ZHANG Z,et al.A hierarchical temporal attention-based LSTM encoder-decoder model for individual mobility prediction[J].Neurocomputing,2020,403:153-166.
[10] SERRANO S,SMITH N A.Is attention interpretable?[J].arXiv:1906.03731,2019.
[11] 项煜,陈晓旭,杨超,等.基于地铁售检票系统刷卡数据的乘客出行模式分析[J].城市轨道交通研究,2020,23(6):63-67.
XIANG Y,CHEN X X,YANG C,et al.Analysis of passengers travel patterns based on subway automatic fase collection system smart card data[J].Urban Mass Transit,2020,23(6):63-67.
[12] WANG S,ZHOU W,JIANG C.A survey of word embeddings based on deep learning[J].Computing,2020,102(3):717-740.
[13] BAHDANAU D,CHO K,BENGIO Y.Neural machine translation by jointly learning to align and translate[J].arXiv:1409.0473,2014.
[14] VIROSZTEK D.The metric property of the quantum Jensen-Shannon divergence[J].Advances in Mathematics,2021,380:107595.
[15] 徐雅芸,曾碧,梁天恺,等.面向家居用户行为预测的Bi GRU-DAtt模型研究[J].计算机工程与应用,2020,56(12):237-242.
XU Y Y,ZENG B,LIANG T K,et al.Research on Bi GRU-DAtt model for home user behavior prediction[J].Computer Engineering and Applications,2020,56(12):237-242.
[16] DRUZHKOV P N,KUSTIKOVA V D.A survey of deep learning methods and software tools for image classification and object detection[J].Pattern Recognition and Image Analysis,2016,26(1):9-15.