Taxi Destination Prediction Based on Convolution, Attention and Multilayer Perceptron

doi:10.3778/j.issn.1002-8331.2203-0168

Abstract

Abstract: Taxi destination prediction based on location services is an important aspect for reasonable planning of urban transportation. However, there exist problems of data sparsity and single feature of trajectory data, which affect the accuracy of destination prediction. To address the problem of data sparsity, the original taxi trajectory data（i. e. taxi speed, direction angle, and time） is combined with trajectory truncation method to determine the model input features, thus overcoming data sparsity. To address the problems of excessive parameters and overfitting caused by a large number of parameters of the multilayer perceptron（MLP）, a parameter sharing mechanism based on convolution is proposed to solve parameter redundancy. Furthermore, an attention mechanism is used to allocate more computing resources to more important tasks, focusing on important information to improve the prediction performance of the model. Based on this, a taxi destination prediction method（CCMLP） that combines convolution, attention modules, and MLP is proposed, which achieves more accurate destination prediction while overcoming the structural deficiencies of MLP and convolution. The reliability of the CCMLP model is verified through different data and experiments. The experimental results show that selecting the trajectory features of the first m points and the last n points, as well as their corresponding direction angles, speeds, license plate numbers, and time features as the input features of the model can effectively improve the accuracy of destination prediction. The proposed CCMLP method has good feature learning ability. Compared with the MLP prediction model, the distance error is reduced by 10%, and compared with the ensemble learning algorithm, the distance error is reduced by 19.6%. The CCMLP model’s generalization ability for different data distributions is verified by dividing the data set based on weekdays and weekends, with distance losses of 2.25 km and 2.23 km respectively. The effect of different trajectory completeness on destination prediction is verified based on the first ten points of the trajectory, with distance losses of 2.23 km, 1.80 km, 0.97 km, and 0.68 km for completeness rates of 40%, 60%, 80%, and complete trajectories respectively.

Key words: taxi trajectory, destination prediction, Xiamen Island, neural network, attention module, multilayer perceptron

摘要： 出租车目的地预测是基于位置服务的重要内容，对城市交通合理规划具有重要意义。基于出租车历史轨迹数据进行出行目的地预测，存在数据稀疏性问题与轨迹数据的特征单一性问题，影响目的地预测的精度。针对数据稀疏问题，利用出租车原始轨迹数据（出租车速度、行驶方向角和时间）结合轨迹截断方法确定模型输入特征，克服轨迹稀疏性问题。针对多层感知机具有参数过多、训练困难和大量参数导致较快的过拟合等问题，提出利用卷积的参数共享机制解决参数冗余。进一步提出采用注意力机制使神经网络把更多的计算资源分配给更重要的任务，聚焦重要信息提升模型预测性能。基于此构建了一种融合卷积、注意力模块和多层感知机的出租车目的地预测方法（CCMLP），在克服MLP和卷积各自结构不足的同时，对目的地实现了更为准确的预测，通过不同数据与实验验证CCMLP模型的可靠性。实验结果表明，选取轨迹前[m]点与末[n]点及其对应行驶方向角、速度、车牌号和时间特征作为模型输入特征有效提高目的地预测精度；提出的CCMLP方法具有较好特征学习能力，相比于基于MLP预测模型的距离误差下降了10%，相比于基于集成学习算法的距离误差下降了19.6%；基于工作日与非工作日不同数据分布数据集划分，基于CCMLP目的地预测模型距离损失分别为2.25?km与2.23?km，验证了CCMLP对于不同数据分布的泛化能力；基于轨迹前十点，40%、60%、80%不同完整度轨迹得到的距离损失分别为2.23?km、1.80?km、0.97?km、0.68?km，验证给定不同轨迹完整度对目的地预测的影响。

关键词: 出租车轨迹, 目的地预测, 厦门岛, 神经网络, 注意力模块, 多层感知机

YU Danqing, WU Qunyong, YAO Jiangtao, KUANG Jiaheng. Taxi Destination Prediction Based on Convolution, Attention and Multilayer Perceptron[J]. Computer Engineering and Applications, 2023, 59(11): 302-311.

余丹青, 邬群勇, 姚江涛, 邝嘉恒. 融合卷积、注意力和MLP的出租车目的地预测[J]. 计算机工程与应用, 2023, 59(11): 302-311.

References

[1] JIANG F，LU Z，GAO M，et al.DP-BPR：destination prediction based on Bayesian personalized ranking[J].Journal of Central South University，2021，28（2）：494-506.
[2] ZHANG X，ZHAO Z，ZHENG Y，et al.Prediction of taxi destinations using a novel data embedding method and ensemble learning[J].IEEE Transactions on Intelligent Transportation Systems，2019，21（1）：68-78.
[3] GAMBS S，KILLIJIAN M O，DEL PRADO CORTEZ M N.Next place prediction using mobility Markov chains[C]//Proceedings of the First Workshop on Measurement，Privacy，and Mobility，2012：1-6.
[4] MO B，ZHAO Z，KOUTSOPOULOS H N，et al.Individual mobility prediction in mass transit systems using smart card data：an interpretable activity-based hidden Markov approach[J].IEEE Transactions on Intelligent Transportation Systems，2021，23（8）：12014-12026.
[5] GAO J X，JUAN Z C，NI A N.Modeling and application of traveler destination selection behavior based on Bayesian network[J].Journal of System & Management，2015，24（1）：32-37.
[6] ZONG F，TIAN Y，HE Y，et al.Trip destination prediction based on multi-day GPS data[J].Physica A：Statistical Mechanics and its Applications，2019，515：258-269.
[7] NETO F D N，DE SOUZA BAPTISTA C，CAMPELO C E C.Combining Markov model and prediction by partial matching compression technique for route and destination prediction[J].Knowledge-Based Systems，2018，154：81-92.
[8] LI X，LI M，GONG Y J，et al.T-DesP：destination prediction based on big trajectory data[J].IEEE Transactions on Intelligent Transportation Systems，2016，17（8）：2344-2354.
[9] REZAIE R，LI X R.Destination-directed trajectory modeling，filtering，and prediction using conditionally Markov sequences[J].IEEE Transactions on Aerospace and Electronic Systems，2020，57（2）：820-833.
[10] YANG Z，SUN H，HUANG J，et al.An efficient destination prediction approach based on future trajectory prediction and transition matrix optimization[J].IEEE Transactions on Knowledge and Data Engineering，2018，32（2）：203-217.
[11] WANG X，LIAO C，CHEN C，et al.O2D：an uncooperative taxi-passenger’s destination predication system via deep neural networks[J].Peer-to-Peer Networking and Applications，2021：1-14.
[12] ZHANG L，ZHANG G，LIANG Z，et al.Multi-features taxi destination prediction with frequency domain processing[J].PloS One，2018，13（3）：e0194629.
[13] TSILIGKARIDIS A，ZHANG J，TAGUCHI H，et al.Personalized destination prediction using transformers in a contextless data setting[C]//2020 International Joint Conference on Neural Networks（IJCNN），2020：1-7.
[14] DE BRéBISSON A，SIMON é，AUVOLAT A，et al.Artificial neural networks applied to taxi destination prediction[J].arXiv：1508.00021，2015.
[15] ZHANG L，ZHANG G，LIANG Z，et al.Predicting taxi destination by regularized RNN with SDZ[J].IEICE Transactions on Information and Systems，2018，101（8）：2141-2144.
[16] ROSSI A，BARLACCHI G，BIANCHINI M，et al.Modelling taxi drivers’ behaviour for the next destination prediction[J].IEEE Transactions on Intelligent Transportation Systems，2019，21（7）：2980-2989.
[17] WANG W，ZHAO X，GONG Z，et al.An attention-based deep learning framework for trip destination prediction of sharing bike[J].IEEE Transactions on Intelligent Transportation Systems，2020，22（7）：4601-4610.
[18] JIANG J，LIN F，FAN J，et al.A destination prediction network based on spatiotemporal data for bike-sharing[J].Complexity，2019（3）：1-14.
[19] ENDO Y，NISHIDA K，TODA H，et al.Predicting destinations from partial trajectories using recurrent neural network[C]//Pacific-Asia Conference on Knowledge Discovery and Data Mining.Cham：Springer，2017：160-172.
[20] EBEL P，G?L I E，LINGENFELDER C，et al.Destination prediction based on partial trajectory data[C]//2020 IEEE Intelligent Vehicles Symposium（IV），2020：1149-1155.
[21] LV J，LI Q，SUN Q，et al.T-CONV：a convolutional neural network for multi-scale taxi trajectory prediction[C]//2018 IEEE International Conference on Big Data and Smart Computing，2018：82-89.
[22] TANG J，LIANG J，YU T，et al.Trip destination prediction based on a deep integration network by fusing multiple features from taxi trajectories[J].IET Intelligent Transport Systems，2021，15：1131-1141.
[23] SONG Z，WU K，SHAO J.Destination prediction using deep echo state network[J].Neurocomputing，2020，406：343-353.
[24] WOO S，PARK J，LEE J Y，et al.CBAM：convolutional block attention module[C]//Proceedings of the European Conference on Computer Vision（ECCV），2018：3-19.