Reinforcement Learning-designed LSTM for Trajectory and Traffic Flow Prediction
Mostafa Karimzadeh, Ryan Aebi, Allan M. de Souza, Zhongliang Zhao, Torsten Braun, Susana Sargento, Leandro A. Villas
Abstract
Trajectory and traffic flow prediction will play an essential role in Intelligent Transportation Systems (ITS) to enable a whole new set of applications ranging from traffic management to infotainment applications. In this scenario, deep learning approaches such as Recurrent Neural Networks (RNN) and its variant Long Short Term Memory (LSTM) are excellent alternatives due to their ability to learn spatiotemporal dependencies. However, these neural networks tend to be over-complex and hard to design due to the broad set of hyper-parameters. We propose an automated framework to predict future trajectories and traffic flows in urban areas without human interventions. We employ Reinforcement Learning (RL) and Transfer Learning (TL) to generate high-performance LSTM predictors, which is referred as RL-LSTM. In addition, we introduce HERITOR (High ordE r tR affI c convoluTiOn R 1-lstm), a novel deep learning algorithm for traffic flow prediction. Specifically, HERITOR attempts to capture pure spatiotemporal features of urban traffic. The extracted features are fed into the RL-LSTM to realize a high performance LSTM for traffic flow prediction. We examine the proposed trajectory and traffic flow predictors on two real-world, large-scale datasets and observe consistent improvements of 15% - 25% over the state-of-the-art.