A Hybrid Method for Traffic Incident Detection Using Random Forest-Recursive Feature Elimination and Long Short-Term Memory Network With Bayesian Optimization Algorithm
Qiang Shang, Linlin Feng, Song Gao
Abstract
Automatic Incident Detection (AID) is an important part of Intelligent Transportation Systems (ITS). A hybrid AID method using Random Forest-Recursive Feature Elimination (RF-RFE) algorithm and Long-Short Term Memory (LSTM) network optimized by Bayesian Optimization Algorithm (BOA) is proposed in this article. Firstly, a relatively comprehensive set of initial variables is constructed using basic traffic variables and their combinations. Secondly, feature variables are selected from the initial variables using the RF-RFE algorithm. Then, the feature variables are used for training the LSTM network, and the hyper-parameters of the LSTM network are optimized by BOA. In addition, Synthetic Minority Over-Sampling Technique (SMOTE) is employed to solve the problem of imbalance between incident sample size and non-incident sample size. Finally, experiments are conducted using real-world data to test performance of the proposed method and compare with several state-of-the-art AID methods on multiple evaluation criteria. The experimental results illustrate that the proposed method achieved superior performance with respect to almost all the evaluation criteria. It also shows that the proposed method is promising for dealing with the problems of imbalance and small sample size of traffic incident data.