Blockchain-Empowered Asynchronous Federated Reinforcement Learning for IoT-Based Traffic Trajectory Prediction
Bin Wang, Zhao Tian, Fengxiao Tang, Heng Pan, Wei She, Wei Liu
Abstract
Vehicle trajectory prediction plays a crucial role in IoT-based intelligent transportation systems, which can effectively address key issues, such as driving safety and multivehicle collaboration. However, the sensitivity of trajectory data and the reluctance of data holders to share it constrain the prediction model’s ability to capture vehicle behavior patterns in different scenarios. To address the above problems, we propose a blockchain-enabled asynchronous federated proximal policy optimization framework (BE-AFPPO) for the trajectory prediction of self-driving vehicles. First, we propose a curiosity proximal policy optimization (C-PPO) algorithm. The method utilizes a driven exploration strategy to actively motivate the intelligent agent to explore the unknown state space. The avoidance policy model reaches a local optimum when processing trajectory data. In addition, we design historical gated recurrent unit (GRU) and future GRU as input layers. The target’s historical motion features and future trajectory features are extracted, respectively. Then, various data is received through asynchronous federated learning. This model can fully learn the vehicle’s behavior patterns in different scenarios, which improves prediction accuracy. Based on this, we develop a blockchain-based dynamic group practical Byzantine fault tolerance (DG-PBFT) consensus algorithm. This enhances the credibility and integrity of the data while enriching the sources of trajectory data. Finally, we perform the experiments on the publicly available dataset nuScenes. The results demonstrate that the proposed method improves the robustness and accuracy of trajectory prediction.