Game-Theoretic Lane-Changing Decision Making and Payoff Learning for Autonomous Vehicles
Victor G. Lopez, Frank L. Lewis, Mushuang Liu, Yan Wan, Subramanya Nageshrao, Dimitar Filev
Abstract
In this paper, the problem of decision making for autonomous vehicles changing lanes is addressed by formulating multiple games in normal form for pairs of agents. This formulation generates the optimal action for the Ego vehicle at a given state and does not consider global optimality for all agents. The payoff matrices of the games are designed based on a user-defined set of rules. The constant parameters of these payoffs are then adjusted using neural learning to generate optimal behavior among the vehicles. An algorithm integrating deep reinforcement learning and game theory, regarded as Nash Q-learning, is included in the decision-making scheme. The applicability of the proposed method in a lane-changing scenario is tested via simulation.