DRL-Based Pricing-Driven for Task Offloading and Dynamic Resource in Vehicle Edge Computing
Sijun Wu, Liang Yang, Junjie Li, Hongzhi Guo, Ishtiaq Ahmad, Daniel Benevides da Costa, Hongbo Jiang, Dusit Niyato
Abstract
Vehicle Edge Computing (VEC) assists vehicles in performing latency-sensitive tasks by deploying resources near the vehicle. Designing an incentive mechanism for vehicles and VEC is crucial for realizing an intelligent transmission system. Considering the rationality of resource allocation, we model the utility functions of the VEC and the vehicle, which are used as optimization objectives. Specifically, the VEC allocates resources through pricing to maximize revenue under resource-constrained conditions, and the vehicle weighs payments against energy consumption to determine offloading and resource allocation. Given the vehicle movement and the variable channel state, we use the Deep Reinforcement Learning (DRL) algorithm to solve these optimization problems. To reduce the learning difficulty of the DRL algorithm in complex VEC scenarios with multiple optimization variables, we propose a Pricing-Driven Resource Allocation (PDRA) algorithm that performs mobility-aware task offloading and calculates the optimal values of the optimization variables in the utility function of the vehicle to reduce the decision dimension. Furthermore, we also propose a DRL-based Pricing-Driven Dynamic Resource Allocation (DPDDRA) algorithm to achieve efficient resource allocation. Extensive experimental results show that the proposed algorithms can reduce the learning difficulty while maximizing VEC and vehicle revenue in complex VEC scenarios.