Joint Optimization of Caching and Computation in Multi-Server NOMA-MEC System via Reinforcement Learning
Shilu Li, Baogang Li, Wei Zhao
Abstract
With the development of emerging applications such as augmented reality, more and more computing tasks are sensitive to delay. Caching popular task computation results on the mobile edge computing (MEC) server is an effective solution to meet the latency requirements. When multiple users request the same task, if the computation result is cached on the MEC server, it will return the computation result directly to the user to reduce the delay for repeated computation. In this paper, we use the caching to assist the calculation. Non-orthogonal multiple access (NOMA) is used to further reduce the delay for computation offloading. The optimization problem is formulated as how to make caching and offloading decision to minimize the delay of whole system. In the case of unknown popularity, we use Gated Recurrent Unit (GRU) algorithm to predict the task popularity in time-varying system, and place the computing results of tasks with high popularity on the corresponding server. Based on the predicted popularity, a multi-agent Deep-Q-network (MADQN) algorithm is used to solve the caching and offloading problem. The simulation results show that the prediction error of GRU algorithm can be reduced by increasing the learning rate. Meanwhile, the proposed MADQN can effectively reduce the delay compared with other methods.