Task Offloading and Resource Allocation for Satellite-Terrestrial Integrated Networks
Ting Lyu, Yueqiang Xu, Feifei Liu, Haitao Xu, Zhu Han
Abstract
Low-Earth orbit (LEO) satellite networks can achieve global network coverage without geographical restrictions and are essential to the future communication network. In this article, we study the computing offloading problem in a satellite-terrestrial integrated network for the Internet of Remote Things (IoRT), which aims to reduce the total cost (weighted sum of energy consumption and delay), and jointly offload node selection, offloading ratio, and computational resource allocation to achieve the dynamic management of network resources. First, we propose a hybrid cloud and satellite multilayer multiaccess edge computing (MEC) network architecture that can provide heterogeneous computing resources to terrestrial users. Subsequently, since the problem under consideration is a mixed-integer nonlinear programming problem, we propose a computing offloading algorithm for multiagent reinforcement learning, which is an integration of double deep Q learning (DDQN) and deep deterministic policy gradient (DDPG). The algorithm can learn the optimal policy for actions containing a mixture of discrete and continuous variables. Finally, an optimal computational resource allocation scheme is proposed to improve the task computation efficiency. Simulation results show that the proposed task offloading and resource allocation scheme can achieve reasonable scheduling of computational tasks and optimal allocation of computational resources, reducing the cost of task computation.