Joint UAV Placement Optimization, Resource Allocation, and Computation Offloading for THz Band: A DRL Approach
Heng Wang, Haijun Zhang, Xiangnan Liu, Keping Long, Arumugam Nallanathan
Abstract
With the development of internet of things, latency-sensitive applications such as telemedicine are constantly emerging. Unfortunately, due to the limited computation capacity of wireless user devices, the real-time demands can not be met. Multi-access edge computing (MEC), which enables the deployment of edge access points (E-APs) to support computation-intensive applications, has become an effective way to meet the real-time demands. However, the number of WUDs that E-APs can serve are limited. To increase system capacity, the unmanned aerial vehicle (UAV) assisted computation offloading architecture in the terahertz (THz) band is proposed. In this paper, the problem of UAV placement optimization, resource allocation, and computation offloading is investigated considering the quality of service and resource constraints. The joint optimization problem is non-convex and hard to be solved in time by using traditional algorithms, such as successive convex approximation. Therefore, deep reinforcement learning (DRL) based approach is a promising way to solve the formulated non-convex problem of minimizing latency. Double deep Q-learning (DDQN) and deep deterministic policy gradient (DDPG) algorithms are provided to search for near-optimal solutions in highly dynamic environments. The effectiveness of the proposed algorithms is proved by simulation results in different scenarios.