Reinforcement Learning for a Cellular Internet of UAVs: Protocol Design, Trajectory Control, and Resource Management
Jingzhi Hu, Hongliang Zhang, Lingyang Song, Zhu Han, H. Vincent Poor
Abstract
Unmanned aerial vehicles (UAVs) can be powerful Internet of Things components to execute sensing tasks over the next-generation cellular networks, which are generally referred to as the cellular Internet of UAVs. However, due to the high mobility of UAVs and shadowing in airto-ground channels, UAVs operate in a dynamic and uncertain environment. Therefore, UAVs need to improve the quality of service of sensing and communication without complete information, which makes reinforcement learning suitable for use in the cellular Internet of UAVs. In this article, we propose a distributed sense-and-send protocol to coordinate UAVs for sensing and transmission. Then we apply reinforcement learning in the cellular Internet of UAVs to solve key problems such as trajectory control and resource management. Finally, we point out several potential future research directions.