A Deep Reinforcement Learning-Based QoS Routing Protocol Exploiting Cross-Layer Design in Cognitive Radio Mobile Ad Hoc Networks
Thong‐Nhat Tran, Toan-Van Nguyen, Kyusung Shim, Daniel Benevides da Costa, Beongku An
Abstract
In this paper, we propose a novel deep reinforcement learning-based quality-of-service (QoS) routing protocol, namely DRQR, exploiting cross-layer design to establish efficient QoS (EQS) routes in cognitive radio mobile ad hoc networks. An EQS route is a route with minimum end-to-end (E2E) queuing delay subject to QoS constraints such as link stability, residual energy, number of hops and avoiding licensed channels of primary users. Particularly, we propose an NP-complete optimization problem which has a feasible solution as an EQS route. To tackle this problem, we design a new deep reinforcement learning model which supports the DRQR protocol to establish EQS routes in real time by offline training instead of online training like most of literature studies. Moreover, the DRQR protocol guarantees to have high system performance. A mathematical analysis of the E2E queuing delay with random waypoint mobility model also provides to verify simulation results. Numerical results show that the DRQR protocol outperforms state-of-the-art routing protocols in terms of routing delay, queuing delay, control overhead, PDR and energy consumption.