Machine-Learning-Based Optimal Cooperating Node Selection for Internet of Underwater Things
Ishtiaq Ahmad, Ramsha Narmeen, Zeeshan Kaleem, Ahmad Almadhor, Yazeed Alkhrijah, Pin‐Han Ho, Chau Yuen
Abstract
Multihop communication has gained prominence within the realm of the Internet of Underwater Things (IoUT) owing to its exceptional reliability amidst the challenges posed by the underwater acoustic environment. Despite this, the persistence of limitations caused by propagation delay, high collision rate, and limited energy in underwater communication remains, representing the most formidable hurdles in ensuring the successful transmission of data gathered by sensor nodes. To address these challenges, we employ a machine learning (ML)-based optimal cooperating node selection for each hop, considering the Shortest propagation delay, minimal residual Energy, and a low Collision rate (referred to as SEC). For this purpose, we initially assemble the sensor nodes to create a list of cooperative nodes, considering the aspect of SEC. Then, using an assembled list of cooperating sensor nodes, we employ ML-based algorithms, such as reinforcement learning (RL-SEC), deep Q-networks (DQN-SEC), and deep deterministic policy gradient (DDPG-SEC), to predict the optimal cooperating node for each hop. The simulation results of the DDPG-SEC demonstrate a significant improvement of approximately 56% when compared with RL-SEC, DQN-SEC, and other state-of-the-art techniques.