Learning-Based Adaptive Sliding-Window RLNC for High Bandwidth-Delay Product Networks
Shahzad Shahzad, Rashid Ali, Amir Haider, Hyung Seok Kim
Abstract
Sliding-window random linear network coding (RLNC) is a good fit for achieving low in-order delivery delay in future-generation networks characterized by lossy links. In high bandwidth-delay product networks, however, the issue of integrating RLNC with transmission control protocol (TCP) flow and congestion control poses a significant challenge. In this paper, we propose an innovative reinforcement learning framework that addresses this issue by decoupling the RLNC sliding window from TCP and dynamically adjusting it to enhance network performance in terms of goodput, in-order delivery delay, and decoding complexity. By employing reinforcement learning, we enable autonomous decision-making for adjusting the sliding window of RLNC, which operates independently of TCP. This decoupling allows RLNC to adapt dynamically to the varying conditions of the network, without prior knowledge of its characteristics. By leveraging the benefits of RLNC and TCP separately, we achieve more efficient and effective utilization of network resources. The results highlight significant improvements in goodput, in-order delivery delay, and decoding complexity. Goodput is improved by up to 11 %, the in-order delivery delay is reduced by a factor of 9 %, and coding complexity shows an improvement of up to 45% compared to the state-of-the-art.