Nonlinear Impairment-Aware RMSA Under the Sliding Scheduled Traffic Model for EONs Based on Deep Reinforcement Learning
Yucong Zou, Xiaofeng Cai, Min Zhu, Jiahua Gu, Yunwu Wang, Zhao Guo, Chenglin Shi, Jiao Zhang, Yuancheng Cai, Mingzheng Lei
Abstract
The elastic optical network (EON) can accommodate dynamic and diverse demands of next-generation applications by provisioning flexible lightpaths for them. Consequently, blocking probability of these requests can be reduced especially in sliding scheduled traffic, where requests are scheduled to start well after their arrival. In this paper, a nonlinear impairment-aware routing, modulation and spectrum assignment (NLI-RMSA) problem was investigated and modeled under a sliding scheduled traffic model. We proposed a novel dynamic resource allocation scheme in EONs based on deep reinforcement learning (DRL) to jointly determine the path, modulation format and scheduling time of the lightpath requests. Several designed methods consider the nonlinear impairment in the physical layer to accurately estimate the channel state and increase the feasibility of the allocation scheme. Simulation results on the 14-node NSFNET topology demonstrate that the proposed DRL-based method greatly outperforms the two baseline heuristics, potentially saving at least 38.7% more blocking probability than the baseline heuristics.