A Bilevel Graph Reinforcement Learning Method for Electric Vehicle Fleet Charging Guidance
Qiang Xing, Yan Xu, Zhong Chen
Abstract
This letter proposes a bilevel graph reinforcement learning method for electric vehicle (EV) fleet charging guidance, achieving collaborative optimization of the transportation-electrification coupled system. A dual-agent architecture is first constructed, where the upper-level is used for charging and the lower-level is used for routing. The EV traveling and charging behavior is characterized as a graph-structured interaction process. A graph attention network (GAT) is leveraged to extract the topology correlation and feature information. Then the extracted topology embedded with knowledge, as intermediate latent environment states, is fed into the underlying network of deep reinforcement learning (DRL). A DRL-based sequential scheduling pattern is developed to realize the guidance of multiple EVs. Extensive experimental results verify the superiority and adaptability of our proposed methodology.