LLM-Assisted Reinforcement Learning: Leveraging Lightweight Large Language Model Capabilities for Efficient Task Scheduling in Multi-Cloud Environment
Xuhao Tang, Fagui Liu, Dishi Xu, Jun Jiang, Quan Tang, Bin Wang, Qingbo Wu, C. L. Philip Chen
Abstract
In the contemporary landscape of large language models (LLMs) development, it is crucial to address the challenges of deploying these models on hardware-constrained consumer electronic devices (CEDs), especially within complex dynamic task scheduling in multi-cloud environments (MCE). We propose a novel methodology leveraging a lightweight LLM to enhance task scheduling decisions in MCE.Our approach involves creating a task scheduling expert database informed by optimization objectives to fine-tune the lightweight LLM. This enables the model to generate a schedulable candidate set of tasks based on the current state of tasks and operational conditions within CEDs across MCE, optimizing scheduling decisions and enhancing overall efficiency. Simulations using both synthetic and real-world datasets demonstrate that our method outperforms three other algorithms in cost minimization, makespan reduction, and energy consumption. In summary, our methodology empowers CEDs to optimize the utilization of multi-cloud resources and harness the capabilities of lightweight LLMs to effectively minimize makespan, operational costs, and energy consumption during the task scheduling process, thereby facilitating efficient task scheduling.