Cost-Efficient Continuous Edge Learning for Artificial Intelligence of Things
Lin Jia, Zhi Zhou, Fei Xu, Hai Jin
Abstract
The accelerating convergence of artificial intelligence (AI) and Internet of Things (IoT) has sparked a recent wave of interest in Artificial Intelligence of Things (AIoT). By exploiting the novel paradigm of edge intelligence, emerging computational intensive and resource demanding AIoT applications can be efficiently supported at the network edge. However, due to the limited resource capacity and/or power budget of the edge node, AIoT applications typically deploy compressed AI models to achieve the goal of low-latency and energy-efficient model inference. However, compressed models inherently suffer from the curse of data drift, i.e., the inference data at the deployment stage diverges from the training data at the training stage, leading to reduced model inference accuracy. To handle this issue, continuous learning has been proposed to periodically retrain the AI models on new data in an incremental manner. In this article, we investigate how to coordinate the edge and the cloud resources to perform cost-efficient continuous learning, with the goal of simultaneously optimizing the model performance (in terms of accuracy and robustness) and resource cost. Leveraging the Lyapunov optimization theory, we design and analyze a cost-efficient optimization framework for making online decisions upon admission control, transmission scheduling, and resource provisioning, for the dynamically arrived new data samples of various AIoT applications. We examine the effectiveness of the proposed framework on navigating the performance–cost tradeoff theoretically and empirically through trace-driven simulations.