λGrapher: A Resource-Efficient Serverless System for GNN Serving through Graph Sharing
Haichuan Hu, Fangming Liu, Qiangyu Pei, Yongjie Yuan, Zichen Xu, Lin Wang
Abstract
Graph Neural Networks (GNNs) have been increasingly adopted for graph analysis in web applications such as social networks. Yet, efficient GNN serving remains a critical challenge due to high workload fluctuations and intricate GNN operations. Serverless computing, thanks to its flexibility and agility, offers on-demand serving of GNN inference requests. Alas, the request-centric serverless model is still too coarse-grained to avoid resource waste.
Topics & Concepts
Computer scienceWorkloadDistributed computingFlexibility (engineering)GraphInferenceShared resourceTheoretical computer scienceComputer networkArtificial intelligenceOperating systemMathematicsStatisticsAdvanced Graph Neural NetworksGraph Theory and AlgorithmsCloud Computing and Resource Management