Litcius/Paper detail

LW-GCN: A Lightweight FPGA-based Graph Convolutional Network Accelerator

Zhuofu Tao, C.-L. Wu, Yuan Liang, Kun Wang, Lei He

2022ACM Transactions on Reconfigurable Technology and Systems37 citationsDOIOpen Access PDF

Abstract

Graph convolutional networks (GCNs) have been introduced to effectively process non-Euclidean graph data. However, GCNs incur large amounts of irregularity in computation and memory access, which prevents efficient use of traditional neural network accelerators. Moreover, existing dedicated GCN accelerators demand high memory volumes and are difficult to implement onto resource limited edge devices. In this work, we propose LW-GCN, a lightweight FPGA-based accelerator with a software-hardware co-designed process to tackle irregularity in computation and memory access in GCN inference. LW-GCN decomposes the main GCN operations into Sparse Matrix-Matrix Multiplication (SpMM) and Matrix-Matrix Multiplication (MM). We propose a novel compression format to balance workload across PEs and prevent data hazards. Moreover, we apply data quantization and workload tiling, and map both SpMM and MM of GCN inference onto a uniform architecture on resource limited hardware. Evaluation on GCN and GraphSAGE are performed on Xilinx Kintex-7 FPGA with three popular datasets. Compared to existing CPU, GPU, and state-of-the-art FPGA-based accelerator, LW-GCN reduces latency by up to 60×, 12×, and 1.7× and increases power efficiency by up to 912×, 511×, and 3.87×, respectively. Furthermore, compared with NVIDIA’s latest edge GPU Jetson Xavier NX, LW-GCN achieves speedup and energy savings of 32× and 84×, respectively.

Topics & Concepts

Computer scienceField-programmable gate arraySpeedupHardware accelerationParallel computingMatrix multiplicationComputationConvolutional neural networkEmbedded systemAlgorithmArtificial intelligenceQuantumQuantum mechanicsPhysicsAdvanced Graph Neural NetworksFerroelectric and Negative Capacitance DevicesGraph Theory and Algorithms
LW-GCN: A Lightweight FPGA-based Graph Convolutional Network Accelerator | Litcius