AKG: automatic kernel generation for neural processing units using polyhedral transformations
Jie Zhao, Bojie Li, Wang Nie, Zhen Geng, Renwei Zhang, Xiong Gao, Bin Cheng, Chen Wu, Yun Cheng, Zheng Li, Peng Di, Kun Zhang, Xuefeng Jin
Abstract
Existing tensor compilers have proven their effectiveness in deploying deep neural networks on general-purpose hardware like CPU and GPU, but optimizing for neural processing units (NPUs) is still challenging due to the heterogeneous compute units and complicated memory hierarchy.
Topics & Concepts
Computer scienceKernel (algebra)CompilerArtificial neural networkMemory hierarchyParallel computingComputer architectureArtificial intelligenceComputer engineeringProgramming languageMathematicsCombinatoricsCacheParallel Computing and Optimization TechniquesTensor decomposition and applicationsComputational Physics and Python Applications