A 28 nm 66.8 TOPS/W Sparsity-Aware Dynamic-Precision Deep-Learning Processor
Han-Gyeol Mun, Hyunwoo Son, Seunghyun Moon, Jaehyun Park, Byung-Jun Kim, Jae‐Yoon Sim
Abstract
The required precision for deep neural network (DNN) models strongly depends on sparsity and compactness. This paper presents a heterogeneous DNN accelerator performing dynamic-precision computing adapted to sparsity. Simulation shows that the proposed dynamic precision computing successfully covers EfficientNets and Transformers with a negligible accuracy loss. The accelerator, fabricated in a 28nm LP CMOS, achieves a peak energy efficiency of 66.8 TOPS/W with a peak performance of 4.2 TOPS.
Topics & Concepts
TOPSComputer scienceArtificial neural networkDeep learningTransformerCMOSAlgorithmArtificial intelligenceComputational scienceParallel computingElectronic engineeringElectrical engineeringVoltageEngineeringPhysicsOpticsAzimuthNeural Networks and ApplicationsAdvanced Memory and Neural ComputingFerroelectric and Negative Capacitance Devices