Litcius/Paper detail

Energy-efficient XNOR-free in-memory BNN accelerator with input distribution regularization

Hyungjun Kim, Hyunmyung Oh, Jae‐Joon Kim

202014 citationsDOI

Abstract

SRAM-based in-memory Binary Neural Network (BNN) accelerators are garnering interests as a platform for energy-efficient edge neural network computing thanks to their compactness in terms of hardware and neural network parameter size. However, previous works had to modify SRAM cells to support XNOR operations on memory array resulting in limited area and energy efficiencies. In this work, we present a conversion method which replaces the signed inputs (+1/-1) of BNN with the unsigned inputs (1/0) without computation error, and vice versa. The method enables BNN computing on conventional 6T SRAM arrays and improves area and energy efficiencies. We also demonstrate that further energy saving is possible by skewing the distribution of binary input data based on regularization during network training. Evaluation results show that the proposed techniques improve the inference energy efficiency by up to 9.4x for various benchmarks over previous works.

Topics & Concepts

XNOR gateStatic random-access memoryComputer scienceEfficient energy useArtificial neural networkBinary numberHardware accelerationParallel computingEnergy (signal processing)ComputationRegularization (linguistics)Computer hardwareComputer engineeringComputational scienceAlgorithmLogic gateField-programmable gate arrayArtificial intelligenceMathematicsEngineeringArithmeticNAND gateElectrical engineeringStatisticsAdvanced Neural Network ApplicationsAdvanced Memory and Neural ComputingFerroelectric and Negative Capacitance Devices
Energy-efficient XNOR-free in-memory BNN accelerator with input distribution regularization | Litcius