Ex Situ Transfer of Bayesian Neural Networks to Resistive Memory‐Based Inference Hardware
Thomas Dalgaty, Eduardo Esmanhotto, N. Castellani, Damien Querlioz, Elisa Vianello
Abstract
Neural networks cannot typically be trained locally in edge‐computing systems due to severe energy constraints. It has, therefore, become commonplace to train them “ex situ” and transfer the resulting model to a dedicated inference hardware. Resistive memory arrays are of particular interest for realizing such inference hardware, because they offer an extremely low‐power implementation of the dot‐product operation. However, the transfer of high‐precision software parameters to the imprecise and random conductance states of resistive memories poses significant challenges. Here, it is proposed that Bayesian neural networks can be more suitable for model transfer, because, such as device conductance states, their parameters are described by random variables. The ex situ training of a Bayesian neural network is performed, and then, the resulting software model is transferred in a single programming step to an array of 16 384 resistive memory devices. On an illustrative classification task, it is observed that the transferred decision boundaries and the prediction uncertainties of the software model are well preserved. This work demonstrates that resistive memory‐based Bayesian neural networks are a promising direction in the development of resistive memory compatible edge inference hardware.