Explaining Deep Neural Network using Layer-wise Relevance Propagation and Integrated Gradients
Ivan Čík, Andrindrasana David Rasamoelina, Marián Mach, Peter Sinčák
Abstract
Machine learning has become an integral part of technology in today's world. The field of artificial intelligence is the subject of research by a wide scientific community. In particular, through improved methodology, the availability of big data, and increased computing power, today's machine learning algorithms can achieve excellent performance that sometimes even exceeds the human level. However, due to their nested nonlinear structure, these models are generally considered to be “Black boxes” that do not provide any information about what exactly leads them to provide a specific output. This raised the need to interpret these algorithms and understand how they work as they are applied even in areas where they can cause critical damage. This article describes Integrated Gradients [1] and Layer-wise Relevance Propagation [2] methods and presents individual experiments with. In experiments we have used well-known datasets like MNIST[3], MNIST-Fashion dataset[4], Imagenette and Imagewoof which are subsets of ImageNet [5].