Litcius/Paper detail

Review of white box methods for explanations of convolutional neural networks in image classification tasks

Meghna P. Ayyar, Jenny Benois‐Pineau, Akka Zemmari

2021Journal of Electronic Imaging29 citationsDOIOpen Access PDF

Abstract

In recent years, deep learning has become prevalent to solve applications from multiple domains. Convolutional neural networks (CNNs) particularly have demonstrated state-ofthe-art performance for the task of image classification. However, the decisions made by these networks are not transparent and cannot be directly interpreted by a human. Several approaches have been proposed to explain the reasoning behind a prediction made by a network. We propose a topology of grouping these methods based on their assumptions and implementations. We focus primarily on white box methods that leverage the information of the internal architecture of a network to explain its decision. Given the task of image classification and a trained CNN, our work aims to provide a comprehensive and detailed overview of a set of methods that can be used to create explanation maps for a particular image, which assign an importance score to each pixel of the image based on its contribution to the decision of the network. We also propose a further classification of the white box methods based on their implementations to enable better comparisons and help researchers find methods best suited for different scenarios.

Topics & Concepts

Computer scienceConvolutional neural networkWhite boxLeverage (statistics)Artificial intelligenceContextual image classificationMachine learningImplementationArtificial neural networkTask (project management)Deep learningPixelImage (mathematics)Pattern recognition (psychology)Programming languageManagementEconomicsExplainable Artificial Intelligence (XAI)Adversarial Robustness in Machine LearningMachine Learning and Data Classification
Review of white box methods for explanations of convolutional neural networks in image classification tasks | Litcius