Backward recursive Class Activation Map refinement for high resolution saliency map
Alexandre Englebert, Olivier Cornu, Christophe De Vleeschouwer
Abstract
The need for Explainable AI is increasing with the development of deep learning. The saliency maps derived from convolutional neural networks generally fail in localizing with accuracy the image features justifying the network prediction. This is because those maps are either low-resolution as for CAM, or smooth as for perturbation-based methods, or do correspond to a large number of widespread peaky spots as for gradient-based approaches. In contrast, our work proposes to combine the information from earlier network layers with the one from later layers to produce a high resolution Class Activation Map that is competitive with the previous art in term of insertion-deletion faithfulness metrics, while outperforming it in term of precision of class-specific features localization.