Reproducing “Show, Attend and Tell: Neural Image Caption Generation with Visual Attention”
Haixia Liu, Tim Brailsford
Abstract
Abstract This paper replicates the experiment presented in the work of Xu et al. [1], and examines errors in the generated captions. The analysis of the identified errors aims to provide deeper insight into the underlying causes. This study also encompasses subsequent experiments aiming at investigating the feasibility of rectifying these errors via a post-processing stage. Image recognition and object detection models, as well as a language probability computational model were explored. The findings presented in this paper aim to contribute towards the overarching objective of Explainable Artificial Intelligence (XAI), thereby providing potential pathways to improve image captioning.
Topics & Concepts
Closed captioningComputer scienceImage (mathematics)Artificial intelligenceVisualizationObject (grammar)Natural language processingMachine learningComputer visionMultimodal Machine Learning ApplicationsHuman Pose and Action RecognitionNatural Language Processing Techniques