Litcius/Paper detail

Apply Deep Learning-based CNN and LSTM for Visual Image Caption Generator

N. Indumathi, R.J. Divyalakshmi, J. Stalin, V. S. Ramachandran, P. Rajaram

202316 citationsDOI

Abstract

Implemented Image captioning is becoming a need. Deep neural network models enable integrated applications to generate and caption images. Image captioning describes an image. It requires identifying an image's main objects, properties, and relationships. It produces correct sentences. The creation of image caption generators, which examine the content of an image and offer pertinent descriptions, makes use of deep learning and computer vision techniques. One element of this method involves classifying objects in the image using English keywords derived from training datasets. The caption generator was created by combining LSTM and CNN. In this paper, we propose a deep-learning model that uses computer vision and machine translation to characterize images and generate captions. The model successfully recognizes and labels visual items and their relationships. Transfer Learning will be used to demonstrate the suggested experiment, coupled with the Flickr8k dataset and the Python3 programming language. This study will also look into the functions and construction of neural networks. The proposed model achieves a BELU Score of 69.8.

Topics & Concepts

Closed captioningComputer scienceGenerator (circuit theory)Artificial intelligenceDeep learningImage (mathematics)Convolutional neural networkTransfer of learningMachine translationArtificial neural networkComputer visionImage translationTranslation (biology)VisualizationContextual image classificationNatural language processingPattern recognition (psychology)Quantum mechanicsBiochemistryPhysicsPower (physics)GeneMessenger RNAChemistryMultimodal Machine Learning ApplicationsAdvanced Neural Network ApplicationsAdvanced Image and Video Retrieval Techniques
Apply Deep Learning-based CNN and LSTM for Visual Image Caption Generator | Litcius