Litcius/Paper detail

Captioning Changes in Bi-Temporal Remote Sensing Images

Seloua Chouaf, Genc Hoxha, Youcef Smara, Farid Melgani

202156 citationsDOI

Abstract

Motivated by the good performance recorded for image captioning (IC) techniques in different remote sensing (RS) applications, we propose in this paper a change detection (CD) system based on IC. It aims to the creation of a user-friendly solution that describes, via human-like sentences, the changes detected comparing bi-temporal images acquired over the same geographical area. The model we propose, is based on a convolutional neural network (CNN), and a multimodal recurrent neural network (RNN). Our experiments have been performed combining a set of aerial images with semantic information that we generated to describe the changes observed for different types of objects. This work yielded to encouraging results, evaluated using the BLEU metric.

Topics & Concepts

Closed captioningComputer scienceConvolutional neural networkArtificial intelligenceMetric (unit)Set (abstract data type)Image (mathematics)Recurrent neural networkPattern recognition (psychology)Computer visionArtificial neural networkOperations managementProgramming languageEconomicsAdvanced Image and Video Retrieval TechniquesRemote-Sensing Image ClassificationMultimodal Machine Learning Applications
Captioning Changes in Bi-Temporal Remote Sensing Images | Litcius