Litcius/Paper detail

RSDiff: remote sensing image generation from text using diffusion model

Ahmad Sebaq, Mohamed Elhelw

2024Neural Computing and Applications49 citationsDOIOpen Access PDF

Abstract

Abstract The generation and enhancement of satellite imagery are critical in remote sensing, requiring high-quality, detailed images for accurate analysis. This research introduces a two-stage diffusion model methodology for synthesizing high-resolution satellite images from textual prompts. The pipeline comprises a low-resolution diffusion model (LRDM) that generates initial images based on text inputs and a super-resolution diffusion model (SRDM) that refines these images into high-resolution outputs. The LRDM merges text and image embeddings within a shared latent space, capturing essential scene content and structure. The SRDM then enhances these images, focusing on spatial features and visual clarity. Experiments conducted using the Remote Sensing Image Captioning Dataset demonstrate that our method outperforms existing models, producing satellite images with accurate geographical details and improved spatial resolution.

Topics & Concepts

Computational Science and EngineeringComputer scienceImage (mathematics)DiffusionRemote sensingArtificial intelligenceMachine learningGeologyPhysicsThermodynamicsImage Retrieval and Classification TechniquesAdvanced Image and Video Retrieval TechniquesGenerative Adversarial Networks and Image Synthesis
RSDiff: remote sensing image generation from text using diffusion model | Litcius