Improved Few-Shot SAR Image Generation by Enhancing Diversity
Jianghan Bao, Wenming Yu, Kaiqiao Yang, Che Liu, Tie Jun Cui
Abstract
Due to their remarkable capabilities of generation, deep learning-based (DL) generative models have been widely applied in the field of synthetic aperture radar (SAR) image synthesis. This kind of data-driven DL methods usually requires abundant training samples to guarantee the performance. However, the number of SAR images for training is often insufficient because of expensive acquisitions. This typical few-shot image generation (FSIG) task still remains not fully investigated. In this paper, we propose an optical-to-SAR (O2S) image translation model with a pairwise distance (PD) loss to enhance the diversity of generation. Firstly, we replace the semantic maps used as the input of network in previous studies with more easily available optical images and apply the popular pix2pix model in image-to-image translation tasks as the foundation network. Secondly, inspired by the FSIG works in traditional computer vision field, we propose a similarity preservation term in the loss function, which encourages the generated images to inherit the similarity relationship of the corresponding simulated SAR images. Thirdly, the data augmentation experiments on the MSTAR dataset indicates the effectiveness of our model. With only 5 samples for each target category and 6 categories in total, the basic O2S network boosts the classification accuracy by 4.81% and 2.27% for data of depression angle of <inline-formula xmlns:mml="http://www.w3.org/1998/Math/MathML" xmlns:xlink="http://www.w3.org/1999/xlink"><tex-math notation="LaTeX">$15^{\circ }$</tex-math></inline-formula> and <inline-formula xmlns:mml="http://www.w3.org/1998/Math/MathML" xmlns:xlink="http://www.w3.org/1999/xlink"><tex-math notation="LaTeX">$17^{\circ }$</tex-math></inline-formula> , respectively. The PD loss is capable of bringing additional 2.23% and 1.78% improvement. The investigation on similarity curves also suggests that the generated images enhanced by the PD loss have closer similarity behaviors to the real SAR images.