Freshwater Microscopic Algae Detection Based on Deep Neural Network with GAN-Based Augmentation for Imbalanced Algal Data
Benjamin S. B. Fung, Wang Hin Chan, Irene M.C. Lo, Danny H. K. Tsang
Abstract
Identifying and quantifying algal genera in images are crucial for understanding their ecological impact. Algal data are often imbalanced, limiting detection model accuracy. This paper presents a novel data augmentation method using StyleGAN2-ADA to enhance algal image instance segmentation. StyleGAN2-ADA generates artificial single-algal images to address data scarcity and imbalance. We train a Cascaded Mask R-CNN with Swin Transformer on a combined data set of real and artificial multigenera algal images and evaluate performance using the COCO mAP metric. The approach improves bounding box detection performance by 17.9% on all genera and 32.1% on rare genera compared with the baseline model. Additionally, 50% more artificial data yield significant enhancements without excessive artificial data use. The GAN-based augmentation technique shows a performance improvement in both Swin-Tiny and ResNet-50 backbone models, suggesting adaptability for various machine learning models. The increased mAP leads to the accurate identification of harmful algae genera, allowing for better prevention and mitigation. This method offers a superior data augmentation solution for accurate algal instance segmentation and can benefit applications challenged by imbalanced and scarce data.