Denoising diffusion probabilistic models for addressing data limitations in chest X-ray classification

Abstract

Deep learning plays a crucial role in medical imaging analysis, particularly in tasks such as image classification and segmentation. However, learning from medical imaging datasets presents challenges, including scarcity of labeled examples, class imbalances, and inadequate representation of diverse patient populations. To address these challenges, there has been a growing interest in the use of deep generative models to create synthetic training data, with denoising diffusion probabilistic models (DDPMs) recently gaining attention for their ability to produce realistic and high-quality images. This study explores the potential of a DDPM to generate synthetic chest X-rays for multi-label classifier training. The results indicate that the use of a conditional DDPM has the potential to produce a realistic training set of synthetic chest X-rays. In addition, the study analyzes the impact on classification performance of addressing class imbalance. Balancing the synthetic training set increased the overall classification sensitivity from 0.02 to 0.59, but decreased the overall specificity from 0.99 to 0.71. Furthermore, we investigated the potential of unconditional pre-training to learn general representations, followed by conditional fine-tuning of the DDPM. The results indicate that this approach allows the amount of labeled training data to be reduced to 25% of the original set. Finally, we demonstrate that fidelity and classification metrics do not consistently exhibit the same trends. Integrating a DDPM into the classification pipeline underscores the benefits of having optimal control over the data and efficient use of available unlabeled data. Our research provides insights for making informed decisions about integrating generative models into medical image analysis. • Generate realistic chest X-rays with controlled DDPM for medical image classification training. • Balanced synthetic datasets improve positive predictions by correcting class imbalance in training. • Optimize use of labeled data by unconditional pre-training and conditional fine-tuning.

Topics & Concepts