Multi-Modal Fusion and Longitudinal Analysis for Alzheimer’s Disease Classification Using Deep Learning
Shakhnoza Muksimova, Sabina Umirzakova, Jushkin Baltayev, Young Im Cho
Abstract
Background: Addressing the complex diagnostic challenges of Alzheimer’s disease (AD), this study introduces FusionNet, a groundbreaking framework designed to enhance AD classification through the integration of multi-modal and longitudinal imaging data. Methods: FusionNet synthesizes inputs from Magnetic Resonance Imaging (MRI), Positron Emission Tomography (PET), and Computed Tomography (CT) scans, harnessing advanced machine learning strategies such as generative adversarial networks (GANs) for robust data augmentation, lightweight neural architectures for efficient computation, and deep metric learning for precise feature extraction. The model uniquely combines cross-sectional and temporal data, significantly enhancing diagnostic accuracy and enabling the early detection and ongoing monitoring of AD. The FusionNet architecture incorporates specialized feature extraction pathways for each imaging modality, a fusion layer to integrate diverse data sources effectively, and attention mechanisms to focus on salient diagnostic features. Results: Demonstrating superior performance, FusionNet achieves an accuracy of 94%, with precision and recall rates of 92% and 93%, respectively. Conclusions: These results underscore its potential as a highly reliable diagnostic tool for AD, facilitating early intervention and tailored treatment strategies. FusionNet’s innovative approach not only improves diagnostic precision but also offers new insights into the progression of Alzheimer’s disease, supporting personalized patient care and advancing our understanding of this debilitating condition.