Litcius/Paper detail

Multimodal medical image fusion with convolution sparse representation and mutual information correlation in NSST domain

Peng Guo, Guoqi Xie, Renfa Li, Hui Hu

2022Complex & Intelligent Systems25 citationsDOIOpen Access PDF

Abstract

Abstract Multimodal medical image is an effective method to solve a series of clinical problems, such as clinical diagnosis and postoperative treatment. In this study, a medical image fusion method based on convolutional sparse representation (CSR) and mutual information correlation is proposed. In this method, the source image is decomposed into one high-frequency and one low-frequency sub-band by non-subsampled shearlet transform. For the high-frequency sub-band, CSR is used for high-frequency coefficient fusion. For the low-frequency sub-band, different fusion strategies are used for different regions by mutual information correlation analysis. Analysis of two kinds of medical image fusion problems, namely, CT–MRI and MRI–SPECT, reveals that the performance of this method is robust in terms of five common objective metrics. Compared with the other six advanced medical image fusion methods, the experimental results show that the proposed method achieves better results in subjective vision and objective evaluation metrics.

Topics & Concepts

Mutual informationImage fusionPattern recognition (psychology)Convolution (computer science)Artificial intelligenceFusion rulesImage (mathematics)CorrelationSparse approximationShearletFusionFrequency domainComputer scienceRepresentation (politics)Correlation coefficientComputational intelligenceMathematicsComputer visionMachine learningArtificial neural networkPolitical sciencePhilosophyLinguisticsLawGeometryPoliticsAdvanced Image Fusion TechniquesImage and Signal Denoising MethodsPhotoacoustic and Ultrasonic Imaging