Litcius/Paper detail

GALFusion: Multi-Exposure Image Fusion via a Global–Local Aggregation Learning Network

Jia Lei, Jiawei Li, Jinyuan Liu, Shihua Zhou, Qiang Zhang, Nikola Kasabov

2023IEEE Transactions on Instrumentation and Measurement24 citationsDOIOpen Access PDF

Abstract

The goal of multi-exposure image fusion is to generate synthetic results with abundant details and balanced exposure from low dynamic range(LDR) images. The existing multi-exposure fusion methods often use convolution operations to extract features. However, these methods only consider the pixel values in local view field and ignore the long-range dependencies between pixels. To solve the aforementioned problem, we propose a global-local aggregation network for fusing extreme exposure images in an unsupervised way. Firstly, we design a collaborative aggregation module, composed of two sub-modules covering a non-local attention inference module and a local adaptive learning module, to mine the relevant features from source images. So that we successfully formulate a feature extraction mechanism with aggregating global and local information. Secondly, we provide a special fusion module to reconstruct fused images, which effectively avoids artifacts and suppresses information decay. Moreover, we further fine-tune the fusion results by a recursive refinement module to capture more textural details from source images. The results of both comparative and ablation analyses on two datasets demonstrate that GALFusion achieves the best marks in terms of MEF-SSIM and PSNR, outperforming the existing 12 state-of-the-art fusion methods.

Topics & Concepts

Computer scienceConvolution (computer science)Artificial intelligenceFusionPixelInferenceRange (aeronautics)Feature extractionPattern recognition (psychology)Image fusionImage (mathematics)Field (mathematics)Feature (linguistics)Computer visionArtificial neural networkMathematicsPhilosophyComposite materialPure mathematicsLinguisticsMaterials scienceAdvanced Image Fusion TechniquesImage Enhancement TechniquesPhotoacoustic and Ultrasonic Imaging
GALFusion: Multi-Exposure Image Fusion via a Global–Local Aggregation Learning Network | Litcius