Towards bridging the synthetic-to-real gap in quantitative photoacoustic tomography via unsupervised domain adaptation
Zeqi Wang, Wei Tao, Zhuang Zhang, Hui Zhao
Abstract
The difficulty of obtaining absorption coefficient annotations hinders the practical application of deep learning in quantitative photoacoustic tomography. While training on synthetic data is easy to implement, the synthetic-to-real domain gap poses a significant challenge to model generalization. To address this, we propose a Decoder-enhanced unsupervised Domain Adaptation (DDA) framework to enable knowledge transfer from synthetic data to an unlabeled target domain. Experimental results show that DDA significantly improves estimation performance on target images and surpasses competing methods in quantitative evaluation and visual comparison. Additionally, we investigate the effect of cross-domain label distribution similarity on domain adaptation and recommend an effective approach for data synthesis. To mitigate the effect of absorption property mismatch, we propose fine-tuning the affine parameters of normalization layers, which significantly improves estimation accuracy using labeled multi-wavelength photoacoustic images from as few as two target samples.