Generative Semantic Communications With Foundation Models: Perception-Error Analysis and Semantic-Aware Power Allocation
Chunmei Xu, Mahdi Boloursaz Mashhadi, Yi Ma, Rahim Tafazolli, Jiangzhou Wang
Abstract
Generative foundation models can revolutionize the design of semantic communication (SemCom) systems by enabling high fidelity exchange of semantic information at ultra-low rates. In this work, a generative SemCom framework utilizing pre-trained foundation models is proposed, where both uncoded forward-with-error and coded discard-with-error schemes are developed for the semantic decoder. Using the rate-distortion-perception theory, the relationship between regenerated signal quality and transmission reliability is characterized, which is proven to be non-decreasing. Based on this, semantic values are defined to quantify the semantic similarity between multimodal semantic features and the original source. We also investigate semantic-aware power allocation problems that minimize power consumption for ultra-low rate and high fidelity SemComs. Two semantic-aware power allocation methods are proposed by leveraging the non-decreasing property of the perception-error relationship. Based on the Kodak dataset, perception-error functions and semantic values are obtained for image tasks. Simulation results show that the proposed semantic-aware method significantly outperforms conventional approaches, particularly in the channel-coded case (up to 90% power saving).