Litcius/Paper detail

Semantic-aware Speech to Text Transmission with Redundancy Removal

Tianxiao Han, Qianqian Yang, Zhiguo Shi, Shibo He, Zhaoyang Zhang

20222022 IEEE International Conference on Communications Workshops (ICC Workshops)19 citationsDOI

Abstract

Deep learning (DL) based semantic communication methods have been explored for the efficient transmission of images, text, and speech in recent years. In contrast to traditional wireless communication methods that focus on the transmission of abstract symbols, semantic communication approaches attempt to achieve better transmission efficiency by only sending the semantic-related information of the source data. In this paper, we consider semantic-oriented speech to text transmission. We propose a novel end-to-end DL-based transceiver, which includes an attention-based soft alignment module and a redundancy removal module to compress the transmitted data. In particular, the former extracts only the text-related semantic features, and the latter further drops the semantically redundant content, greatly reducing the amount of semantic redundancy compared to existing methods. We also propose a two-stage training <sup xmlns:mml="http://www.w3.org/1998/Math/MathML" xmlns:xlink="http://www.w3.org/1999/xlink">sc</sup> heme, which speeds up the training of the proposed DL model. The simulation results indicate that our proposed method outperforms current methods in terms of the accuracy of the received text and transmission efficiency. Moreover, the proposed method also has a smaller model size and shorter end-to-end runtime.

Topics & Concepts

Computer scienceRedundancy (engineering)Data redundancyArtificial intelligenceNatural language processingTransmission (telecommunications)Semantic data modelData transmissionInformation retrievalComputer networkDatabaseTelecommunicationsOperating systemSpeech Recognition and SynthesisSpeech and Audio ProcessingWireless Signal Modulation Classification
Semantic-aware Speech to Text Transmission with Redundancy Removal | Litcius