Litcius/Paper detail

Demo: Real-Time Semantic Communications with a Vision Transformer

Han-Ju Yoo, Taehun Jung, Linglong Dai, Songkuk Kim, Chan‐Byoung Chae

20222022 IEEE International Conference on Communications Workshops (ICC Workshops)34 citationsDOI

Abstract

Semantic communications are expected to enable the more effective delivery of meaning rather than a precise transfer of symbols. In this paper, we propose an end-to-end deep neural network-based architecture for image transmission and demonstrate its feasibility in a real-time wireless channel by implementing a prototype based on a field-programmable gate array (FPGA). We demonstrate that this system outperforms the traditional 256-quadrature amplitude modulation system in the low signal-to-noise ratio regime with the popular CIFAR-10 dataset. To the best of our knowledge, this is the first work that implements and investigates real-time semantic communications with a vision transformer.

Topics & Concepts

Computer scienceField-programmable gate arrayTransformerWirelessQuadrature amplitude modulationArchitectureArtificial intelligenceReal-time computingComputer visionComputer hardwareChannel (broadcasting)TelecommunicationsElectrical engineeringEngineeringBit error rateArtVoltageVisual artsWireless Signal Modulation ClassificationImage Processing Techniques and ApplicationsInfrared Target Detection Methodologies