Litcius/Paper detail

Task-Oriented Image Transmission for Scene Classification in Unmanned Aerial Systems

Xu Kang, Bin Song, Jie Guo, Zhijin Qin, F. Richard Yu

2022IEEE Transactions on Communications128 citationsDOI

Abstract

The vigorous developments of the Internet of Things make it possible to extend its computing and storage capabilities to computing tasks in the aerial system with the collaboration of cloud and edge, especially for artificial intelligence (AI) tasks based on deep learning (DL). Collecting a large amount of image/video data, unmanned aerial vehicles (UAVs) can only hand over intelligent analysis tasks to the back-end mobile edge computing (MEC) server due to their limited storage and computing capabilities. How to efficiently transmit the most correlated information for the AI model is a challenging topic. Inspired by task-oriented communication in recent years, we propose a new aerial image transmission paradigm for the scene classification task. A lightweight model is developed on the front-end UAV for semantic block transmission with the perception of images and channel states. To achieve the tradeoff between transmission latency and classification accuracy, deep reinforcement learning (DRL) is applied to explore the semantic blocks which have the greatest contribution to the back-end classifier under various channel states. Experimental results show that the proposed method can significantly improve classification accuracy by more than 4% under the same conditions, compared to other semantic saliency learning methods.

Topics & Concepts

Computer scienceArtificial intelligenceDeep learningCloud computingEdge computingContextual image classificationTask (project management)Transmission (telecommunications)Computer visionClassifier (UML)Real-time computingEnhanced Data Rates for GSM EvolutionImage (mathematics)EngineeringSystems engineeringOperating systemTelecommunicationsVideo Surveillance and Tracking MethodsAdvanced Neural Network ApplicationsVisual Attention and Saliency Detection
Task-Oriented Image Transmission for Scene Classification in Unmanned Aerial Systems | Litcius