A Fast Multi-Loss Learning Deep Neural Network for Automatic Modulation Classification
Shuo Chang, Zheng Yang, Jiashuo He, Rong Li, Sai Huang, Zhiyong Feng
Abstract
Automatic modulation classification (AMC) enables significant applications in both the military and civilian domains. Inspired by the great success of deep learning (DL), a dual-stream neural network using in-phase/quadrature (I/Q) and amplitude/phase (A/P) data has made a superior performance. However, this dual-stream model is oversized (large number of parameters) and time-consuming (high inference time). To deal with that, a novel lightweight single stream neural network made up of group convolutional layer and transformer encoder layer is proposed. Specifically, the group convolutional layer divides the input tensor into different groups for convolution, which needs fewer parameters and has lower computational complexity than commonly used convolutional layers. For the transformer encoder layer, it can generate all time steps’ outputs in parallel by using multi-head attention scheme, which is impossible for the commonly used recurrent-like layers (i.e., the recurrent-like layers output all time steps one by one.). Furthermore, a novel class center distance expansion loss incorporating the cross entropy loss is proposed for model training, which can enlarge the distance of different class centers Finally, the overlapping risk of different class features is reduced. As a result, the inference time of the proposed FastMLDNN is <inline-formula xmlns:mml="http://www.w3.org/1998/Math/MathML" xmlns:xlink="http://www.w3.org/1999/xlink"> <tex-math notation="LaTeX">$13\times $ </tex-math></inline-formula> faster than MLDNN, and the model size is near <inline-formula xmlns:mml="http://www.w3.org/1998/Math/MathML" xmlns:xlink="http://www.w3.org/1999/xlink"> <tex-math notation="LaTeX">${}\frac {1}{6}$ </tex-math></inline-formula> as MLDNN, which only sacrifices 0.12% in accuracy. The source code has been released in the github: <uri xmlns:mml="http://www.w3.org/1998/Math/MathML" xmlns:xlink="http://www.w3.org/1999/xlink">https://github.com/Singingkettle/ChangShuoRadioRecognition/tree/main/configs/fastmldnn</uri> .