Cognitive Electronic Jamming Decision-Making Method Based on Improved <a:math xmlns:a="http://www.w3.org/1998/Math/MathML" id="M1"> <a:mi>Q</a:mi> </a:math>-Learning Algorithm
Huiqin Li, Yanling Li, Chuan He, Jianwei Zhan, Hui Zhang
Abstract
In this paper, a cognitive electronic jamming decision-making method based on improved <a:math xmlns:a="http://www.w3.org/1998/Math/MathML" id="M2"> <a:mi>Q</a:mi> </a:math> -learning is proposed to improve the efficiency of radar jamming decision-making. First, the method adopts the simulated annealing (SA) algorithm’s Metropolis criterion to enhance the exploration strategy, balancing the contradictory relationship between exploration and utilization in the algorithm to avoid falling into local optima. At the same time, the idea of stochastic gradient descent with warm restarts (SGDR) is introduced to improve the learning rate of the algorithm, which reduces the oscillation and improves convergence speed at the later stage of the algorithm iteration. Then, a cognitive electronic jamming decision-making model is constructed, and the improved <c:math xmlns:c="http://www.w3.org/1998/Math/MathML" id="M3"> <c:mi>Q</c:mi> </c:math> -learning algorithm’s specific steps are given. The simulation experiment takes a multifunctional radar as an example to analyze the influence of exploration strategy and learning rate on decision-making performance. The results reveal that compared with the traditional <e:math xmlns:e="http://www.w3.org/1998/Math/MathML" id="M4"> <e:mi>Q</e:mi> </e:math> -learning algorithm, the improved <g:math xmlns:g="http://www.w3.org/1998/Math/MathML" id="M5"> <g:mi>Q</g:mi> </g:math> -learning algorithm proposed in this paper can fully explore and efficiently utilize and converge the results to a better solution at a faster speed. The number of iterations can be reduced to more than 50%, which proves the feasibility and effectiveness of the method applied to cognitive electronic jamming decision-making.