Litcius/Paper detail

A UAV Maneuver Decision-Making Algorithm for Autonomous Airdrop Based on Deep Reinforcement Learning

Ke Li, Kun Zhang, Zhenchong Zhang, Zekun Liu, Shuai Hua, Jianliang He

2021Sensors13 citationsDOIOpen Access PDF

Abstract

How to operate an unmanned aerial vehicle (UAV) safely and efficiently in an interactive environment is challenging. A large amount of research has been devoted to improve the intelligence of a UAV while performing a mission, where finding an optimal maneuver decision-making policy of the UAV has become one of the key issues when we attempt to enable the UAV autonomy. In this paper, we propose a maneuver decision-making algorithm based on deep reinforcement learning, which generates efficient maneuvers for a UAV agent to execute the airdrop mission autonomously in an interactive environment. Particularly, the training set of the learning algorithm by the Prioritized Experience Replay is constructed, that can accelerate the convergence speed of decision network training in the algorithm. It is shown that a desirable and effective maneuver decision-making policy can be found by extensive experimental results.

Topics & Concepts

Reinforcement learningComputer scienceKey (lock)Convergence (economics)Set (abstract data type)Artificial intelligenceMarkov decision processComputer securityMathematicsMarkov processStatisticsEconomicsEconomic growthProgramming languageReinforcement Learning in RoboticsRobotic Path Planning AlgorithmsDistributed Control Multi-Agent Systems