A Multi-Agent Deep Reinforcement Learning Approach for Practical Decentralized UAV Collision Avoidance
Nicholas Thumiger, Mohammad Deghat
Abstract
This letter proposes an improved deep reinforcement learning controller for the decentralized collision avoidance problem. Using a unique architecture incorporating ‘long-short term memory cells’ and a reward function inspired from gradient-based approaches, the controller outperforms existing techniques in environments with variable numbers of agents. The design of the reward function is also evaluated to critique existing deep reinforcement learning approaches and used to establish a better result. The proposed controller is subsequently tested in simulation and a real-world 3-dimensional drone environment: outperforming the predominant classical approach in the literature by a significant margin.
Topics & Concepts
Reinforcement learningCollision avoidanceComputer scienceMargin (machine learning)Controller (irrigation)Artificial intelligenceFunction (biology)Deep learningCollisionMachine learningComputer securityBiologyAgronomyEvolutionary biologyDistributed Control Multi-Agent SystemsRobotic Path Planning AlgorithmsUAV Applications and Optimization