Litcius/Paper detail

A Multi-Agent Deep Reinforcement Learning Approach for Practical Decentralized UAV Collision Avoidance

Nicholas Thumiger, Mohammad Deghat

2021IEEE Control Systems Letters24 citationsDOI

Abstract

This letter proposes an improved deep reinforcement learning controller for the decentralized collision avoidance problem. Using a unique architecture incorporating ‘long-short term memory cells’ and a reward function inspired from gradient-based approaches, the controller outperforms existing techniques in environments with variable numbers of agents. The design of the reward function is also evaluated to critique existing deep reinforcement learning approaches and used to establish a better result. The proposed controller is subsequently tested in simulation and a real-world 3-dimensional drone environment: outperforming the predominant classical approach in the literature by a significant margin.

Topics & Concepts

Reinforcement learningCollision avoidanceComputer scienceMargin (machine learning)Controller (irrigation)Artificial intelligenceFunction (biology)Deep learningCollisionMachine learningComputer securityBiologyAgronomyEvolutionary biologyDistributed Control Multi-Agent SystemsRobotic Path Planning AlgorithmsUAV Applications and Optimization