Litcius/Paper detail

PPO-based Reinforcement Learning for UAV Navigation in Urban Environments

Khalil Chikhaoui, Hakim Ghazzai, Yehia Massoud

20222022 IEEE 65th International Midwest Symposium on Circuits and Systems (MWSCAS)16 citationsDOI

Abstract

Autonomous navigation of unmanned aerial vehicles (UAVs) in urban environments is a difficult task due to the complexity of the surroundings and the battery limitations of the flying unit. In this paper, we present an autonomous framework for UAV navigation using deep reinforcement learning. We deploy a proximal policy optimization (PPO) algorithm for path planning with collision avoidance. The energy limitations of the UAV is taken into account to prevent crashes due to low battery situations. We develop a virtual environment that simulates a random three dimensional space with obstacles, and we use it to train the model and evaluate its performance. It is shown that 90% of the trips have been successfully accomplished.

Topics & Concepts

Reinforcement learningComputer scienceCollision avoidanceMotion planningTask (project management)Artificial intelligenceReal-time computingBattery (electricity)SimulationCollisionEngineeringRobotComputer securitySystems engineeringPhysicsPower (physics)Quantum mechanicsUAV Applications and OptimizationRobotic Path Planning AlgorithmsDistributed Control Multi-Agent Systems