Litcius/Paper detail

Augmented Reality Maintenance Assistant Using YOLOv5

Ana Malta, Mateus Mendes, José Torres Farinha

2021Applied Sciences117 citationsDOIOpen Access PDF

Abstract

Maintenance professionals and other technical staff regularly need to learn to identify new parts in car engines and other equipment. The present work proposes a model of a task assistant based on a deep learning neural network. A YOLOv5 network is used for recognizing some of the constituent parts of an automobile. A dataset of car engine images was created and eight car parts were marked in the images. Then, the neural network was trained to detect each part. The results show that YOLOv5s is able to successfully detect the parts in real time video streams, with high accuracy, thus being useful as an aid to train professionals learning to deal with new equipment using augmented reality. The architecture of an object recognition system using augmented reality glasses is also designed.

Topics & Concepts

Augmented realityComputer scienceArtificial neural networkTask (project management)Trouble shootingArtificial intelligenceObject (grammar)Human–computer interactionEngineeringSystems engineeringReliability engineeringAugmented Reality ApplicationsAdvanced Neural Network Applications3D Surveying and Cultural Heritage
Augmented Reality Maintenance Assistant Using YOLOv5 | Litcius