Litcius/Paper detail

A New Architecture based AR for Detection and Recognition of Objects and Text to Enhance Navigation of Visually Impaired People

Imene Ouali, Mohamed Saifeddine Hadj Sassi, Mohamed Ben Halima, Ali Wali

2020Procedia Computer Science23 citationsDOIOpen Access PDF

Abstract

Navigation in unfamiliar places is a big challenge for partially sighted and visually impaired people. Improving visual information on the location and content of objects such as drugs can help navigation in unfamiliar environments. There are several existing navigation solutions capable of helping these people. However, navigation solutions are rarely adopted and implemented in reality. In order to optimize the perception of digital information of objects from sensors and to naturally interact with the pervasive computing landscape, Augmented Reality (AR) equipment has to be seamlessly integrated into the user’s environment. For this purpose, we develop an architecture of text and objects recognition based on AR in order to assist partially sighted and visually impaired people. Such architecture makes navigation easier in the environment by helping users to find drugs and to verify the number of pills using speech. The proposed architecture uses context-aware mobile computing and shows great potential to integrate AR for object recognition through AR engines.

Topics & Concepts

Computer scienceAugmented realityArchitectureHuman–computer interactionContext (archaeology)PerceptionVisually impairedMobile deviceObject (grammar)Artificial intelligenceMultimediaComputer visionWorld Wide WebArtBiologyPaleontologyVisual artsNeuroscienceTactile and Sensory InteractionsAdvanced Image and Video Retrieval TechniquesHandwritten Text Recognition Techniques