Litcius/Paper detail

Sign language recognition system for communicating to people with disabilities

Yulius Obi, Kent Samuel Claudio, Vetri Marvel Budiman, Said Achmad, Aditya Kurniawan

2023Procedia Computer Science90 citationsDOIOpen Access PDF

Abstract

Sign language is one of the most reliable ways of communicating with special needs people, as it can be done anywhere. However, most people do not understand sign language. Therefore, we have devised an idea to make a desktop application that can recognize sign language and convert it to text in real time. This research uses American Sign Language (ASL) datasets and the Convolutional Neural Networks (CNN) classification system. In the classification, the hand image is first passed through a filter and after the filter is applied, the hand is passed through a classifier which predicts the class of the hand gestures. This research focuses on the accuracy of the recognition. Our Application resulted in 96,3% accuracy for the 26 letters of the alphabet.

Topics & Concepts

Computer scienceSign languageGestureClassifier (UML)AlphabetAmerican Sign LanguageConvolutional neural networkSign (mathematics)Artificial intelligenceGesture recognitionNatural language processingFilter (signal processing)Speech recognitionComputer visionLinguisticsMathematical analysisPhilosophyMathematicsHand Gesture Recognition SystemsHearing Impairment and CommunicationGait Recognition and Analysis