Hand Gesture Recognition Based on Optimal Segmentation in Human-Computer Interaction
Md Abdur Rahim, Abu Saleh Musa Miah, Abu Sayeed, Jungpil Shin
Abstract
In recent years, hand gesture recognition (HGR) systems have been extensively developed with the technologies of human-computer interaction (HCI), which enables regular interaction with machines. However, the significance of progress in HGR continues to advance, although the problem of hand segmentation and recognition is challenging due to the unfavorable environment, background illumination, hand size, and shape. To overcome this, we propose an optimal segmentation method for identifying hand gestures from input images, improving recognition performance. For segmenting hand gestures, we compared the segmentation methods of YCbCr, SkinMask, and HSV (hue, saturation, and value). The CR component is extracted from YCbCr, then binarization, erosion, and hole filling are performed. Color segmentation is applied to the SkinMask process that detects pixels that match the color of the hand. In the HSV process, threshold masking determines the dominant features. The Softmax classification is used to classify hand gestures where features are extracted through convolutional neural network (CNN). The proposed segmentation methods are applied to a benchmark dataset and the result shows an improvement in recognition accuracy over state-of-the-art systems.