Litcius/Paper detail

WiFace: Facial Expression Recognition Using Wi-Fi Signals

Yanjiao Chen, Runmin Ou, Zhiyang Li, Kaishun Wu

2020IEEE Transactions on Mobile Computing30 citationsDOI

Abstract

Facial expressions are an essential form of human nonverbal communication. Recognition of this nonverbal sign may enable developers to understand the feedbacks on smart device functionality and advertising. Existing approaches for facial expression recognition are mainly based on cameras or on-body sensors, which are either sensitive to lighting conditions or cumbersome for users to wear devices on their faces. In this paper, we propose a new facial expression recognition system based on Wi-Fi signals, named WiFace. Our fundamental intuition is that facial muscle movements in different expressions will induce distinctive waveform patterns in the time-series of channel state information (CSI) in Wi-Fi signals. We develop a series of algorithms to process the CSI signals and extract the most representative waveform patterns for facial expression classification. We build a fully-functional prototype of WiFace using commercial off-the-shelf devices, which can recognize six typical facial expressions. We conduct extensive experiments to evaluate the performance of WiFace, and the experimental results show that the average recognition accuracy is 94.80 percent.

Topics & Concepts

Computer scienceFacial expressionSpeech recognitionWaveformFacial expression recognitionNonverbal communicationArtificial intelligenceFacial recognition systemProcess (computing)Expression (computer science)IntuitionPattern recognition (psychology)Activity recognitionFacial musclesComputer visionTelecommunicationsProgramming languageOperating systemPsychologyEpistemologySociologyCommunicationRadarDevelopmental psychologyPhilosophyIndoor and Outdoor Localization TechnologiesSpeech and Audio ProcessingAdvanced Adaptive Filtering Techniques
WiFace: Facial Expression Recognition Using Wi-Fi Signals | Litcius