Litcius/Paper detail

Deep Neural Network Embeddings for the Estimation of the Degree of Sleepiness

José Vicente Egas-López, Gábor Gosztolya

202117 citationsDOI

Abstract

Estimating the degree of sleepiness from the human speech is an emerging research problem with straightforward applications. In this study, we employ the x-vector approach, currently the state-of-the-art in speaker recognition, as a neural network feature extractor to detect the level of sleepiness of a speaker. Besides using different corpora for fitting the x- vector DNN, we also experiment with adding noise and reverberation to the training samples. According to our experimental results for the publicly available Dusseldorf Sleepy Language Corpus, utilizing x-vector embeddings as features for Support Vector Regression consistently leads to competitive performance scores in sleepiness detection. In particular, we present the highest Spearman's correlation coefficient on the public corpus that was achieved by a single method.

Topics & Concepts

Degree (music)Support vector machineComputer scienceArtificial neural networkExtractorSpeech recognitionArtificial intelligenceCorrelationPattern recognition (psychology)Feature (linguistics)Noise (video)Feature vectorCorrelation coefficientMachine learningMathematicsEngineeringAcousticsLinguisticsImage (mathematics)Process engineeringGeometryPhysicsPhilosophySpeech and Audio ProcessingSpeech Recognition and SynthesisEmotion and Mood Recognition