Litcius/Paper detail

Utilizing Wav2Vec In Database-Independent Voice Disorder Detection

Saska Tirronen, Farhad Javanmardi, Manila Kodali, Sudarsana Reddy Kadiri, Paavo Alku

202319 citationsDOIOpen Access PDF

Abstract

Automatic detection of voice disorders from acoustic speech signals can help to improve reliability of medical diagnosis. However, the real-life environment in which speech signals are recorded for diagnosis can be different from the environment in which the detection system’s training data was originally collected. This mismatch between the recording conditions can decrease detection performance in practical scenarios. In this work, we propose to use a pre-trained wav2vec 2.0 model as a feature extractor to build automatic detection systems for voice disorders. The embeddings from the first layers of the context network contain information about phones, and these features are useful in voice disorder detection. We evaluate the performance of the wav2vec features in single-database and crossdatabase scenarios to study their generalizability to unseen speakers and recording conditions. The results indicate that the wav2vec features generalize better than popular spectral and cepstral baseline features.

Topics & Concepts

Computer scienceGeneralizability theoryMel-frequency cepstrumExtractorSpeech recognitionVoice activity detectionReliability (semiconductor)Context (archaeology)Feature (linguistics)Feature extractionArtificial intelligenceSpeech processingQuantum mechanicsPhysicsPower (physics)BiologyProcess engineeringEngineeringPhilosophyMathematicsLinguisticsStatisticsPaleontologyVoice and Speech DisordersSpeech Recognition and SynthesisMusic and Audio Processing
Utilizing Wav2Vec In Database-Independent Voice Disorder Detection | Litcius