Litcius/Paper detail

Real-Time Multichannel Deep Speech Enhancement in Hearing Aids: Comparing Monaural and Binaural Processing in Complex Acoustic Scenarios

Nils L. Westhausen, Hendrik Kayser, Theresa Jansen, Bernd T. Meyer

2024IEEE/ACM Transactions on Audio Speech and Language Processing11 citationsDOIOpen Access PDF

Abstract

Deep learning has the potential to enhance speech signals and increase their intelligibility for users of hearing aids. Deep models suited for real-world application should feature a low computational complexity and low processing delay of only a few milliseconds. In this paper, we explore deep speech enhancement that matches these requirements and contrast monaural and binaural processing algorithms in two complex acoustic scenes. Both algorithms are evaluated with objective metrics and in experiments with hearing-impaired listeners performing a speech-in-noise test. Results are compared to two traditional enhancement strategies, i.e., adaptive differential microphone processing and binaural beamforming. While in diffuse noise, all algorithms perform similarly, the binaural deep learning approach performs best in the presence of spatial interferers. Through a post-analysis, this can be attributed to improvements at low SNRs and to precise spatial filtering.

Topics & Concepts

MonauralBinaural recordingSpeech recognitionAudiologySpeech enhancementComputer scienceHearing aidAcousticsArtificial intelligenceMedicineNoise reductionPhysicsSpeech and Audio ProcessingHearing Loss and Rehabilitation
Real-Time Multichannel Deep Speech Enhancement in Hearing Aids: Comparing Monaural and Binaural Processing in Complex Acoustic Scenarios | Litcius