Litcius/Paper detail

Estimation Reliability Function Assisted Sound Source Localization With Enhanced Steering Vector Phase Difference

Longbiao Cheng, Xingwei Sun, Dingding Yao, Junfeng Li, Yonghong Yan

2020IEEE/ACM Transactions on Audio Speech and Language Processing17 citationsDOI

Abstract

The performance of the traditional direction-of-arrival (DOA) estimation algorithms greatly degrades in noisy and reverberant environments. Recently, deep learning has been applied to sound source localization and provided the substantial improvement in robustness for DOA estimation. In this paper, we propose a sound source localization approach using the deep learning-based steering vector phase difference enhancement. The steering vectors and their estimation reliability functions (ERFs) are first estimated under the guidance of the time-frequency masks that are predicted using deep neural network (DNN). The phase difference of the steering vectors is further enhanced with a second DNN model, which is trained with the ERF-weighted mean square error (MSE) loss. The DOA of the sound source is finally determined by the ERF-weighted histogram analysis. Experimental results with various types and levels of noise and various reverberant conditions show that the proposed approach outperforms the state-of-the-art sound source localization algorithms in utterance and frame-level DOA estimation.

Topics & Concepts

Computer scienceRobustness (evolution)Direction of arrivalArtificial neural networkMean squared errorReliability (semiconductor)HistogramSpeech recognitionPattern recognition (psychology)AlgorithmArtificial intelligenceMathematicsStatisticsImage (mathematics)Power (physics)Antenna (radio)TelecommunicationsBiochemistryChemistryQuantum mechanicsGenePhysicsSpeech and Audio ProcessingMusic and Audio ProcessingUnderwater Acoustics Research