Speech Denoising in the Waveform Domain With Self-Attention
Zhifeng Kong, Wei Ping, Ambrish Dantrey, Bryan Catanzaro
2022ICASSP 2022 - 2022 IEEE International Conference on Acoustics, Speech and Signal Processing (ICASSP)70 citationsDOI
Abstract
In this work, we present CleanUNet, a causal speech denoising model on the raw waveform. The proposed model is based on an encoder-decoder architecture combined with several self-attention blocks to refine its bottleneck representations, which is crucial to obtain good results. The model is optimized through a set of losses defined over both waveform and multi-resolution spectrograms. The proposed method outperforms the state-of-the-art models in terms of denoised speech quality from various objective and subjective evaluation metrics. <sup xmlns:mml="http://www.w3.org/1998/Math/MathML" xmlns:xlink="http://www.w3.org/1999/xlink">1</sup>
Topics & Concepts
SpectrogramWaveformComputer scienceNoise reductionSpeech recognitionBottleneckEncoderSet (abstract data type)Domain (mathematical analysis)Decoding methodsSpeech enhancementArtificial intelligencePattern recognition (psychology)AlgorithmMathematicsRadarProgramming languageTelecommunicationsEmbedded systemMathematical analysisOperating systemSpeech and Audio ProcessingSpeech Recognition and SynthesisMusic and Audio Processing