Litcius/Paper detail

Direction of Arrival Estimation of Sound Sources Using Icosahedral CNNs

David Diaz-Guerra, Antonio Miguel, José Ramón Beltrán

2022IEEE/ACM Transactions on Audio Speech and Language Processing35 citationsDOIOpen Access PDF

Abstract

In this paper, we present a new model for Direction of Arrival (DOA) estimation of sound sources based on an Icosahedral Convolutional Neural Network (CNN) applied over SRP-PHAT power maps computed from the signals received by a microphone array. This icosahedral CNN is equivariant to the 60 rotational symmetries of the icosahedron, which represent a good approximation of the continuous space of spherical rotations, and can be implemented using standard 2D convolutional layers, having a lower computational cost than most of the spherical CNNs. In addition, instead of using fully connected layers after the icosahedral convolutions, we propose a new soft-argmax function that can be seen as a differentiable version of the argmax function and allows us to solve the DOA estimation as a regression problem interpreting the output of the convolutional layers as a probability distribution. We prove that using models that fit the equivariances of the problem allows us to outperform other state-of-the-art models with a lower computational cost and more robustness, obtaining root mean square localization errors lower than <inline-formula xmlns:mml="http://www.w3.org/1998/Math/MathML" xmlns:xlink="http://www.w3.org/1999/xlink"><tex-math notation="LaTeX">$10^{\circ }$</tex-math></inline-formula> even in scenarios with a reverberation time <inline-formula xmlns:mml="http://www.w3.org/1998/Math/MathML" xmlns:xlink="http://www.w3.org/1999/xlink"><tex-math notation="LaTeX">$\mathbf {T_{60}}$</tex-math></inline-formula> of <inline-formula xmlns:mml="http://www.w3.org/1998/Math/MathML" xmlns:xlink="http://www.w3.org/1999/xlink"><tex-math notation="LaTeX">$1.5 \,\mathrm{s}$</tex-math></inline-formula> .

Topics & Concepts

Direction of arrivalReverberationConvolutional neural networkIcosahedral symmetryRobustness (evolution)AlgorithmComputer scienceDifferentiable functionMathematicsArtificial intelligenceAcousticsPhysicsMathematical analysisGeometryTelecommunicationsGeneAntenna (radio)ChemistryBiochemistrySpeech and Audio ProcessingMusic and Audio ProcessingUnderwater Acoustics Research
Direction of Arrival Estimation of Sound Sources Using Icosahedral CNNs | Litcius