Litcius/Paper detail

Detecting Fake Audio of Arabic Speakers Using Self-Supervised Deep Learning

Zaynab M. Almutairi, Hebah ElGibreen

2023IEEE Access34 citationsDOIOpen Access PDF

Abstract

One of the most significant discussions in forensics is Audio Deepfake, where AI-generated tools are used to clone audio content of people’s voices. Although it was intended to improve people’s lives, attackers utilized it maliciously, compromising the public’s safety. Thus, Machine Learning (ML) and Deep Learning (DL) methods have been developed to detect imitated or synthetically faked voices. However, the developed methods suffered from massive training data or excessive pre-processing. To the author’s best knowledge, Arabic speech has not yet been explored with synthetic fake audio, and it is very limited to the challenged fakeness, which is imitation. This paper proposed a new Audio Deepfake detection method called Arabic-AD based on self-supervised learning techniques to detect both synthetic and imitated voices. Additionally, it contributed to the literature by creating the first synthetic dataset of a single speaker who perfectly speaks Modern Standard Arabic (MSA). Besides, the accent was also considered by collecting Arabic recordings from non-Arabic speakers to evaluate the robustness of Arabic-AD. Three extensive experiments were conducted to measure the proposed method and compare it to well-known benchmarks in literature. As a result, Arabic-AD outperformed other state-of-the-arts methods with the lowest EER rate (0.027%), and high detection accuracy (97%) while avoiding the need for excessive training.

Topics & Concepts

Computer scienceArabicArtificial intelligenceSpeech recognitionRobustness (evolution)Natural language processingDeep learningStress (linguistics)LinguisticsBiochemistryPhilosophyGeneChemistryDigital Media Forensic DetectionMusic and Audio ProcessingSpeech and Audio Processing