Litcius/Paper detail

Arabic dialect identification using machine learning and transformer-based models: Submission to the NADI 2022 Shared Task

Nouf AlShenaifi, Aqil M. Azmi

202211 citationsDOIOpen Access PDF

Abstract

Arabic has a wide range of dialects. Dialect is the language variation of a specific community. In this paper, we show the models we created to participate in the third Nuanced Arabic Dialect Identification (NADI) shared task (Subtask 1) that involves developing a system to classify a tweet into a country-level dialect. We utilized a number of machine learning techniques as well as deep learning transformer-based models. For the machine learning approach, we build an ensemble classifier of various machine learning models. In our deep learning approach, we consider bidirectional LSTM model and AraBERT pretrained model. The results demonstrate that the deep learning approach performs noticeably better than the other machine learning approaches with 68.7% accuracy on the development set.

Topics & Concepts

Computer scienceArtificial intelligenceTransformerArabicDeep learningNatural language processingMachine learningMulti-task learningClassifier (UML)Task (project management)EngineeringLinguisticsVoltageElectrical engineeringPhilosophySystems engineeringNatural Language Processing TechniquesLinguistics and Cultural StudiesAuthorship Attribution and Profiling
Arabic dialect identification using machine learning and transformer-based models: Submission to the NADI 2022 Shared Task | Litcius