Enhancing Arabic Sentiment Analysis in E-Commerce Reviews on Social Media Through a Stacked Ensemble Deep Learning Approach

Abstract

Sentiment analysis (SA) employs natural language processing techniques to extract opinions from textual data.Applying SA to the Arabic language presents numerous challenges, including ambiguity, the presence of multiple dialects, a need for additional resources, and morphological variation.The domain of Arabic SA has witnessed significant advancements with the application of deep learning (DL) approaches, such as convolutional neural networks (CNNs).The performance of single DL models has been further improved by hybrid models combining CNNs with bidirectional long short-term memory (Bi-LSTM) or bidirectional gated recurrent units (Bi-GRU).It is anticipated that the accuracy of these DL models can be enhanced through stacked deep learning ensembles.In this study, a stacked ensemble approach is proposed that accurately predicts Arabic sentiment by leveraging the predictive capabilities of CNN, Bi-GRU, Bi-LSTM, and hybrid DL models (CNN-Bi-GRU and CNN-Bi-LSTM).The proposed model's efficacy is evaluated using four extensive datasets: the HARD dataset, the BRAD dataset, the ARD dataset, and a real dataset composed of 71,583 Arabic reviews.Experimental results demonstrate the suitability of the proposed model for analyzing sentiments in Arabic texts.The method's first step involves feature extraction using the AraBERT model.Subsequently, five DL models are developed and trained, including CNN, Bi-GRU, Bi-LSTM, a hybrid CNN-Bi-GRU model, and a hybrid CNN-LSTM model.Finally, the outputs of the base classifiers are concatenated using the multilayer perceptron algorithm.Our approach achieves an improved accuracy of 0.9256 compared to basic and hybrid deep learning methods.

Topics & Concepts