Performance Comparison of Support Vector Machines, AdaBoost, and Random Forest for Sentiment Text Analysis and Classification
Ahmed Hussein Salman, Waleed A. Mahmoud Al‐Jawher
Abstract
In sentiment analysis, text analysis becomes an important process to derive useful information from the unstructured data. In this work, we study the performance of three advanced machine learning algorithms, Support Vector Machines (SVM), Random Forest, and AdaBoost, for a specific sentiment classification task. Each classifier was trained and evaluated on principal metrics such as Area Under the Curve (AUC), Classification Accuracy (CA), F1-Score, Precision, and Recall using the Bag of Words model for feature extraction. Those results show that the Random Forest approach beat both SVM and AdaBoost, with an AUC of 0.988, CA = 0.915, and F1-Score = 0.915 SVM demonstrated moderate performance with an AUC of 0.939 and an F1-Score of 0.845, while AdaBoost exhibited the worst performance in all metrics based on that ensemble model-based classifiers for data change predictions. Random Forest may thus be a powerful machine learning technique to implement for sentiment analysis in text.