A Hybrid CNN-LSTM Model With Word-Emoji Embedding For Improving The Twitter Sentiment Analysis on Indonesia's PPKM Policy
Syafrial Fachri Pane, Jenly Ramdan, Aji Gautama Putrada, Mohamad Nurkamal Fauzan, Rolly Maulana Awangga, Nur Alamsyah
Abstract
The policy of limiting community mobilization is implemented to reduce the daily rate of COVID-19. However, a high-accuracy sentiment analysis model can determine public sentiment toward such policies. Our research aims to improve the accuracy of the LSTM model on sentiment analysis of the Jakarta community towards PPKM using Indonesian language Tweets with emoji embedding. The first stage is modeling using the hybrid CNN-LSTM model. It is a combination between CNN and LSTM. The CNN model cites word embedding and emoji embedding features that reflect the dependence on temporary short-term sentiment. At the same time, LSTM builds long-term sentiment relationships between words and emojis. Next, the model evaluation uses Accuracy, Loss, the receiver operating curve (ROC), the precision and recall curve, and the area under curve (AUC) value to see the performance of the designed model. Based on the results of the tests, we conclude that the CNN-LSTM Hybrid Model performs better with the words+emoji dataset. The ROC AUC is 0.966, while the precision-recall curve AUC is 0.957.